Re: Python AH Buyer / Seller / ffxiah.com scrubber
Posted: Fri Dec 28, 2018 6:16 pm
There are (2) column options "Rate01, Rate12". Can anyone explain what this does and give me an example of how it would be written please?
Go to LandSandBoat
http://forums.dspt.info:80/
They aren't used (yet). You can see the intended future use right on the instruction page. http://adamgagorik.github.io/pydarkstar ... usage.htmlFearmonger wrote: ↑Fri Dec 28, 2018 6:16 pmThere are (2) column options "Rate01, Rate12". Can anyone explain what this does and give me an example of how it would be written please?
Code: Select all
[2019-02-10 14:23:49,594][ 3996][INFO ]: (0x29b5588) Options: config = config.yaml
[2019-02-10 14:23:49,594][ 3996][INFO ]: (0x29b5588) Options: verbose = True
[2019-02-10 14:23:49,595][ 3996][INFO ]: (0x29b5588) Options: silent = False
[2019-02-10 14:23:49,595][ 3996][INFO ]: (0x29b5588) Options: stub = items
[2019-02-10 14:23:49,595][ 3996][INFO ]: (0x29b5588) Options: overwrite = False
[2019-02-10 14:23:49,595][ 3996][INFO ]: (0x29b5588) Options: backup = True
[2019-02-10 14:23:49,596][ 3996][INFO ]: (0x29b5588) Options: stock01 = 3
[2019-02-10 14:23:49,596][ 3996][INFO ]: (0x29b5588) Options: stock12 = 3
[2019-02-10 14:23:49,596][ 3996][INFO ]: (0x29b5588) Options: itemids = ????
[2019-02-10 14:23:49,596][ 3996][INFO ]: (0x29b5588) Options: urls = ????
[2019-02-10 14:23:49,597][ 3996][DEBUG]: (0x3d940f0) FFXIAHScrubber: init
[2019-02-10 14:23:49,598][ 3996][DEBUG]: (0x3d940f0) FFXIAHScrubber: forcing redownload of data
[2019-02-10 14:23:49,598][ 3996][DEBUG]: (0x3d940f0) FFXIAHScrubber: getting category urls
[2019-02-10 14:23:49,598][ 3996][DEBUG]: (0x3d940f0) FFXIAHScrubber: open https://www.ffxiah.com/browse
[2019-02-10 14:23:49,600][ 3996][ERROR]: urlopen failed (attempt 1)
Traceback (most recent call last):
File "C:\Users\Highwind\Desktop\ah\pydarkstar\scrubbing\scrubber.py", line 33, in soup
handle = urlopen(url)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 525, in open
response = self._open(req, data)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 548, in _open
'unknown_open', req)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 503, in _call_chain
result = func(*args)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 1387, in unknown_open
raise URLError('unknown url type: %s' % type)
urllib.error.URLError: <urlopen error unknown url type: https>
[2019-02-10 14:24:01,679][ 3996][ERROR]: the maximum urlopen attempts have been reached
[2019-02-10 14:24:01,681][ 3996][ERROR]: caught unhandled excetion
Traceback (most recent call last):
File "C:\Users\Highwind\Desktop\ah\pydarkstar\logutils.py", line 45, in capture
yield
File "C:\Users\Highwind\Desktop\ah\bin\scrub.py", line 21, in <module>
pydarkstar.apps.scrub.run.main()
File "C:\Users\Highwind\Desktop\ah\pydarkstar\apps\scrub\run.py", line 35, in main
data = scrubber.scrub(force=True, threads=-1, urls=opts.urls, ids=opts.itemids)
File "C:\Users\Highwind\Desktop\ah\pydarkstar\scrubbing\ffxiah.py", line 63, in scrub
urls = self._get_category_urls()
File "C:\Users\Highwind\Desktop\ah\pydarkstar\scrubbing\ffxiah.py", line 194, in _get_category_urls
soup = self.soup(path)
File "C:\Users\Highwind\Desktop\ah\pydarkstar\scrubbing\scrubber.py", line 33, in soup
handle = urlopen(url)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 525, in open
response = self._open(req, data)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 548, in _open
'unknown_open', req)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 503, in _call_chain
result = func(*args)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 1387, in unknown_open
raise URLError('unknown url type: %s' % type)
urllib.error.URLError: <urlopen error unknown url type: https>
[2019-02-10 14:24:01,704][ 3996][INFO ]: exit
Ok that's work now but my auction house dont want see the price for each item. Any idea?Alexandre24 wrote: ↑Sun Sep 08, 2019 9:22 amHe can't found this f**** file! Please help me..
(base) C:\Users\alexa\Documents\pydarkstar>python -m pydarkstar.apps.broker.run
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: config = config.yaml
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: verbose = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: silent = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: hostname = 127.0.0.1
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: database = dspdb
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: username = root
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: password = ????
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: fail = False
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: data = []
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: name = Zissou
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: restock = 3600
[2019-09-08 10:21:42][ 9828][INFO ]: (0x1bab3cce908) Options: tick = 30
[2019-09-08 10:21:42][ 9828][ERROR]: caught unhandled excetion
Traceback (most recent call last):
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\logutils.py", line 45, in capture
yield
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\apps\broker\run.py", line 66, in <module>
main()
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\apps\broker\run.py", line 34, in main
idata = ItemList.from_csv(*opts.data)
File "C:\Users\alexa\Documents\pydarkstar\pydarkstar\itemlist.py", line 24, in from_csv
raise RuntimeError('missing item data CSV!')
RuntimeError: missing item data CSV!
[2019-09-08 10:21:42][ 9828][INFO ]: exit