Received item 28oujucmeue9eu44aceozq0au.


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[104656:1742229878.9505]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[104656:1742229878.9528]: Manhole UDS path: /tmp/manhole-104656
Manhole[104656:1742229878.9528]: Waiting for new connection (in pid:104656) ...


Settings listener connected.
Settings updated:  3 workers, 233 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://connect.facebook.net/login/?next=https%3A%2F%2Fconnect.facebook.net%2Flogin%2F%3Fnext%3Dhttps%253A%252F%252Fconnect.facebook.net%252Flogin%252F%253Fnext%253Dhttps%25253A%25252F%25252Fconnect.facebook.net%25252Flogin%25252F%25253Fnext%25253Dhttps%2525253A%2525252F%2525252Fconnect.facebook.net%2525252Flogin%2525252F%2525253Fnext%2525253Dhttps%252525253A%252525252F%252525252Fconnect.facebook.net%252525252Flogin%252525252F%252525253Fnext%252525253Dhttps%25252525253A%25252525252F%25252525252Fconnect.facebook.net%25252525252Flogin%25252525252F%25252525253Fnext%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Fconnect.facebook.net%2525252525252Flogin%2525252525252F%2525252525253Fnext%2525252525253Dhttps%252525252525253A%252525252525252F%252525252525252Fconnect.facebook.net%252525252525252Fen_US%252525252525252Fall.js’ encountered an error: Too many redirects.


DNS resolution failed: [Errno -2] Name or service not known


ERROR Fetching ‘https://ssl/’ encountered an error: DNS resolution failed: [Errno -2] Name or service not known


ERROR Fetching ‘http://www/’ encountered an error: DNS resolution failed: [Errno -2] Name or service not known


ERROR Fetching ‘https://swfgg.acool.com/upfiles/games/LEGO-Ninjago-Escape/index.html’ encountered an error: Connect timed out.


ERROR Fatal exception.
Traceback (most recent call last):
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/application/app.py", line 157, in run
    yield from pipeline.process()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 194, in process
    yield from self._process_one_worker()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 215, in _process_one_worker
    task.result()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 119, in process
    item = yield from self.process_one(_worker_id=worker_id)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 103, in process_one
    yield from task.process(item)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/application/tasks/download.py", line 492, in process
    yield from session.app_session.factory['Processor'].process(session)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/delegate.py", line 29, in process
    return (yield from processor.process(item_session))
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/web.py", line 92, in process
    return (yield from session.process())
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/web.py", line 186, in process
    yield from self._process_loop()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/web.py", line 245, in _process_loop
    exit_early, wait_time = yield from self._fetch_one(cast(Request, self._item_session.request))
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/web.py", line 309, in _fetch_one
    action = self._handle_response(request, response)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/web.py", line 424, in _handle_response
    self._processing_rule.scrape_document(self._item_session)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/rule.py", line 527, in scrape_document
    item_session.url_record.link_type
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/scraper/base.py", line 186, in scrape_info
    scrape_result = scraper.scrape(request, response, link_type)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/scraper/sitemap.py", line 37, in scrape
    for link in link_iter:
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/scraper/base.py", line 150, in iter_processed_links
    for link in self.iter_links(file, encoding):
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/document/sitemap.py", line 69, in iter_links
    for html_obj in self._html_parser.parse(file, encoding):
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/document/htmlparse/lxml_.py", line 121, in parse
    parser_type=parser_type):
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/document/htmlparse/lxml_.py", line 171, in parse_lxml
    data = file.read(self.BUFFER_SIZE)
  File "/home/archivebot/.pyenv/versions/3.6.15/lib/python3.6/gzip.py", line 276, in read
    return self._buffer.read(size)
  File "/home/archivebot/.pyenv/versions/3.6.15/lib/python3.6/_compression.py", line 68, in readinto
    data = self.read(len(byte_view))
  File "/home/archivebot/.pyenv/versions/3.6.15/lib/python3.6/gzip.py", line 482, in read
    raise EOFError("Compressed file ended before the "
EOFError: Compressed file ended before the end-of-stream marker was reached


CRITICAL Sorry, Wpull unexpectedly crashed.


CRITICAL Please report this problem to the authors at Wpull's issue tracker so it may be fixed. If you know how to program, maybe help us fix it? Thank you for helping us help you help us all.


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Starting CompressLogIfNoMetaWarc for Item