type: stdout

message: Received item 2l061r0tu470x51chu5p009sg.

fetch_depth: inf

started_by: pabs

started_in: #archivebot

suppress_ignore_reports: true


message: Starting StartHeartbeat for Item


message: Finished StartHeartbeat for Item


message: Starting SetFetchDepth for Item


message: Finished SetFetchDepth for Item


message: Starting PreparePaths for Item


message: Finished PreparePaths for Item


message: Starting WriteInfo for Item


message: Finished WriteInfo for Item


message: Starting DownloadUrlFile for Item


message: Starting WgetDownload for Item


message: Manhole[1662263:1741492918.8218]: Patched <built-in function fork> and <built-in function forkpty>.


message: Manhole[1662263:1741492918.8260]: Manhole UDS path: /tmp/manhole-1662263


message: Manhole[1662263:1741492918.8267]: Waiting for new connection (in pid:1662263) ...


message:
ERROR Fatal exception.
Traceback (most recent call last):
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/network/connection.py", line 299, in run_network_operation
    data = yield from asyncio.wait_for(task, wait_timeout)
  File "/home/archivebot/.pyenv/versions/3.6.15/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
    return fut.result()
  File "/home/archivebot/.pyenv/versions/3.6.15/lib/python3.6/asyncio/streams.py", line 81, in open_connection
    lambda: protocol, host, port, **kwds)
  File "/home/archivebot/.pyenv/versions/3.6.15/lib/python3.6/asyncio/base_events.py", line 798, in create_connection
    raise exceptions[0]
  File "/home/archivebot/.pyenv/versions/3.6.15/lib/python3.6/asyncio/base_events.py", line 785, in create_connection
    yield from self.sock_connect(sock, address)
  File "/home/archivebot/.pyenv/versions/3.6.15/lib/python3.6/asyncio/selector_events.py", line 439, in sock_connect
    return (yield from fut)
  File "/home/archivebot/.pyenv/versions/3.6.15/lib/python3.6/asyncio/selector_events.py", line 469, in _sock_connect_cb
    raise OSError(err, 'Connect call failed %s' % (address,))
ConnectionRefusedError: [Errno 111] Connect call failed ('69.163.185.110', 21)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/processor/ftp.py", line 267, in _fetch
    response = yield from session.start_listing(request)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/ftp/client.py", line 173, in start_listing
    yield from self._prepare_fetch(request, response)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/ftp/client.py", line 216, in _prepare_fetch
    yield from self._control_stream.reconnect()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/ftp/stream.py", line 100, in reconnect
    yield from self._connection.connect()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/network/pool.py", line 382, in connect
    yield from self._primary_connection.connect()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/network/connection.py", line 194, in connect
    name='Connect')
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/network/connection.py", line 327, in run_network_operation
    error.errno, os.strerror(error.errno)) from error
wpull.errors.ConnectionRefused: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/application/app.py", line 157, in run
    yield from pipeline.process()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 194, in process
    yield from self._process_one_worker()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 215, in _process_one_worker
    task.result()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 119, in process
    item = yield from self.process_one(_worker_id=worker_id)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 103, in process_one
    yield from task.process(item)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/application/tasks/download.py", line 492, in process
    yield from session.app_session.factory['Processor'].process(session)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/processor/delegate.py", line 29, in process
    return (yield from processor.process(item_session))
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/processor/ftp.py", line 100, in process
    return (yield from session.process())
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/processor/ftp.py", line 151, in process
    wait_time = yield from self._fetch(request, is_file)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/processor/ftp.py", line 292, in _fetch
    response.body, duration_timeout=duration_timeout)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/abstract/client.py", line 53, in __exit__
    self.recycle()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/ftp/client.py", line 410, in recycle
    connection_closed=self._control_connection.closed()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/application/hook.py", line 134, in notify
    callback(*args, **kwargs)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/warc/recorder.py", line 665, in end_control
    hostname, port = self._request_hostname_port()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/warc/recorder.py", line 714, in _request_hostname_port
    hostname = self._request.address[0]
AttributeError: 'NoneType' object has no attribute 'address'


message:
CRITICAL Sorry, Wpull unexpectedly crashed.
CRITICAL Please report this problem to the authors at Wpull's issue tracker so it may be fixed. If you know how to program, maybe help us fix it? Thank you for helping us help you help us all.


message: Settings listener connected.


message: Finished WgetDownload for Item


message: Starting RelabelIfAborted for Item


message: Starting CompressLogIfNoMetaWarc for Item

last_trimmed_log_entry: +inf


message: Finished CompressLogIfNoMetaWarc for Item


message: Starting WriteInfo for Item


message: Finished WriteInfo for Item


message: Starting MoveFiles for Item


message: Finished MoveFiles for Item


message: Starting StopHeartbeat for Item


message: Finished StopHeartbeat for Item


message: Starting MarkItemAsDone for Item