Received item a7k2xvvpwk6e1rjfv2ozg87o6.


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[1047163:1760008639.9796]: Patched <built-in function fork> and <built-in function forkpty>.


Manhole[1047163:1760008639.9805]: Manhole UDS path: /tmp/manhole-1047163
Manhole[1047163:1760008639.9806]: Waiting for new connection (in pid:1047163) ...


ERROR Fetching ‘https://www.canadiandefencereview.com/’ encountered an error: Connect timed out.


Settings listener connected.
Settings updated:  3 workers, 220 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241008/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://www.canadiandefencereview.com/robots.txt’ encountered an error: Connect timed out.


Settings updated:  3 workers, 220 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


Wpull terminating on bot command


Settings listener died; restarting.
Wpull terminating on bot command


ERROR Fetching ‘https://www.canadiandefencereview.com/sitemap.xml’ encountered an error: Connect timed out.


Settings listener connected.
Settings listener died; restarting.
Wpull terminating on bot command


ERROR HookStop: Script requested immediate stop.


Settings listener connected.


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Adjusted target WARC path to /home/archivebot/ArchiveBot-b/pipeline/data/1760008372d48042df2bb3a21f-332/www.canadiandefencereview.com-inf-20251009-111719-a7k2x-aborted


Starting CompressLogIfNoMetaWarc for Item


Finished CompressLogIfNoMetaWarc for Item


Starting WriteInfo for Item


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Settings listener connected.
Settings updated:  3 workers, 220 ignores, delay min/max: [250, 375] ms, suppressing ignore reports
  0 bytes.


Manhole[657748:1760008779.5087]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[657748:1760008779.5111]: Manhole UDS path: /tmp/manhole-657748
Manhole[657748:1760008779.5112]: Waiting for new connection (in pid:657748) ...
ERROR Fetching ‘https://www.canadiandefencereview.com/’ encountered an error: Connection closed.
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20230414/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://www.canadiandefencereview.com/robots.txt’ encountered an error: Connection closed.
ERROR Fetching ‘https://www.canadiandefencereview.com/sitemap.xml’ encountered an error: Connection closed.
ERROR Fetching ‘https://www.canadiandefencereview.com/’ encountered an error: Connection closed.
ERROR Fetching ‘https://www.canadiandefencereview.com/robots.txt’ encountered an error: Connection closed.
ERROR Fetching ‘https://www.canadiandefencereview.com/sitemap.xml’ encountered an error: Connection closed.
ERROR Fetching ‘https://www.canadiandefencereview.com/’ encountered an error: Connection closed.
ERROR Fetching ‘https://www.canadiandefencereview.com/sitemap.xml’ encountered an error: Connection closed.
ERROR Fetching ‘https://www.canadiandefencereview.com/robots.txt’ encountered an error: Connection closed.


Starting MoveFiles for Item


Finished MoveFiles for Item


Starting StopHeartbeat for Item


Finished StopHeartbeat for Item


Starting MarkItemAsDone for Item


Mozilla/5.0 (Windows NT 6.1; rv:60.0) Gecko/20100101 Firefox/60.0


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[1047230:1760008887.8288]: Patched <built-in function fork> and <built-in function forkpty>.


Manhole[1047230:1760008887.8306]: Manhole UDS path: /tmp/manhole-1047230
Manhole[1047230:1760008887.8307]: Waiting for new connection (in pid:1047230) ...


Settings listener disconnected (cause: Error 111 connecting to 127.0.0.1:16379. Connection refused.).Reconnecting in 5.0 seconds.
Settings listener connected.
Settings updated:  3 workers, 220 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


Wpull terminating on bot command


Settings listener connected.


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Adjusted target WARC path to /home/archivebot/ArchiveBot-b/pipeline/data/1760008691154ee34842d75ab1-333/www.canadiandefencereview.com-inf-20251009-112127-a7k2x-aborted


Starting MoveFiles for Item


Received item a7k2xvvpwk6e1rjfv2ozg87o6.


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[476328:1760027567.6078]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[476328:1760027567.6096]: Manhole UDS path: /tmp/manhole-476328
Manhole[476328:1760027567.6097]: Waiting for new connection (in pid:476328) ...


Settings listener connected.
Settings updated:  3 workers, 220 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241203/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


0 bytes.


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Manhole[476417:1760027678.9046]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[476417:1760027678.9070]: Manhole UDS path: /tmp/manhole-476417
Manhole[476417:1760027678.9070]: Waiting for new connection (in pid:476417) ...


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Settings listener connected.
Settings updated:  3 workers, 220 ignores, delay min/max: [250, 375] ms, suppressing ignore reports
  54819404 bytes.


Manhole[2130091:1760027744.4770]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[2130091:1760027744.4790]: Manhole UDS path: /tmp/manhole-2130091
Manhole[2130091:1760027744.4790]: Waiting for new connection (in pid:2130091) ...
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Starting MoveFiles for Item


Finished MoveFiles for Item


Starting StopHeartbeat for Item


Finished StopHeartbeat for Item


Starting MarkItemAsDone for Item