Received item co4a2dl43wqle3fygaxt3oyuy.


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[1791852:1750648808.5104]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[1791852:1750648808.5122]: Manhole UDS path: /tmp/manhole-1791852
Manhole[1791852:1750648808.5123]: Waiting for new connection (in pid:1791852) ...


Settings listener connected.
Settings updated:  3 workers, 234 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


ERROR Fetching ‘https://ctbaonline.org/’ encountered an error: Connection closed.


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241203/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://ctbaonline.org/robots.txt’ encountered an error: Connection closed.
ERROR Fetching ‘https://ctbaonline.org/sitemap.xml’ encountered an error: Connection closed.
ERROR Fetching ‘https://ctbaonline.org/’ encountered an error: Connection closed.


ERROR Fetching ‘https://ctbaonline.org/’ encountered an error: Connection closed.
ERROR Fetching ‘https://ctbaonline.org/sitemap.xml’ encountered an error: Connection closed.
ERROR Fetching ‘https://ctbaonline.org/robots.txt’ encountered an error: Connection closed.


0 bytes.


ERROR Fetching ‘https://ctbaonline.org/sitemap.xml’ encountered an error: Connection closed.
ERROR Fetching ‘https://ctbaonline.org/robots.txt’ encountered an error: Connection closed.


Mozilla/5.0 (Windows NT 6.1; rv:60.0) Gecko/20100101 Firefox/60.0


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[2103824:1750649487.0437]: Patched <built-in function fork> and <built-in function forkpty>.


Manhole[2103824:1750649487.0454]: Manhole UDS path: /tmp/manhole-2103824


Manhole[2103824:1750649487.0465]: Waiting for new connection (in pid:2103824) ...


ERROR Fetching ‘https://ctbaonline.org/’ encountered an error: Connect timed out.


Settings listener connected.
Settings updated:  3 workers, 221 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


Settings updated:  3 workers, 221 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241008/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://ctbaonline.org/robots.txt’ encountered an error: Connect timed out.


Wpull terminating on bot command


ERROR Fetching ‘https://ctbaonline.org/sitemap.xml’ encountered an error: Connect timed out.


Settings listener died; restarting.
Wpull terminating on bot command


Settings listener connected.
Settings listener died; restarting.
Wpull terminating on bot command


Settings listener connected.


ERROR HookStop: Script requested immediate stop.


Adjusted target WARC path to /home/archivebot/ArchiveBot-d/pipeline/data/1750649480a4f845987f83f1f6-3081/ctbaonline.org-inf-20250623-033126-co4a2-aborted


Starting CompressLogIfNoMetaWarc for Item


Finished CompressLogIfNoMetaWarc for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting MoveFiles for Item


Finished MoveFiles for Item


Starting StopHeartbeat for Item


Finished StopHeartbeat for Item


Starting MarkItemAsDone for Item


Received item co4a2dl43wqle3fygaxt3oyuy.


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[1938151:1750649601.0051]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[1938151:1750649601.0077]: Manhole UDS path: /tmp/manhole-1938151
Manhole[1938151:1750649601.0077]: Waiting for new connection (in pid:1938151) ...


Settings listener connected.
Settings updated:  3 workers, 234 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


DNS resolution failed: [Errno -2] Name or service not known


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20230414/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘http://ctba.local.prod/’ encountered an error: DNS resolution failed: [Errno -2] Name or service not known


Settings updated:  3 workers, 235 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


ERROR Fetching ‘http://193.201.224.233/m.js?d=1’ encountered an error: Connect timed out.


ERROR Fetching ‘https://www.medtargetsystem.local/analytics/collect.gif’ encountered an error: DNS resolution failed: [Errno -2] Name or service not known


115428848 bytes.


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting MoveFiles for Item


Finished MoveFiles for Item


Starting StopHeartbeat for Item


Finished StopHeartbeat for Item


Starting MarkItemAsDone for Item