Received item 3fug406g7m3fs9g3zdl6ul9vg.


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[2137635:1756628007.5290]: Manhole UDS path: /tmp/manhole-2137635
Manhole[2137635:1756628007.5290]: Waiting for new connection (in pid:2137635) ...
Manhole[2137635:1756628007.5291]: Patched <built-in function fork> and <built-in function forkpty>.


Settings listener connected.
Settings updated:  3 workers, 269 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20230414/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


0 bytes.


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Settings listener connected.
Settings updated:  3 workers, 268 ignores, delay min/max: [250, 375] ms, suppressing ignore reports
Settings updated:  1 workers, 268 ignores, delay min/max: [250, 375] ms, suppressing ignore reports
Settings updated:  1 workers, 268 ignores, delay min/max: [300000, 300000] ms, suppressing ignore reports


Manhole[1507320:1756628396.9120]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[1507320:1756628396.9140]: Manhole UDS path: /tmp/manhole-1507320
Manhole[1507320:1756628396.9140]: Waiting for new connection (in pid:1507320) ...


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR HookStop: Script requested immediate stop.


Settings updated:  1 workers, 268 ignores, delay min/max: [1000, 1000] ms, suppressing ignore reports
Wpull terminating on bot command


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[3048635:1756631076.1889]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[3048635:1756631076.1909]: Manhole UDS path: /tmp/manhole-3048635
Manhole[3048635:1756631076.1911]: Waiting for new connection (in pid:3048635) ...


Settings listener connected.
Settings updated:  1 workers, 270 ignores, delay min/max: [2500, 2500] ms, suppressing ignore reports


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241203/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://www.openfabrics.org/wp-sitemap-taxonomies-post_tag-1.xml’ encountered an error: Connection closed.


Settings updated:  1 workers, 270 ignores, delay min/max: [300000, 300000] ms, suppressing ignore reports


Settings updated:  1 workers, 270 ignores, delay min/max: [1000, 1000] ms, suppressing ignore reports
Wpull terminating on bot command


ERROR HookStop: Script requested immediate stop.


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


proactive; attempt 4; starts returning 503s after hitting 404s in "quick" succession


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Settings listener connected.
Settings updated:  1 workers, 271 ignores, delay min/max: [2500, 2500] ms, suppressing ignore reports


Manhole[3230539:1756636533.6928]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[3230539:1756636533.6951]: Manhole UDS path: /tmp/manhole-3230539
Manhole[3230539:1756636533.6951]: Waiting for new connection (in pid:3230539) ...


Settings updated:  1 workers, 271 ignores, delay min/max: [2500, 2500] ms, suppressing ignore reports
Wpull terminating on bot command


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241203/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR HookStop: Script requested immediate stop.


Finished WgetDownload for Item


Received item 3fug406g7m3fs9g3zdl6ul9vg.

proactive; attempt 5; starts returning 503s after hitting 404s

Mozilla/5.0 (Windows NT 6.1; rv:60.0) Gecko/20100101 Firefox/60.0


Manhole[72342:1756637097.8716]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[72342:1756637097.8719]: Manhole UDS path: /tmp/manhole-72342
Manhole[72342:1756637097.8720]: Waiting for new connection (in pid:72342) ...


Settings listener connected.
Settings updated:  1 workers, 271 ignores, delay min/max: [30000, 30000] ms, suppressing ignore reports


Settings updated:  1 workers, 273 ignores, delay min/max: [3000, 7000] ms, suppressing ignore reports


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241101/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://www.openfabrics.org/wp-sitemap.xml’ encountered an error: Connection closed.


ERROR Fetching ‘https://www.openfabrics.org/wp-content/uploads/2018/06/SNL-160x85_c.jpg’ encountered an error: Connection closed.


ERROR Fetching ‘https://www.openfabrics.org/wp-content/themes/kallyas/css/template.min.css?ver=4.22.0’ encountered an error: Connection closed.


Settings updated:  1 workers, 274 ignores, delay min/max: [3000, 7000] ms, suppressing ignore reports


ERROR Fetching ‘https://www.openfabrics.org/media-kit/’ encountered an error: Connection closed.


ERROR Fetching ‘https://www.openfabrics.org/wp-includes/js/underscore.min.js?ver=1.13.7’ encountered an error: Connection closed.


ERROR Fetching ‘https://www.openfabrics.org/wp-json/wp-statistics/v2’ encountered an error: Connection closed.


Settings updated:  1 workers, 275 ignores, delay min/max: [3000, 7000] ms, suppressing ignore reports


Settings updated:  1 workers, 276 ignores, delay min/max: [3000, 7000] ms, suppressing ignore reports


Settings updated:  1 workers, 277 ignores, delay min/max: [3000, 7000] ms, suppressing ignore reports


Wpull terminating on bot command


ERROR HookStop: Script requested immediate stop.


proactive; attempt 6; starts returning 503s after hitting 404s


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[2774617:1756638584.1197]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[2774617:1756638584.1216]: Manhole UDS path: /tmp/manhole-2774617
Manhole[2774617:1756638584.1217]: Waiting for new connection (in pid:2774617) ...


Settings listener connected.
Settings updated:  1 workers, 277 ignores, delay min/max: [3000, 7000] ms, suppressing ignore reports


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240904/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://www.openfabrics.org/wp-content/uploads/logo-gallery/logo-gallery_OpenFabricLogo.jpg’ encountered an error: Connection closed.


ERROR Fetching ‘https://www.openfabrics.org/wp-content/themes/kallyas/template_helpers/icons/glyphicons_halflingsregular/glyphicons_halflingsregular.woff’ encountered an error: Connection closed.


Settings updated:  1 workers, 278 ignores, delay min/max: [3000, 7000] ms, suppressing ignore reports


ERROR Fetching ‘https://www.openfabrics.org/wp-content/uploads/2024-workshop/2024-workshop-presentations/session-12.pdf’ encountered an error: Connection closed.


Settings updated:  1 workers, 278 ignores, delay min/max: [300000, 300000] ms, suppressing ignore reports


Settings updated:  1 workers, 278 ignores, delay min/max: [6000, 9000] ms, suppressing ignore reports


proactive; attempt 6; starts returning 503s after hitting 404s (only non-media URLs)


Settings updated:  1 workers, 278 ignores, delay min/max: [20000, 30000] ms, suppressing ignore reports


Settings updated:  1 workers, 279 ignores, delay min/max: [20000, 30000] ms, suppressing ignore reports


Settings updated:  1 workers, 279 ignores, delay min/max: [300000, 300000] ms, suppressing ignore reports