Received item dwx6bipfvirrz2w0ev64qh1xs.


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Settings listener connected.
Settings updated:  3 workers, 220 ignores, delay min/max: [250, 375] ms, suppressing ignore reports
  1377 bytes.


Manhole[13595:1773883051.9525]: Manhole UDS path: /tmp/manhole-13595
Manhole[13595:1773883051.9525]: Waiting for new connection (in pid:13595) ...
Manhole[13595:1773883051.9537]: Patched <built-in function fork> and <built-in function forkpty>.
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Starting CompressLogIfNoMetaWarc for Item


Finished CompressLogIfNoMetaWarc for Item


Starting MoveFiles for Item


Finished MoveFiles for Item


Starting StopHeartbeat for Item


Finished StopHeartbeat for Item


Starting MarkItemAsDone for Item


Should redirect to https://www.afternic.com/forsale/www.com in browser.

Mozilla/5.0 (Windows NT 6.1; rv:60.0) Gecko/20100101 Firefox/60.0


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[13770:1773883341.9734]: Manhole UDS path: /tmp/manhole-13770
Manhole[13770:1773883341.9801]: Waiting for new connection (in pid:13770) ...
Manhole[13770:1773883341.9802]: Patched <built-in function fork> and <built-in function forkpty>.
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Attempt #2. Should 302 to https://www.afternic.com/forsale/www.com in browser.

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_6) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.1 Safari/605.1.15


Manhole[14226:1773884092.2662]: Manhole UDS path: /tmp/manhole-14226
Manhole[14226:1773884092.2662]: Waiting for new connection (in pid:14226) ...
Manhole[14226:1773884092.2662]: Patched <built-in function fork> and <built-in function forkpty>.
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Attempt #3. Should 302 to https://www.afternic.com/forsale/www.com in browser.


Settings listener connected.
  1377 bytes.


Manhole[14331:1773884271.7125]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[14331:1773884271.7155]: Manhole UDS path: /tmp/manhole-14331
Manhole[14331:1773884271.7156]: Waiting for new connection (in pid:14331) ...
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Starting MoveFiles for Item


Finished MoveFiles for Item


Starting StopHeartbeat for Item


Finished StopHeartbeat for Item


Starting MarkItemAsDone for Item


Attempt #4. Should 302 to https://www.afternic.com/forsale/www.com in browser.

Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


  1377 bytes.
Settings listener connected.


Manhole[14485:1773884474.7389]: Manhole UDS path: /tmp/manhole-14485
Manhole[14485:1773884474.7390]: Waiting for new connection (in pid:14485) ...
Manhole[14485:1773884474.7401]: Patched <built-in function fork> and <built-in function forkpty>.
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Attempt #5. Should 302 to https://www.afternic.com/forsale/www.com in browser.

Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.140 Safari/537.36 Edge/18.17763


Manhole[14544:1773884606.8533]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[14544:1773884606.8575]: Manhole UDS path: /tmp/manhole-14544
Manhole[14544:1773884606.8575]: Waiting for new connection (in pid:14544) ...
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Attempt #6. Should 302 to https://www.afternic.com/forsale/www.com in browser.

Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; WOW64; Trident/6.0)


Manhole[14611:1773884750.9566]: Manhole UDS path: /tmp/manhole-14611
Manhole[14611:1773884750.9567]: Waiting for new connection (in pid:14611) ...
Manhole[14611:1773884750.9602]: Patched <built-in function fork> and <built-in function forkpty>.
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Starting MoveFiles for Item


Finished MoveFiles for Item


Starting StopHeartbeat for Item


Finished StopHeartbeat for Item


Starting MarkItemAsDone for Item


Attempt #7. Should 302 to https://www.afternic.com/forsale/www.com in browser.

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[14683:1773884875.1798]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[14683:1773884875.1828]: Manhole UDS path: /tmp/manhole-14683
Manhole[14683:1773884875.1829]: Waiting for new connection (in pid:14683) ...
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Starting MoveFiles for Item


Finished MoveFiles for Item


Starting StopHeartbeat for Item


Finished StopHeartbeat for Item


Starting MarkItemAsDone for Item


Attempt #8. Should 302 to https://www.afternic.com/forsale/www.com in browser.

Mozilla/5.0 (Linux; Android 5.0.2; Nexus 7 Build/LRX22G) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.61 Safari/537.36


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[14739:1773884963.9844]: Manhole UDS path: /tmp/manhole-14739
Manhole[14739:1773884963.9844]: Waiting for new connection (in pid:14739) ...
Manhole[14739:1773884963.9845]: Patched <built-in function fork> and <built-in function forkpty>.
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Attempt #9. Should 302 to https://www.afternic.com/forsale/www.com.

Mozilla/5.0 (iPhone; U; CPU iPhone OS 8_1_2 like Mac OS X; en) AppleWebKit/600.1.4 (KHTML, like Gecko) CriOS/39.0.2171.50 Mobile/12B440 Safari/600.1.4


Manhole[14777:1773885042.1708]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[14777:1773885042.1735]: Manhole UDS path: /tmp/manhole-14777
Manhole[14777:1773885042.1735]: Waiting for new connection (in pid:14777) ...
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Attempt #10. Should 302 to https://www.afternic.com/forsale/www.com.

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36


Manhole[14851:1773885150.6804]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[14851:1773885150.6831]: Manhole UDS path: /tmp/manhole-14851
Manhole[14851:1773885150.6831]: Waiting for new connection (in pid:14851) ...
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Received item dwx6bipfvirrz2w0ev64qh1xs.

Attempt #11. Should 302 to https://www.afternic.com/forsale/www.com.

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[14911:1773885231.4491]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[14911:1773885231.4517]: Manhole UDS path: /tmp/manhole-14911
Manhole[14911:1773885231.4517]: Waiting for new connection (in pid:14911) ...
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Attempt #12. Should 302 to https://www.afternic.com/forsale/www.com.


Manhole[14957:1773885298.9635]: Manhole UDS path: /tmp/manhole-14957
Manhole[14957:1773885298.9636]: Waiting for new connection (in pid:14957) ...
Manhole[14957:1773885298.9642]: Patched <built-in function fork> and <built-in function forkpty>.
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Mozilla/5.0 (Android; Mobile; rv:66.0) Gecko/66.0 Firefox/66.0

Attempt #13. Should 302 to https://www.afternic.com/forsale/www.com.


Settings listener connected.
Settings updated:  3 workers, 220 ignores, delay min/max: [250, 375] ms, suppressing ignore reports
  1377 bytes.


Manhole[15020:1773885387.3593]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[15020:1773885387.3667]: Manhole UDS path: /tmp/manhole-15020
Manhole[15020:1773885387.3668]: Waiting for new connection (in pid:15020) ...
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Attempt #14. Should 302 to https://www.afternic.com/forsale/www.com.

Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/533.20.25 (KHTML, like Gecko) Version/5.0.4 Safari/533.20.27


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[15090:1773885450.9727]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[15090:1773885450.9739]: Manhole UDS path: /tmp/manhole-15090
Manhole[15090:1773885450.9739]: Waiting for new connection (in pid:15090) ...
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Attempt #15. Should 302 to https://www.afternic.com/forsale/www.com.

Mozilla/5.0 (iPad; CPU OS 12_2 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.1 Mobile/15E148 Safari/604.1


Manhole[15150:1773885542.0419]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[15150:1773885542.0452]: Manhole UDS path: /tmp/manhole-15150
Manhole[15150:1773885542.0452]: Waiting for new connection (in pid:15150) ...
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Starting CompressLogIfNoMetaWarc for Item


Finished CompressLogIfNoMetaWarc for Item


Starting MoveFiles for Item


Finished MoveFiles for Item


Starting StopHeartbeat for Item


Finished StopHeartbeat for Item


Starting MarkItemAsDone for Item


Mozilla/5.0 (iPad; CPU OS 9_2_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13D15 Safari/601.1

Attempt #16. Should 302 to https://www.afternic.com/forsale/www.com.


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[15214:1773885654.8467]: Manhole UDS path: /tmp/manhole-15214
Manhole[15214:1773885654.8468]: Waiting for new connection (in pid:15214) ...
Manhole[15214:1773885654.8470]: Patched <built-in function fork> and <built-in function forkpty>.
/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20240430/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Starting MoveFiles for Item


Finished MoveFiles for Item


Starting StopHeartbeat for Item


Finished StopHeartbeat for Item


Starting MarkItemAsDone for Item