Received item emhf0uv9qfw7tp8vydo1n86xj.

For IDK; English version not found in sitemap; 'english one is abandoned since around 2015'

Mozilla/5.0 (Windows NT 6.1; rv:60.0) Gecko/20100101 Firefox/60.0


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[1717956:1750518610.9499]: Patched <built-in function fork> and <built-in function forkpty>.


Manhole[1717956:1750518610.9517]: Manhole UDS path: /tmp/manhole-1717956
Manhole[1717956:1750518610.9518]: Waiting for new connection (in pid:1717956) ...


Settings listener connected.
Settings updated:  3 workers, 233 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


ERROR Fetching ‘https://www.edu.cn/english/’ encountered an error: Connection closed.


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://www.edu.cn/robots.txt’ encountered an error: Connection closed.


ERROR Fetching ‘https://www.edu.cn/sitemap.xml’ encountered an error: Connection closed.


ERROR Fetching ‘https://www.edu.cn/robots.txt’ encountered an error: Connection closed.


ERROR Fetching ‘https://www.edu.cn/robots.txt’ encountered an error: Connection closed.
ERROR Fetching ‘https://www.edu.cn/english/’ encountered an error: Connection closed.
ERROR Fetching ‘https://www.edu.cn/sitemap.xml’ encountered an error: Connection closed.


0 bytes.


Attempt 2 - For IDK; English version not found in sitemap; 'english one is abandoned since around 2015'


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[1907755:1750518934.2697]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[1907755:1750518934.2724]: Manhole UDS path: /tmp/manhole-1907755
Manhole[1907755:1750518934.2724]: Waiting for new connection (in pid:1907755) ...


Settings listener connected.
Settings updated:  1 workers, 233 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20230414/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://www.edu.cn/robots.txt’ encountered an error: Connection closed.


Attempt 4 - For IDK; English version not found in sitemap; 'english one is abandoned since around 2015'

Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36


Manhole[1806155:1750519678.7578]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[1806155:1750519678.7602]: Manhole UDS path: /tmp/manhole-1806155
Manhole[1806155:1750519678.7602]: Waiting for new connection (in pid:1806155) ...


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241203/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://www.edu.cn/robots.txt’ encountered an error: Connection closed.


0 bytes.


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Starting CompressLogIfNoMetaWarc for Item


Finished CompressLogIfNoMetaWarc for Item


Starting MoveFiles for Item


Finished MoveFiles for Item


Starting StopHeartbeat for Item


Finished StopHeartbeat for Item


Starting MarkItemAsDone for Item