Received item 2mt13kxolzln2i6awfxyprnud.

Attempt 2 - https://www.scholastic.com/ - Inactive since unknown; uses Cloudflare

Mozilla/5.0 (Windows NT 6.1; rv:60.0) Gecko/20100101 Firefox/60.0


Starting StartHeartbeat for Item


Finished StartHeartbeat for Item


Starting SetFetchDepth for Item


Finished SetFetchDepth for Item


Starting PreparePaths for Item


Finished PreparePaths for Item


Starting WriteInfo for Item


Finished WriteInfo for Item


Starting DownloadUrlFile for Item


Starting WgetDownload for Item


Manhole[1425272:1748982721.3451]: Patched <built-in function fork> and <built-in function forkpty>.
Manhole[1425272:1748982721.3467]: Manhole UDS path: /tmp/manhole-1425272
Manhole[1425272:1748982721.3467]: Waiting for new connection (in pid:1425272) ...


Settings listener connected.
Settings updated:  3 workers, 220 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
ERROR Fetching ‘https://purl.archive.org/ASN/scheme/ASNEducationLevel/HighSchool’ encountered an error: Too many redirects.


ERROR Fetching ‘https://purl.archive.org/ASN/scheme/ASNEducationLevel/11’ encountered an error: Too many redirects.
ERROR Fetching ‘https://purl.archive.org/ASN/scheme/ASNEducationLevel/7’ encountered an error: Too many redirects.


ERROR Fetching ‘https://purl.archive.org/ASN/scheme/ASNEducationLevel/8’ encountered an error: Too many redirects.


ERROR Fetching ‘https://purl.archive.org/ASN/scheme/ASNEducationLevel/10’ encountered an error: Too many redirects.


ERROR Fetching ‘https://purl.archive.org/ASN/scheme/ASNEducationLevel/MiddleSchool’ encountered an error: Too many redirects.


ERROR Fetching ‘https://purl.archive.org/ASN/scheme/ASNEducationLevel/12’ encountered an error: Too many redirects.


ERROR Fetching ‘https://purl.archive.org/ASN/scheme/ASNEducationLevel/9’ encountered an error: Too many redirects.


DNS resolution failed: [Errno -2] Name or service not known


ERROR Fetching ‘https://digital-dev.scholastic.com/resources/nav-widget/sdm-nav-bar.js’ encountered an error: DNS resolution failed: [Errno -2] Name or service not known


ERROR Fetching ‘https://digital-qa.scholastic.com/resources/nav-widget/sdm-nav-bar.js’ encountered an error: DNS resolution failed: [Errno -2] Name or service not known


ERROR Fetching ‘https://video.limelight.com/player/limelightjs-player.js’ encountered an error: DNS resolution error: All nameservers failed to answer the query video.limelight.com. IN A: Server 127.0.0.1 UDP port 53 answered SERVFAIL


DNS resolution error: All nameservers failed to answer the query video.limelight.com. IN A: Server 127.0.0.1 UDP port 53 answered SERVFAIL


ERROR Fetching ‘https://cdn.livefyre.com/Livefyre.js’ encountered an error: [Errno 111] Connection refused


Settings updated:  3 workers, 221 ignores, delay min/max: [250, 375] ms, suppressing ignore reports


Pattern ^https?://www\.pinterest.\com/.*\.js$ is invalid (error: bad escape \c at position 25).  Ignored.
ERROR Fatal exception.
Traceback (most recent call last):
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/application/app.py", line 157, in run
    yield from pipeline.process()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 194, in process
    yield from self._process_one_worker()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 215, in _process_one_worker
    task.result()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 119, in process
    item = yield from self.process_one(_worker_id=worker_id)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 103, in process_one
    yield from task.process(item)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/application/tasks/download.py", line 492, in process
    yield from session.app_session.factory['Processor'].process(session)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/delegate.py", line 29, in process
    return (yield from processor.process(item_session))
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/web.py", line 92, in process
    return (yield from session.process())
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/web.py", line 174, in process
    ok = yield from self._process_robots()
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/web.py", line 201, in _process_robots
    request))
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/web.py", line 367, in _should_fetch_reason_with_robots
    self._fetch_rule.check_initial_web_request(self._item_session, request)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/rule.py", line 179, in check_initial_web_request
    item_session, verdict, reason, test_info
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/processor/rule.py", line 130, in consult_hook
    PluginFunctions.accept_url, item_session, verdict, reasons,
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/application/hook.py", line 81, in call
    return self._callbacks[name](*args, **kwargs)
  File "/home/archivebot/.pyenv/versions/3.6.15/envs/archivebot-20241016/lib/python3.6/site-packages/wpull/application/plugin.py", line 49, in wrapper
    return func(*args, **kwargs)
  File "archive_bot_plugin.py", line 227, in accept_url
    pattern = self.settings.ignore_url(item_session.url_record)
  File "/home/archivebot/ArchiveBot-c/pipeline/archivebot/wpull/settings.py", line 50, in ignore_url
    return self.ignoracle.ignores(record_info)
  File "/home/archivebot/ArchiveBot-c/pipeline/archivebot/wpull/ignoracle.py", line 110, in ignores
    self._compiled.append((pattern, compiledPattern))
UnboundLocalError: local variable 'compiledPattern' referenced before assignment


CRITICAL Sorry, Wpull unexpectedly crashed.


CRITICAL Please report this problem to the authors at Wpull's issue tracker so it may be fixed. If you know how to program, maybe help us fix it? Thank you for helping us help you help us all.


Finished WgetDownload for Item


Starting RelabelIfAborted for Item


Starting CompressLogIfNoMetaWarc for Item