HR Wiki mirror — download status LIVE

Failures

4,353 failed attempts in concurrent log (~29% of completed attempts)

Recent error samples:

• <urlopen error [Errno 111] Connection refused>
• <urlopen error [Errno 111] Connection refused>
• <urlopen error [Errno 111] Connection refused>
• <urlopen error [Errno 111] Connection refused>
• <urlopen error [Errno 111] Connection refused>

Failed URLs can be retried later; resume skips files already saved.

After download

Convert → XML dump → MediaWiki import is chained to start when the download process exits. The wiki currently shows only pilot pages until that import finishes.

Processes

• 74650 python3 /root/hrwiki-mirror/scripts/download_from_manifest.py --workers 4 --delay 0.45 --log-tag halfspeed-retry
• 97347 sh -c -- pgrep -af 'download_from_manifest.py' 2>/dev/null
• 97349 sh -c -- pgrep -af 'cdx_wayback_download.py' 2>/dev/null
• 97351 sh -c -- pgrep -af 'html_to_mediawiki.py' 2>/dev/null
• 97353 sh -c -- pgrep -af 'build_xml_dump.py' 2>/dev/null
• 97355 sh -c -- pgrep -af 'run_full_pipeline.sh' 2>/dev/null