PyPI Mirror

fails with "socket.timeout: timed out"

Bug #385671 reported by Sridhar Ratnakumar on 2009-06-10

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	PyPI Mirror	Fix Committed	Critical	Andreas Jung

Bug Description

We need to catch socket errors too (retry; or ignore them)

(...)
2009-06-10 12:11:44,057 DEBUG Processing package Albus
http://evanhanson.com/blog/albus
Traceback (most recent call last):
  File "/home/sridharr/as/pypm/bin/pypimirror", line 26, in <module>
    z3c.pypimirror.mirror.run()
  File "/home/sridharr/as/pypm/eggs/z3c.pypimirror-1.0.14-py2.6.egg/z3c/pypimirror/mirror.py", line 754, in run
    config["base_url"])
  File "/home/sridharr/as/pypm/eggs/z3c.pypimirror-1.0.14-py2.6.egg/z3c/pypimirror/mirror.py", line 461, in mirror
    links = package.ls(filename_matches, external_links, follow_external_index_pages)
  File "/home/sridharr/as/pypm/eggs/z3c.pypimirror-1.0.14-py2.6.egg/z3c/pypimirror/mirror.py", line 319, in ls
    return [(link[0], os.path.basename(link[0]), link[1]) for link in links]
  File "/home/sridharr/as/pypm/eggs/z3c.pypimirror-1.0.14-py2.6.egg/z3c/pypimirror/mirror.py", line 298, in _links
    for link in self._links_external(remote_index_html, filename_matches, follow_external_index_pages):
  File "/home/sridharr/as/pypm/eggs/z3c.pypimirror-1.0.14-py2.6.egg/z3c/pypimirror/mirror.py", line 242, in _links_external
    html = site.read()
  File "/opt/ActivePython-2.6/lib/python2.6/socket.py", line 327, in read
    data = self._sock.recv(rbufsize)
  File "/opt/ActivePython-2.6/lib/python2.6/httplib.py", line 517, in read
    return self._read_chunked(amt)
  File "/opt/ActivePython-2.6/lib/python2.6/httplib.py", line 553, in _read_chunked
    line = self.fp.readline()
  File "/opt/ActivePython-2.6/lib/python2.6/socket.py", line 395, in readline
    data = recv(1)
socket.timeout: timed out