harvestman wont run

[Peter Pearse]

Binary package hint: harvestman

Ubuntu 7.10
python 2.5
harvestman 1.4.6 final
ubuntu@us710-oe:/stuff/utilities$ harvestman -C /stuff/utilities/harvestman/config.xml
Traceback (most recent call last):
  File "/usr/bin/harvestman", line 364, in <module>
    spider.run_projects()
  File "/usr/bin/harvestman", line 283, in run_projects
    self.register_common_objects()
  File "/usr/bin/harvestman", line 135, in register_common_objects
    conn = connector.HarvestManNetworkConnector()
  File "/usr/share/pycentral/harvestman/site-packages/HarvestMan/connector.py", line 201, in __init__
    self.__configure()
  File "/usr/share/pycentral/harvestman/site-packages/HarvestMan/connector.py", line 326, in __configure
    self.__configure_protocols()
  File "/usr/share/pycentral/harvestman/site-packages/HarvestMan/connector.py", line 449, in __configure_protocols
    cookiehandler)
  File "/usr/lib/python2.5/urllib2.py", line 467, in build_opener
    opener.add_handler(h)
  File "/usr/lib/python2.5/urllib2.py", line 303, in add_handler
    type(handler))
TypeError: expected BaseHandler instance, got <type 'NoneType'>

[coredmp (fabrice-coredmp)]

Can be corrected by the modification of the line 376 of the file
/usr/share/pycentral/harvestman/site-packages/HarvestMan/connector.py

"if minor_version==4:"

by

"if minor_version>=4:"

Regards

Fabrice

[lszyba1 (szybalski)]

There is a new version of harvestman.
Give that a try:
http://code.google.com/p/harvestman-crawler/wiki/InstallHarvestMan

[Daniel T Chen (crimsun)]

Is this symptom still reproducible in 8.10 or 9.04?

[Srecko Toroman (sreckotoroman)]

Yes, unfortunately.

toroman@toroman-laptop:~/work/wikipedia$ harvestman -N http://www.wikipedia.org
Traceback (most recent call last):
  File "/usr/bin/harvestman", line 5, in <module>
    h.run_projects()
  File "/usr/lib/python2.5/site-packages/HarvestMan/harvestman.py", line 283, in run_projects
    self.register_common_objects()
  File "/usr/lib/python2.5/site-packages/HarvestMan/harvestman.py", line 135, in register_common_objects
    conn = connector.HarvestManNetworkConnector()
  File "/usr/lib/python2.5/site-packages/HarvestMan/connector.py", line 201, in __init__
    self.__configure()
  File "/usr/lib/python2.5/site-packages/HarvestMan/connector.py", line 326, in __configure
    self.__configure_protocols()
  File "/usr/lib/python2.5/site-packages/HarvestMan/connector.py", line 449, in __configure_protocols
    cookiehandler)
  File "/usr/lib/python2.5/urllib2.py", line 467, in build_opener
    opener.add_handler(h)
  File "/usr/lib/python2.5/urllib2.py", line 303, in add_handler
    type(handler))
TypeError: expected BaseHandler instance, got <type 'NoneType'>

[Luca Falavigna (dktrkranz)]

Will be fixed syncing new revision from Debian (bug #329363).