git: bzrlib [ERNO 24] too many open files

[jugglefish]

still trying to fetch a 40k revisions branch with a lot of criss-cross merging from a pretty huge bzr repo (lp:openobject-addons)

I now stepped down to do it in single steps per mainline commit (by pulling into a local bzr branch with bzr pull -r
XY). After ~6 days of processing I am at revno 6081 but now I am running into a problem:

git fetch bzr::/tmp/bzr-addons-trunk :refs/remotes/bzr/trunk
Traceback (most recent call last):
  File "/usr/lib/git-core/git-remote-bzr", line 49, in <module>
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/git_remote_helper.py", line 168, in process
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/git_remote_helper.py", line 174, in process_line
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/git_remote_helper.py", line 79, in fetch
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/push.py", line 260, in fetch_refs
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/push.py", line 278, in fetch_objects
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/push.py", line 202, in missing_revisions
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/push.py", line 171, in _commit_needs_fetching
  File "/usr/lib/python2.7/dist-packages/dulwich/object_store.py", line 95, in __contains__
  File "/usr/lib/python2.7/dist-packages/dulwich/object_store.py", line 291, in contains_loose
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/transportgit.py", line 490, in _get_loose_object
  File "/usr/lib/python2.7/dist-packages/bzrlib/transport/local.py", line 170, in get
  File "/usr/lib/python2.7/dist-packages/bzrlib/transport/__init__.py", line 358, in _translate_error
bzrlib.errors.TransportError: Transport error: [Errno 24] Too many open files: u'/opt/openerp-git/addons/.git/objects/98/24178f223c07deb6a1fe757fb632c1ea82c660' [Errno 24] Too many open files: u'/opt/openerp-git/addons/.git/objects/98/24178f223c07deb6a1fe757fb632c1ea82c660'
fehler

Anything I can do to recover from here?

[Jelmer Vernooij (jelmer)]

Can you try this with trunk dulwich and trunk bzr-git?

[Jelmer Vernooij (jelmer)]

The bzr->git support in bzr-git is still very experimental; at the moment I think we're writing one pack file per revision.

[Jelmer Vernooij (jelmer)]

repacking the git repo might help

[jugglefish (pniederlag)]

pn@h01:/opt/openerp-git/addons$ git repack
Nothing new to pack.
pn@h01:/opt/openerp-git/addons$ git repack -A -d
error: Could not read b8b1903c2f81483f14f475267f3a06778ecc211e
fatal: bad tree object b8b1903c2f81483f14f475267f3a06778ecc211e

git fsck and git gc seem to fail as well...
.. I guess I am stuck again. :-<

Getting trunk up and running has been on my list already, don't know If I can make that. sources are already in /u/l/s but still have to figure out a way to hook them into the regular package based bzr installation.