'Too many open files' when commiting rename thousands of files on svn

[Hendrik van Antwerpen]

Description:
1. A subversion repository with a branch we want to work on.
2. Do bzr checkout of the branch.
3. Rename a directory containing several thousand files.
4. Commit.

Result:
Bazaar gives an error: INFO: aborting commit write group: OSError(24, 'open: Too many open files')

Expected result:
The commit succeeds.

Software versions:
bzr 2.0.2-1~bazaar1~karmic (bzr stable PPA)
bzr-svn 1.0.0-1~bazaar2~karmic (bzr stable PPA)
subversion 1.5.1 (r32289)

[John A Meinel (jameinel)]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hendrik van Antwerpen wrote:
> Public bug reported:
>
> Description:
> 1. A subversion repository with a branch we want to work on.
> 2. Do bzr checkout of the branch.
> 3. Rename a directory containing several thousand files.
> 4. Commit.
>
> Result:
> Bazaar gives an error: INFO: aborting commit write group: OSError(24, 'open: Too many open files')
>
> Expected result:
> The commit succeeds.
>
> Software versions:
> bzr 2.0.2-1~bazaar1~karmic (bzr stable PPA)
> bzr-svn 1.0.0-1~bazaar2~karmic (bzr stable PPA)
> subversion 1.5.1 (r32289)
>
> ** Affects: bzr
> Importance: Undecided
> Status: New
>

  affects bzr-svn

I'm pretty sure this is something in how bzr-svn is interacting with
svn, and not bzr itself. Mostly because you can rename a dir in bzr and
commit and not have this problem.

John
=:->
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Cygwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAksTL/oACgkQJdeBCYSNAAOPwgCfdheCgSALENYrlGX/k1j/4Yt7
3D8An1YVMYvIVWBXKLhi4xoeOCjD1zt2
=L+sh
-----END PGP SIGNATURE-----

[Robert Collins (lifeless)]

John, 'affects' adds a new task, it doesn't move the existing task - please use the webui to move things between bzr and bzr-svn.

[Jelmer Vernooij (jelmer)]

What version of subvertpy are you using?

I can't reproduce this problem renaming a parent directory with 4k files in it.

[Trent Lillehaugen (tllilleh)]

I had a similar problem and it was discussed here:

http://stackoverflow.com/questions/2089353/how-do-i-resolve-a-too-many-open-files-error-in-bazaar

I was able to work-around the problem for now by running 'ulimit -n 10240' (I am using Mac OS X) before running 'bzr commit'. This allows python to have more files open. However, I don't know why all the files need to be open by bazaar, this seems like a bug.

[Yonggang Luo (luoyonggang)]

That's right, it's fixed, at least at subvertpy 0.8.8, subversion swig binding still got this problem:)
Thanks for the work.