large svn repository import Memory Error exception raised

Bug #371686 reported by gfoureau
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Bazaar Subversion Plugin
New
Undecided
Unassigned

Bug Description

When importing a large repository (more than 10000 revision) with 5-10 branches/tags from a svn repository of 30 GB a MemoryError exception is raised.

I have 6 GB of RAM and I checked the ram consumptions of the bazaar process while importing and it was about 500-600 MB all the times.

Here's the log:

C:\bzr\Trunk>bzr svn-import c:\playall-2009-04-30\var\svn\playall
Using repository layout: root
bzr: ERROR: exceptions.MemoryError:

Traceback (most recent call last):
  File "bzrlib\commands.pyo", line 716, in exception_to_return_code
  File "bzrlib\commands.pyo", line 911, in run_bzr
  File "bzrlib\commands.pyo", line 547, in run_argv_aliases
  File "C:/Program Files (x86)/Bazaar/plugins\svn\commands.py", line 163, in run

  File "C:/Program Files (x86)/Bazaar/plugins\svn\convert.py", line 268, in convert_repository
  File "C:/Program Files (x86)/Bazaar/plugins\svn\fetch.py", line 1251, in fetch

  File "C:/Program Files (x86)/Bazaar/plugins\svn\fetch.py", line 1175, in _fetch_revisions
  File "C:/Program Files (x86)/Bazaar/plugins\svn\fetch.py", line 1120, in _fetch_revision_switch
  File "C:/Program Files (x86)/Bazaar/plugins\svn\errors.py", line 127, in convert
  File "C:/Program Files (x86)/Bazaar/plugins\svn\fetch.py", line 906, in report_inventory_contents
  File "C:/Program Files (x86)/Bazaar/plugins\svn\fetch.py", line 403, in close
  File "C:/Program Files (x86)/Bazaar/plugins\svn\fetch.py", line 591, in _close

  File "bzrlib\knit.pyo", line 900, in add_lines
  File "bzrlib\knit.pyo", line 959, in _add
  File "bzrlib\knit.pyo", line 1765, in _merge_annotations
  File "bzrlib\knit.pyo", line 1126, in _get_content
  File "bzrlib\knit.pyo", line 1949, in _get_content
  File "bzrlib\knit.pyo", line 2008, in _get_one_work
  File "bzrlib\knit.pyo", line 1189, in _raw_map_to_record_map
  File "bzrlib\knit.pyo", line 1777, in _parse_record
  File "bzrlib\knit.pyo", line 1807, in _parse_record_unchecked
MemoryError

bzr 1.13 on python 2.5.2 (win32)
arguments: ['bzr', 'svn-import', 'c:\\playall-2009-04-30\\var\\svn\\playall']
encoding: 'cp1252', fsenc: 'mbcs', lang: None
plugins:
  bzrtools C:\Program Files (x86)\Bazaar\plugins\bzrtools [1.13]
  fastimport C:\Program Files (x86)\Bazaar\plugins\fastimport [0.8dev]

  launchpad C:\Program Files (x86)\Bazaar\plugins\launchpad [unknown]

  netrc_credential_store C:\Program Files (x86)\Bazaar\plugins\netrc_credential_
store [unknown]
  qbzr C:\Program Files (x86)\Bazaar\plugins\qbzr [0.9.8]
  svn C:\Program Files (x86)\Bazaar\plugins\svn [0.5.3]
*** Bazaar has encountered an internal error.
    Please report a bug at https://bugs.launchpad.net/bzr/+filebug
    including this traceback, and a description of what you
    were doing when the error occurred.

Martin Pool (mbp)
affects: bzr → bzr-svn
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.