Activity log for bug #864217

Date Who What changed Old value New value Message
2011-10-01 18:11:22 Mark Grandi bug added bug
2011-10-01 18:11:22 Mark Grandi attachment added bzr log during the bzr fast-import command https://bugs.launchpad.net/bugs/864217/+attachment/2493070/+files/bzr%20git%20import%20memory%20error.txt
2011-10-01 18:11:52 Mark Grandi attachment added dxdiag output https://bugs.launchpad.net/bzr/+bug/864217/+attachment/2493071/+files/DxDiag.txt
2011-10-01 18:16:24 Mark Grandi bug added subscriber Vincent Ladeuil
2011-10-01 18:24:46 Mark Grandi description I was trying an experiment where I would convert the linux kernel git repository into a bazaar repository. However, when I was using 'fast-import', bazaar ran out of memory at "repacking" the repository when i had about 16,000 revisions out of 264,207 Attached is the bzr log (very very long) of when i started the fast-import to when it crashed. I tried to restart the fast-import, but then I ran into this bug: https://bugs.launchpad.net/bzr/+bug/541626 , and now I seem unable to complete it because it keeps crashing with that error. Also attached is my dxdiag output, which someone on irc told me to add so it helps to diagnose the problem. The exact procedure I did, was I used git to clone the repository at "https://github.com/torvalds/linux.git", then i ran "git fast-export --all > linux.fe" to create the fast export file . Then using bazaar explorer i ran "bzr fast-import C:/Users/Mark/Desktop/tmp_linux/linux.fe C:/Users/Mark/Desktop/tmp_linux_bzr_repo" It took about....15 hours to get to the point where it crashed, so be prepared to wait x.x I was trying an experiment where I would convert the linux kernel git repository into a bazaar repository. However, when I was using 'fast-import', bazaar ran out of memory at "repacking" the repository when i had about 16,000 revisions out of 264,207 56378.291 Traceback (most recent call last): File "bzrlib\commands.pyo", line 946, in exception_to_return_code File "bzrlib\commands.pyo", line 1150, in run_bzr File "bzrlib\commands.pyo", line 699, in run_argv_aliases File "bzrlib\commands.pyo", line 721, in run File "bzrlib\cleanup.pyo", line 135, in run_simple File "bzrlib\cleanup.pyo", line 165, in _do_with_cleanups File "C:/Program Files (x86)/Bazaar/plugins\qbzr\lib\commands.py", line 821, in run File "C:/Program Files (x86)/Bazaar/plugins\qbzr\lib\subprocess.py", line 888, in run_subprocess_command File "bzrlib\commands.pyo", line 1150, in run_bzr File "bzrlib\commands.pyo", line 699, in run_argv_aliases File "bzrlib\commands.pyo", line 721, in run File "bzrlib\cleanup.pyo", line 135, in run_simple File "bzrlib\cleanup.pyo", line 165, in _do_with_cleanups File "C:/Program Files (x86)/Bazaar/plugins\fastimport\cmds.py", line 314, in run File "C:/Program Files (x86)/Bazaar/plugins\fastimport\cmds.py", line 40, in _run File "C:/Program Files (x86)/Bazaar/plugins\fastimport\processors\generic_processor.py", line 311, in process File "fastimport\processor.pyo", line 76, in _process File "C:/Program Files (x86)/Bazaar/plugins\fastimport\processors\generic_processor.py", line 556, in commit_handler File "C:/Program Files (x86)/Bazaar/plugins\fastimport\processors\generic_processor.py", line 510, in checkpoint_handler File "C:/Program Files (x86)/Bazaar/plugins\fastimport\processors\generic_processor.py", line 429, in _pack_repository File "bzrlib\decorators.pyo", line 217, in write_locked File "bzrlib\repofmt\pack_repo.pyo", line 1805, in pack File "bzrlib\repofmt\pack_repo.pyo", line 997, in pack File "bzrlib\repofmt\pack_repo.pyo", line 1019, in _try_pack_operations File "bzrlib\repofmt\pack_repo.pyo", line 945, in _execute_pack_operations File "bzrlib\repofmt\pack_repo.pyo", line 714, in pack File "bzrlib\repofmt\groupcompress_repo.pyo", line 490, in _create_pack_from_packs File "bzrlib\repofmt\groupcompress_repo.pyo", line 460, in _copy_chk_texts File "bzrlib\groupcompress.pyo", line 1751, in _insert_record_stream File "bzrlib\repofmt\groupcompress_repo.pyo", line 299, in next_stream File "bzrlib\groupcompress.pyo", line 1474, in get_record_stream File "bzrlib\groupcompress.pyo", line 1580, in _get_remaining_record_stream File "bzrlib\groupcompress.pyo", line 2150, in get_build_details File "bzrlib\groupcompress.pyo", line 2094, in _get_entries MemoryError Attached is the bzr log (very very long) of when i started the fast-import to when it crashed. I tried to restart the fast-import, but then I ran into this bug: https://bugs.launchpad.net/bzr/+bug/541626 , and now I seem unable to complete it because it keeps crashing with that error. Also attached is my dxdiag output, which someone on irc told me to add so it helps to diagnose the problem. The exact procedure I did, was I used git to clone the repository at "https://github.com/torvalds/linux.git", then i ran "git fast-export --all > linux.fe" to create the fast export file . Then using bazaar explorer i ran "bzr fast-import C:/Users/Mark/Desktop/tmp_linux/linux.fe C:/Users/Mark/Desktop/tmp_linux_bzr_repo" It took about....15 hours to get to the point where it crashed, so be prepared to wait x.x
2011-10-06 08:37:35 Martin Pool bzr: status New Confirmed
2011-10-06 08:37:37 Martin Pool bzr: importance Undecided Medium
2011-10-06 08:40:03 Martin Pool tags bzr memoryerror repacking memory
2017-11-09 00:26:45 Jelmer Vernooij tags memory check-for-breezy memory
2019-03-04 03:35:49 Jelmer Vernooij tags check-for-breezy memory memory
2019-03-04 03:36:00 Jelmer Vernooij bug task added brz
2019-03-04 03:36:06 Jelmer Vernooij brz: status New Triaged
2019-03-04 03:36:10 Jelmer Vernooij brz: importance Undecided Medium