bzr checkout crashes

[Eric]

I tried checking out quite a large branch and I got the following:

/home/ericd:>bzr checkout /home/bzruser/repos/trunk fwo
bzr: ERROR: exceptions.MemoryError:

Traceback (most recent call last):
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/commands.py", line 857, in run_bzr_catch_errors
    return run_bzr(argv)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/commands.py", line 797, in run_bzr
    ret = run(*run_argv)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/commands.py", line 499, in run_argv_aliases
    return self.run(**all_cmd_args)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/builtins.py", line 957, in run
    accelerator_tree, hardlink)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/branch.py", line 852, in create_checkout
    hardlink=hardlink)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/bzrdir.py", line 1410, in create_workingtree
    accelerator_tree=accelerator_tree, hardlink=hardlink)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/workingtree_4.py", line 1388, in initialize
    hardlink=hardlink, delta_from_tree=True)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/transform.py", line 1810, in build_tree
    delta_from_tree)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/transform.py", line 1902, in _build_tree
    accelerator_tree, hardlink)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/transform.py", line 1955, in _create_files
    new_desired_files)):
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/revisiontree.py", line 82, in iter_files_bytes
    for result in self._repository.iter_files_bytes(repo_desired_files):
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/repository.py", line 1358, in iter_files_bytes
    for record in self.texts.get_record_stream(text_keys, 'unordered', True):
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/knit.py", line 1221, in get_record_stream
    needed_from_fallback - absent_keys)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/knit.py", line 992, in _get_content_maps
    record_map = self._get_record_map(keys, allow_missing=True)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/knit.py", line 1116, in _get_record_map
    self._read_records_iter(records):
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/knit.py", line 1564, in _read_records_iter
    content, digest = self._parse_record(key[-1], data)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/knit.py", line 1492, in _parse_record
    rec, record_contents = self._parse_record_unchecked(data)
  File "/opt/freeware/lib/python2.5/site-packages/bzrlib/knit.py", line 1522, in _parse_record_unchecked
    (data, e.__class__.__name__, str(e)))
MemoryError

bzr 1.6.1 on python 2.5.2 (aix5)
arguments: ['/opt/freeware/bin/bzr', 'checkout', '/home/bzruser/repos/trunk', 'fwo']
encoding: 'ISO8859-1', fsenc: 'ISO8859-1', lang: 'en_US'
plugins:
  bzrtools /opt/freeware/lib/python2.5/site-packages/bzrlib/plugins/bzrtools [1.6.0]
  launchpad /opt/freeware/lib/python2.5/site-packages/bzrlib/plugins/launchpad [unknown]
  qbzr /opt/freeware/lib/python2.5/site-packages/bzrlib/plugins/qbzr [0.9.5]
*** Bazaar has encountered an internal error.
    Please report a bug at https://bugs.launchpad.net/bzr/+filebug
    including this traceback, and a description of what you
    were doing when the error occurred.

/home/ericd:>bzr --version
Bazaar (bzr) 1.6.1
  Python interpreter: /opt/freeware/bin/python 2.5.2
  Python standard library: /opt/freeware/lib/python2.5
  bzrlib: /opt/freeware/lib/python2.5/site-packages/bzrlib
  Bazaar configuration: /home/ericd/.bazaar
  Bazaar log file: /home/ericd/.bzr.log

Copyright 2005, 2006, 2007, 2008 Canonical Ltd.
http://bazaar-vcs.org/

bzr comes with ABSOLUTELY NO WARRANTY. bzr is free software, and
you may use, modify and redistribute it under the terms of the GNU
General Public License version 2 or later.

[John A Meinel (jameinel)]

Can you try with a newer bzr? I believe bzr 1.6.1 would try to unpack the entire tree content into memory before writing it down to disk, which was fixed in bzr 1.9.

I'm going to go ahead and mark this as a duplicate of bug #269456 for now. You can unmark it if you feel it is a different problem.

[Michael Steele (mikesteele81)]

I used Bazaar's development branch while waiting for 1.9 to be released. I
am still having some trouble related to operations on large files, but this
specific problem was definitely solved by your patch.

On Fri, Nov 21, 2008 at 10:36 AM, John A Meinel <email address hidden>wrote:

> *** This bug is a duplicate of bug 269456 ***
> https://bugs.launchpad.net/bugs/269456
>
> Can you try with a newer bzr? I believe bzr 1.6.1 would try to unpack
> the entire tree content into memory before writing it down to disk,
> which was fixed in bzr 1.9.
>
> I'm going to go ahead and mark this as a duplicate of bug #269456 for
> now. You can unmark it if you feel it is a different problem.
>
> ** Changed in: bzr
> Status: New => Invalid
>
> ** This bug has been marked a duplicate of bug 269456
> checkout operation consume too much resources
>
> --
> bzr checkout crashes
> https://bugs.launchpad.net/bugs/300727
> You received this bug notification because you are a direct subscriber
> of the bug (via bug 269456).
>
> Status in Bazaar Version Control System: Invalid
>
> Bug description:
> I tried checking out quite a large branch and I got the following:
>
> /home/ericd:>bzr checkout /home/bzruser/repos/trunk fwo
> bzr: ERROR: exceptions.MemoryError:
>
> Traceback (most recent call last):
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/commands.py", line
> 857, in run_bzr_catch_errors
> return run_bzr(argv)
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/commands.py", line
> 797, in run_bzr
> ret = run(*run_argv)
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/commands.py", line
> 499, in run_argv_aliases
> return self.run(**all_cmd_args)
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/builtins.py", line
> 957, in run
> accelerator_tree, hardlink)
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/branch.py", line
> 852, in create_checkout
> hardlink=hardlink)
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/bzrdir.py", line
> 1410, in create_workingtree
> accelerator_tree=accelerator_tree, hardlink=hardlink)
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/workingtree_4.py",
> line 1388, in initialize
> hardlink=hardlink, delta_from_tree=True)
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/transform.py", line
> 1810, in build_tree
> delta_from_tree)
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/transform.py", line
> 1902, in _build_tree
> accelerator_tree, hardlink)
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/transform.py", line
> 1955, in _create_files
> new_desired_files)):
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/revisiontree.py",
> line 82, in iter_files_bytes
> for result in self._repository.iter_files_bytes(repo_desired_files):
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/repository.py",
> line 1358, in iter_files_bytes
> for record in self.texts.get_record_stream(text_keys, 'unordered',
> True):
> File "/opt/freeware/lib/python2.5/site-packages/bzrlib/knit.py", line
> 1221, in get_record_stream
> needed_from_fallback - absent_keys)
> File "/opt/freeware/lib/python2....