Comment 4 for bug 723234
Revision history for this message
| seyacat (seyacat) wrote Re: [Bug 723234] Re: cant pull or check, with big tree | #4 |
© 2004
Canonical Ltd.
•
Terms of use
•
Data privacy
•
Contact Launchpad Support
•
Blog
•
Careers
•
System status
•
1b1ed1a
(Get the code!)
Repositorie have like 10K files, most of them are images
On Tue, Feb 22, 2011 at 9:48 PM, GatoSeya <email address hidden> wrote:
> Yes i put a couple of huge files, like 200MB,
> and media file size is like 300KB
>
> the commit do fine, and i dont have problem sinse i try to make push with
> sftp, then i thy with file push
> and after with check, all fails.
>
> The I init new repositorie without huge files, pulls looks good, but i wait
> like an our and it not finish
>
>
> On Tue, Feb 22, 2011 at 9:34 PM, Andrew Bennetts <
> <email address hidden>> wrote:
>
>> My guess is the root cause of this is an out-of-memory problem (so is
>> probably a duplicate of one of the existing reports tagged 'memory')..
>> Does your big tree include any particularly big files?
>>
>> That whatever happens causes SystemError from the zlib module would be a
>> bug in Python itself. Calling zlib.decompress should never cause that.
>>
>> Objects/
>> after this check is tripped:
>>
>> (!PyString_Check(v) || Py_REFCNT(v) != 1 || newsize < 0 ||
>> PyString_
>>
>> zlibmodule.c does call _PyString_Resize directly in places, including in
>> the decompress function (PyZlib_
>> the newsize < 0 is the issue: if the string being decompressed expands
>> to something sufficiently huge I think that could happen.
>> PyZlib_decompress calls _PyString_Resize to double the size of the
>> buffer (via << 1) it is decompressing into as the zlib library produces
>> more decompressed data, and newsize is a Py_ssize_t, a signed type...
>>
>> If that's the case, then basically we need to either fix bzr to either
>> extract such large compressed strings in parts rather than all at once,
>> or avoid compressing such large strings in the first place. There's
>> been some discussion about and gradual progress towards these solutions.
>> John would know more about how far off we are.
>>
>> Out of interest, how big is your "big tree"? How many files, and how
>> big is the biggest file, and what's the average file size?
>>
>> ** Changed in: bzr
>> Importance: Undecided => Medium
>>
>> ** Changed in: bzr
>> Status: New => Confirmed
>>
>> ** Summary changed:
>>
>> - cant pull or check, with big tree
>> + Big tree causes 'SystemError: ../Objects/
>> groupcompress
>>
>> ** Tags added: memory
>>
>> --
>> You received this bug notification because you are a direct subscriber
>> of the bug.
>> https:/
>>
>> Title:
>> Big tree causes 'SystemError: ../Objects/
>> groupcompress
>>
>> Status in Bazaar Version Control System:
>> Confirmed
>>
>> Bug description:
>> i add a big tree and before commit, y cant pull, or check,
>>
>> bzr check
>> Checking working tree at '/home/
>> Checking branch at 'file:/
>> Checking repository at 'file:/
>> bzr: failed to report crash using apport:
>> OSError(13, 'Permiso denegado')
>> bzr: ERROR: exceptions.
>> argument to internal function
>>
>> Traceback (most recent call last):
>> File "/usr/lib/
>> in exception_
>> return the_callable(*args, **kwargs)
>> File "/usr/lib/
>> in run_bzr
>> ret = run(*run_argv)
>> File "/usr/lib/
>> in run_argv_aliases
>> return self.run(
>> File "/usr/lib/
>> in run
>> return self._operation
>> File "/usr/lib/
>> run_simple
>> self.cleanups, self.func, *args, **kwargs)
>> File "/usr/lib/
>> _do_with_cleanups
>> result = func(*args, **kwargs)
>> File "/usr/lib/
>> in run
>> check_dwim(path, verbose, do_branch=branch, do_repo=repo,
>> do_tree=tree)
>> File "/usr/lib/
>> check_dwim
>> check_repo=do_repo)
>> File "/usr/lib/
>> in read_locked
>> result = unbound(self, *args, **kwargs)
>> File "/usr/lib/
>> 2776, in check
>> check_repo=
>> File "/usr/lib/
>> 2780, in _check
>> result.
>> File "/usr/lib/
>> check
>> self.repository
>> File "/usr/lib/
>> 1206, in _check_inventories
>> self._do_
>> File "/usr/lib/
>> 1263, in _do_check_
>> checker, last_object, current_
>> File "/usr/lib/
>> 1289, in _check_record
>> self._check_
>> File "/usr/lib/
>> 1303, in _check_text
>> content = record.
>> File "/usr/lib/
>> 438, in get_bytes_as
>> self._manager.
>> File "/usr/lib/
>> 538, in _prepare_
>> self._block.
>> File "/usr/lib/
>> 151, in _ensure_content
>> self._content = zlib.decompress
>> SystemError: ../Objects/
>> function
>>
>> bzr 2.2.1 on python 2.6.6
>> (Linux-
>> arguments: ['/usr/bin/bzr', 'check']
>> encoding: 'UTF-8', fsenc: 'UTF-8', lang: 'es_EC.UTF-8'
>> plugins:
>> bash_completion
>> /usr/lib/
>> bzrtools
>> /usr/lib/
>> explorer
>> /usr/lib/
>> launchpad
>> /usr/lib/
>> netrc_credentia
>> /usr/lib/
>> [2.2.1]
>> news_merge
>> /usr/lib/
>> qbzr
>> /usr/lib/
>>
>> *** Bazaar has encountered an internal error. This probably indicates a
>> bug in Bazaar. You can help us fix it by filing a bug report at
>> https:/
>> including this traceback and a description of the problem.
>>
>> To unsubscribe from this bug, go to:
>> https:/
>>
>
>