recipe builds can use too much memory
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
| Launchpad itself |
High
|
Aaron Bentley |
Bug Description
It is believed that excess memory use was a factor in https:/
We believe that excessive memory use drove the builders so far into swap that they became unresponsive.
Related branches
- Данило Шеган (community): Approve on 2010-11-18
-
Diff: 19 lines (+2/-0)1 file modifiedlib/canonical/buildd/buildrecipe (+2/-0)
Changed in launchpad-code: | |
status: | Triaged → In Progress |
assignee: | nobody → Aaron Bentley (abentley) |
Changed in launchpad-code: | |
milestone: | none → 10.12 |
tags: | added: qa-needstesting |
Changed in launchpad-code: | |
status: | In Progress → Fix Committed |
tags: |
added: qa-ok removed: qa-needstesting |
Dimitri John Ledkov (xnox) wrote : | #2 |
Is "bzr: out of memory" during recipe build is a new feature introduced by this fix?
E.g. https:/
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On 11/24/2010 01:27 AM, Dmitrijs Ledkovs wrote:
> Is "bzr: out of memory" during recipe build is a new feature introduced
> by this fix?
Yes, more or less. We are in the unfortunate position that bzr uses
excessive memory with large branches and the build farm (not just a
single builder) appears to become unstable when excessive memory is used.
Aaron
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://
iEYEARECAAYFAkz
lTYAnRSYU8vHoXc
=rpGW
-----END PGP SIGNATURE-----
Martin Pool (mbp) wrote : | #4 |
On 24 November 2010 17:44, Aaron Bentley <email address hidden> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> On 11/24/2010 01:27 AM, Dmitrijs Ledkovs wrote:
>> Is "bzr: out of memory" during recipe build is a new feature introduced
>> by this fix?
We're working on reducing bzr memory usage through other bugs,
separate from this. One way to help is to attach a traceback showing
where bzr stopped when it ran out of memory.
@aaron maybe bzr should be run with -Derror in the builders?
--
Martin
Aaron Bentley (abentley) wrote : | #5 |
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On 11/24/2010 01:52 AM, Martin Pool wrote:
> @aaron maybe bzr should be run with -Derror in the builders?
We're currently running an old version of bzr, so the results wouldn't
necessarily be relevant. But also, these memory issues with large
branches are very easy to reproduce locally just by branching, so I
don't think bzr needs help finding them. My gut says we should stick to
the normal behaviour that people are used to, for now.
Aaron
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://
iEYEARECAAYFAkz
XvsAnidbQtg/
=Eq52
-----END PGP SIGNATURE-----
Changed in launchpad-code: | |
status: | Fix Committed → Fix Released |
In the meantime see also bug #109114
Rohan Garg (rohangarg) wrote : | #7 |
Not quite fixed yet : https:/
Fixed in stable r11943 <http:// bazaar. launchpad. net/~launchpad- pqm/launchpad/ stable/ revision/ 11943>.