openoffice.org import causing swap-death (excessive memory use)

Bug #702255 reported by Tom Haddon on 2011-01-13
22
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Bazaar
Undecided
Unassigned
Bazaar Hg Plugin
High
Unassigned
Launchpad itself
High
Unassigned

Bug Description

We got swap alerts on pear and eventually had to kill the process. Memory usage was visibly increasing within the space of a few minutes:

importd@pear:~$ ps fuwwxx | grep 27499
importd 14784 0.0 0.0 7624 808 pts/0 D+ 08:08 0:00 \_ grep 27499
importd 27499 69.4 59.9 6457848 3663916 pts/6 Rs+ 07:15 36:23 \_ /usr/bin/python /srv/importd.launchpad.net/production/launchpad-rev-12177/scripts/code-import-worker.py 416569 hg http://hg.services.openoffice.org/DEV300
importd@pear:~$ ps fuwwxx | grep 27499
importd 27499 69.7 60.6 6967096 3707156 pts/6 Rs+ 07:15 40:37 \_ /usr/bin/python /srv/importd.launchpad.net/production/launchpad-rev-12177/scripts/code-import-worker.py 416569 hg http://hg.services.openoffice.org/DEV300
importd@pear:~$ ps fuwwxx | grep 27499
importd 19886 0.0 0.0 6208 636 pts/0 D+ 08:15 0:00 \_ grep 27499
importd 27499 70.2 62.9 7130472 3848096 pts/6 Rs+ 07:15 41:58 \_ /usr/bin/python /srv/importd.launchpad.net/production/launchpad-rev-12177/scripts/code-import-worker.py 416569 hg http://hg.services.openoffice.org/DEV300

Tom Haddon (mthaddon) on 2011-01-13
tags: added: canonical-losa-lp
Robert Collins (lifeless) wrote :

Do we have ulimits on those processes?

tags: added: code-import
Changed in launchpad:
status: New → Triaged
importance: Undecided → High
summary: - openoffice.org import using excessive memory
+ openoffice.org import causing swap-death (excessive memory use)
Martin Pool (mbp) wrote :

Also, are we getting meliae dumps from failures? I guess not.

I don't think we've got meliae hooked up to that service. Its a good idea.

Martin Pool (mbp) wrote :

bug 702520 for meliae

Jelmer Vernooij (jelmer) wrote :

Unfortunately this is an issue with the current bzr-hg architecture, which isn't really appropriate for openoffice.org-sized trees. I have some ideas about how to improve that but have not yet had time to implement them.

Changed in bzr:
status: New → Invalid
Changed in bzr-hg:
status: New → Triaged
importance: Undecided → High

As reported in https://answers.launchpad.net/launchpad/+question/160305, it seems Python import is failing with a out-of-memory error as well (or recently, with KILL/TERM signals, probably due to our safe-guards in place).

https://code.launchpad.net/~python-dev/python/default

tags: added: memory
Jelmer Vernooij (jelmer) on 2012-05-17
tags: added: bzr-hg
Curtis Hovey (sinzui) on 2013-01-03
Changed in launchpad:
status: Triaged → Won't Fix
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Related questions