populate-archive.py unusably slow

Bug #744849 reported by William Grant
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Launchpad itself
Fix Released
Critical
Steve Kowalik

Bug Description

Preloading in Archive.getPublishedSources has made populate-archive.py extremely slow and memory-hungry: it causes the cache to become immense, and each of the 20000 commits has to invalidate everything.

We should either make the preloading optional or fix populate-archive.py to be a non-sucky loop tuner.

Related branches

Revision history for this message
Steve Kowalik (stevenk) wrote :

This also directly impacts IDS, and therefore derivation.

William Grant (wgrant)
Changed in launchpad:
assignee: nobody → Steve Kowalik (stevenk)
status: Triaged → In Progress
milestone: none → 11.05
Revision history for this message
Launchpad QA Bot (lpqabot) wrote :

Fixed in stable r12802 (http://bazaar.launchpad.net/~launchpad-pqm/launchpad/stable/revision/12802) by a commit, but not testable.

tags: added: qa-untestable
Changed in launchpad:
status: In Progress → Fix Committed
Curtis Hovey (sinzui)
Changed in launchpad:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.