Language pack performance

Bug #277598 reported by Jeroen T. Vermeulen
10
Affects Status Importance Assigned to Milestone
Launchpad itself
Fix Released
High
Jeroen T. Vermeulen

Bug Description

Generating a language pack is dramatically slow at the moment. The process is almost entirely CPU-bound.

The cause is too many objects being fetched individually by id, which in turn is done because memory on the script server used to be the big bottleneck. It's not even the database queries themselves that cost time (not since the db server upgrade); it's Storm composing SQL expressions for the objects' columns.

For now, need to fetch POTMsgSets in bulk to reduce the number of Storm queries. Other suspects are POFile, POTemplate, and Language. Should make the time spent on client-side computation neglible.

Changed in rosetta:
assignee: nobody → jtv
importance: Undecided → High
milestone: none → 2.1.10
status: New → In Progress
Revision history for this message
Jeroen T. Vermeulen (jtv) wrote :

POTMsgSet.singular_text was one of the places where we did a lot of fetches. An optimization for that is in RF 7165.

Revision history for this message
Jeroen T. Vermeulen (jtv) wrote :

The other branch, reducing the number of queries overall, landed in RF 7173.

Changed in rosetta:
status: In Progress → Fix Committed
Changed in rosetta:
status: Fix Committed → Fix Released
Curtis Hovey (sinzui)
visibility: private → public
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.