bug notification script needs to be optimized

Bug #741684 reported by Gary Poster
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Launchpad itself
Fix Released
High
Gary Poster

Bug Description

The database utilization report has picked up that bug notifications is now chewing 17% of a master database CPU core, up from <1%.

It changed on March 10 (https://devpad.canonical.com/~lpqateam/dbr/daily/db-report-2011-03-09.txt was 0.54%, compared to 20% on https://devpad.canonical.com/~lpqateam/dbr/daily/db-report-2011-03-10.txt), right after the last database deployment.

Therefore, it seems likely that this is caused by the work to address bug 164196 ("Quickly-undone actions shouldn't send mail notifications") is the culprit (http://bazaar.launchpad.net/~launchpad-pqm/launchpad/devel/revision/12533#lib/lp/bugs/scripts/bugnotification.py in particular).

An obvious optimization is to get the activity along with the notification. This bug is to perform that optimization. I expect that will reduce the database usage.

I would be very surprised if it would get us down to the previous number. We need to look at more data than before in order to answer these questions, at least without bigger changes than I intend to contemplate right now.

Related branches

Gary Poster (gary)
Changed in launchpad:
status: Triaged → In Progress
assignee: Launchpad Yellow Squad (yellow) → Gary Poster (gary)
Revision history for this message
Gary Poster (gary) wrote :
Revision history for this message
Launchpad QA Bot (lpqabot) wrote :
Changed in launchpad:
milestone: none → 11.04
tags: added: qa-needstesting
Changed in launchpad:
status: In Progress → Fix Committed
Gary Poster (gary)
Changed in launchpad:
status: Fix Committed → In Progress
Revision history for this message
Launchpad QA Bot (lpqabot) wrote :
Changed in launchpad:
status: In Progress → Fix Committed
William Grant (wgrant)
tags: added: qa-ok
removed: qa-needstesting
William Grant (wgrant)
Changed in launchpad:
status: Fix Committed → Fix Released
Revision history for this message
Gary Poster (gary) wrote :

Just to circle around on this again, https://devpad.canonical.com/~lpqateam/dbr/daily/db-report-2011-04-05.txt shows that bugnotifications are back down to .9%. I think it's time to add the filters back in (bug 728818) and see how that affects the world, including this part of it. I'll request that after April's db-deploy, this week. The next, next db deploy (early May) also adds a single additional query per batch.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.