Activity log for bug #874250

Date Who What changed Old value New value Message
2011-10-14 14:05:14 Marc Deslauriers bug added bug
2011-10-14 14:06:46 Marc Deslauriers bug added subscriber Ubuntu Security Team
2011-10-14 14:06:52 Marc Deslauriers bug added subscriber Andy Whitcroft
2011-10-14 14:12:10 Jamie Strandboge tags platform-blocker
2011-10-14 14:22:04 Gavin Panella launchpad: importance Undecided Critical
2011-10-14 14:22:04 Gavin Panella launchpad: status New Incomplete
2011-10-14 14:37:20 Marc Deslauriers launchpad: status Incomplete Confirmed
2011-10-14 14:46:17 Gavin Panella launchpad: status Confirmed Triaged
2011-10-14 15:06:37 Kate Stewart tags platform-blocker platform-blocker rls-mgr-p-tracking
2011-10-16 19:53:22 Robert Collins tags platform-blocker rls-mgr-p-tracking platform-blocker rls-mgr-p-tracking timeout
2011-10-16 19:57:42 Robert Collins description When trying to approve nominations on bugs that have a large number of projects, launchpad times out. For example, bug #706999 or bug #732628. This is preventing the security team and kernel team's workflow from accurately tracking kernel issues. Symptoms ======== When trying to approve nominations on bugs that have a large number of projects, launchpad times out. For example, bug #706999 or bug #732628. This is preventing the security team and kernel team's workflow from accurately tracking kernel issues. Analysis ======== death by sql: multiple heat lookup calls, each of which is slow (30ms) for a very large aggregate. Also see bug 724080 which may show up as soon as this particular code path is fixed. 3. 45 1322 29 1293 SQL-main-master SELECT MAX(Bug.heat), SUM(Bug.heat), COUNT(Bug.id) FROM Bug, BugTask WHERE BugTask.bug = Bug.id AND BugTask.distribution = $INT AND BugTask.sourcepackagename = $INT AND Bug.duplicateof IS NULL AND BugTask.status IN ($INT ... $INT)
2011-10-16 19:58:37 Robert Collins description Symptoms ======== When trying to approve nominations on bugs that have a large number of projects, launchpad times out. For example, bug #706999 or bug #732628. This is preventing the security team and kernel team's workflow from accurately tracking kernel issues. Analysis ======== death by sql: multiple heat lookup calls, each of which is slow (30ms) for a very large aggregate. Also see bug 724080 which may show up as soon as this particular code path is fixed. 3. 45 1322 29 1293 SQL-main-master SELECT MAX(Bug.heat), SUM(Bug.heat), COUNT(Bug.id) FROM Bug, BugTask WHERE BugTask.bug = Bug.id AND BugTask.distribution = $INT AND BugTask.sourcepackagename = $INT AND Bug.duplicateof IS NULL AND BugTask.status IN ($INT ... $INT) Symptoms ======== When trying to approve nominations on bugs that have a large number of projects, launchpad times out. For example, bug #706999 or bug #732628. This is preventing the security team and kernel team's workflow from accurately tracking kernel issues. Analysis ======== death by sql: multiple heat lookup calls, each of which is slow (30ms) for a very large aggregate. The high sql time is commonly correlated with poor sql utilisation, so I would ignore it until the sql statement count is sane (< 100 queries). Also see bug 724080 which may show up as soon as this particular code path is fixed. 3. 45 1322 29 1293 SQL-main-master SELECT MAX(Bug.heat), SUM(Bug.heat), COUNT(Bug.id) FROM Bug,      BugTask WHERE BugTask.bug = Bug.id   AND BugTask.distribution = $INT   AND BugTask.sourcepackagename = $INT   AND Bug.duplicateof IS NULL   AND BugTask.status IN ($INT ... $INT)
2011-10-16 20:00:11 Robert Collins summary Nominations stop working when bugs have large number of projects BugNomination:+editstatus timeout for bugs with many tasks
2011-10-26 19:55:59 Francis J. Lacoste tags platform-blocker rls-mgr-p-tracking timeout escalated platform-blocker rls-mgr-p-tracking timeout
2011-11-09 15:08:18 Gavin Panella launchpad: assignee Gavin Panella (allenap)
2011-11-09 15:08:20 Gavin Panella launchpad: status Triaged In Progress
2011-11-10 11:40:57 Gavin Panella branch linked lp:~allenap/launchpad/bugnomination-timeout-bug-874250
2011-11-15 10:50:33 Gavin Panella branch linked lp:~allenap/launchpad/bugnomination-timeout-bug-874250-lazy-heat
2011-11-16 22:21:18 Brad Crittenden branch linked lp:~bac/launchpad/revert-14301
2011-11-17 04:50:36 Launchpad QA Bot tags escalated platform-blocker rls-mgr-p-tracking timeout escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout
2011-11-17 04:50:37 Launchpad QA Bot launchpad: status In Progress Fix Committed
2011-11-17 13:46:50 Gavin Panella branch linked lp:~allenap/launchpad/bugnomination-timeout-bug-874250-lazy-heat-returns
2011-11-18 15:40:49 Gavin Panella tags escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout escalated platform-blocker qa-ok rls-mgr-p-tracking timeout
2011-11-18 22:21:02 Launchpad QA Bot tags escalated platform-blocker qa-ok rls-mgr-p-tracking timeout escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout
2011-11-21 12:29:20 Gavin Panella tags escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout escalated platform-blocker qa-ok rls-mgr-p-tracking timeout
2011-11-22 05:36:24 William Grant launchpad: status Fix Committed In Progress
2011-12-12 21:31:03 Gavin Panella branch linked lp:~allenap/launchpad/bugnomination-timeout-bug-874250-heat-death
2012-01-03 17:41:30 Gavin Panella branch linked lp:~allenap/launchpad/bugnomination-timeout-bug-874250-preload-email
2012-01-05 21:22:52 Launchpad QA Bot tags escalated platform-blocker qa-ok rls-mgr-p-tracking timeout escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout
2012-01-05 21:22:53 Launchpad QA Bot launchpad: status In Progress Fix Committed
2012-01-06 15:12:48 Gavin Panella tags escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout escalated platform-blocker qa-ok rls-mgr-p-tracking timeout
2012-01-16 15:09:21 Gavin Panella launchpad: status Fix Committed Fix Released
2012-01-16 17:26:33 Francis J. Lacoste launchpad: status Fix Released Triaged
2012-02-07 09:59:52 William Grant launchpad: assignee Gavin Panella (allenap) William Grant (wgrant)
2012-02-07 09:59:54 William Grant launchpad: status Triaged In Progress
2012-02-07 10:00:19 William Grant branch linked lp:~wgrant/launchpad/max-heat-too-hot
2012-02-08 19:20:44 Launchpad QA Bot tags escalated platform-blocker qa-ok rls-mgr-p-tracking timeout escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout
2012-02-08 19:20:46 Launchpad QA Bot launchpad: status In Progress Fix Committed
2012-02-08 23:57:25 William Grant tags escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout escalated platform-blocker qa-ok rls-mgr-p-tracking timeout
2012-02-09 02:17:13 William Grant launchpad: status Fix Committed Fix Released
2012-02-27 17:26:21 John Johansen attachment added error returned from the api https://bugs.launchpad.net/launchpad/+bug/874250/+attachment/2788504/+files/oneiric-706999.txt
2012-02-27 20:23:37 Francis J. Lacoste launchpad: status Fix Released Triaged
2012-02-29 04:09:34 William Grant launchpad: assignee William Grant (wgrant)
2012-04-03 17:32:51 Richard Harding launchpad: status Triaged In Progress
2012-04-03 17:32:51 Richard Harding launchpad: assignee Richard Harding (rharding)
2012-04-27 16:24:44 Richard Harding branch linked lp:~rharding/launchpad/editstatus_timeout_874250
2012-05-04 14:11:59 Richard Harding branch linked lp:~rharding/launchpad/editstatus_timeout_874250_workkthx
2012-05-04 17:07:49 Richard Harding branch linked lp:~rharding/launchpad/editstatus_timeout_874250_workthx
2012-05-10 14:51:40 Richard Harding branch linked lp:~rharding/launchpad/bugnom_874250
2012-05-11 08:00:25 Launchpad QA Bot tags escalated platform-blocker qa-ok rls-mgr-p-tracking timeout escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout
2012-05-11 08:00:26 Launchpad QA Bot launchpad: status In Progress Fix Committed
2012-05-14 02:20:15 William Grant tags escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout escalated platform-blocker qa-ok rls-mgr-p-tracking timeout
2012-06-20 03:51:42 William Grant launchpad: status Fix Committed Triaged
2012-09-11 14:51:01 Curtis Hovey launchpad: assignee Richard Harding (rharding)
2012-09-17 13:05:04 Curtis Hovey tags escalated platform-blocker qa-ok rls-mgr-p-tracking timeout bug-nomination escalated platform-blocker qa-ok rls-mgr-p-tracking timeout
2012-10-16 13:05:57 Curtis Hovey launchpad: assignee Curtis Hovey (sinzui)
2012-10-16 13:06:01 Curtis Hovey launchpad: status Triaged In Progress
2012-10-16 21:26:51 Curtis Hovey branch linked lp:~sinzui/launchpad/nominations-investigation-4
2012-10-18 14:50:37 Launchpad QA Bot tags bug-nomination escalated platform-blocker qa-ok rls-mgr-p-tracking timeout bug-nomination escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout
2012-10-18 14:50:38 Launchpad QA Bot launchpad: status In Progress Fix Committed
2012-10-18 16:34:43 Curtis Hovey tags bug-nomination escalated platform-blocker qa-needstesting rls-mgr-p-tracking timeout bug-nomination escalated platform-blocker qa-ok rls-mgr-p-tracking timeout
2012-11-06 19:11:31 Curtis Hovey launchpad: status Fix Committed Fix Released