Activity log for bug #438116

Date Who What changed Old value New value Message
2009-09-28 12:42:50 Adam B Butler bug added bug
2009-11-30 17:36:37 Curtis Hovey affects launchpad malone
2009-11-30 17:36:37 Curtis Hovey malone: importance Undecided High
2009-11-30 17:36:37 Curtis Hovey malone: status New Triaged
2009-11-30 17:37:00 Curtis Hovey tags oops
2010-08-16 06:11:12 Robert Collins summary Timeout Error (OOPS-1367EC560) When Converting Bug into Question Timeout Error (OOPS-1367EC560) When Converting Bug into Question (BugTask:+create-question)
2010-08-16 15:43:00 Ursula Junque tags oops timeout
2010-08-16 15:45:15 Ursula Junque summary Timeout Error (OOPS-1367EC560) When Converting Bug into Question (BugTask:+create-question) Timeout when converting bug into question (BugTask:+create-question)
2010-08-23 22:25:57 Robert Collins description Earlier today, I was attempting to convert a Bug report (Bug #433515) into a Question, but each time I attempted this, I received the error: "Timeout Error, Sorry, something just went wrong in Launchpad. (OOPS-1367EC560)." I haven't been working with Bug Reports in LP for very long, so this was my first "Bug-to-Question Conversion" and I assumed it was something wrong on my end. Repeated attempts (just clicking the plus icon next to "Convert to Question" in the right-hand-side menu) kept bringing up the same Timeout message, so I asked for help in #ubuntu-bugs. They redirected me to #launchpad ... but then shortly after asking my question, I tried (same process) again; this time, the process completed without error. I was all ready to chalk this up to "Internet/Web/Random-silliness" but james_w on #launchpad indicated that I should file a report, and so here I am and here it is. :) It is probably important to note here that I am using the "bugs.edge.launchpad.net" (beta/testing) server; aside from that, I don't really know what kind of additional information would be useful to add. Apologies in advance if I'm leaving something out... Bug/page in question: https://bugs.edge.launchpad.net/ubuntu/+bug/433515 (Accessed via Firefox 3.5.2, atop Ubuntu Karmic 9.10, x86_64.) https://lp-oops.canonical.com/oops.py/?oopsid=1695L1219 Branch: launchpad-rev-9649 Revno: 9649 SQL time: 1871 ms Non-sql time: 43355 ms Total time: 45226 ms Statement Count: 490 Converting https://bugs.edge.launchpad.net/ubuntu/+source/compiz/+bug/622129 to a question. This bug has 50 or so direct subscribers and some are teams which may be pretty large. 486. 5408 4ms launchpad-main-master UPDATE Bug SET heat=calculate_bug_heat(622129), heat_last_updated=CURRENT_TIMESTAMP AT TIME ZONE 'UTC' WHERE Bug.id = %s 487. 45213 2ms session UPDATE SessionData SET last_accessed = CURRENT_TIMESTAMP WHERE client_id = %s AND last_accessed < CURRENT_TIMESTAMP - '540 seconds'::interval Shows a 40 second gap between updating the heat and closing the request off - I strongly suspect sending mail is the culprit.
2010-09-02 17:02:09 Brian Murray bug added subscriber Brian Murray
2010-09-09 19:30:58 Robert Collins affects malone launchpad-foundations
2010-09-09 19:49:21 Robert Collins description https://lp-oops.canonical.com/oops.py/?oopsid=1695L1219 Branch: launchpad-rev-9649 Revno: 9649 SQL time: 1871 ms Non-sql time: 43355 ms Total time: 45226 ms Statement Count: 490 Converting https://bugs.edge.launchpad.net/ubuntu/+source/compiz/+bug/622129 to a question. This bug has 50 or so direct subscribers and some are teams which may be pretty large. 486. 5408 4ms launchpad-main-master UPDATE Bug SET heat=calculate_bug_heat(622129), heat_last_updated=CURRENT_TIMESTAMP AT TIME ZONE 'UTC' WHERE Bug.id = %s 487. 45213 2ms session UPDATE SessionData SET last_accessed = CURRENT_TIMESTAMP WHERE client_id = %s AND last_accessed < CURRENT_TIMESTAMP - '540 seconds'::interval Shows a 40 second gap between updating the heat and closing the request off - I strongly suspect sending mail is the culprit. Note that while *this* one is a soft timeout, we've seen hard timeouts too, and the fact that the session is being updated correctly sftrongly suffests that the appserver thread state is being preserved for the whole time,which is undesirable. https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1713N810 Branch: launchpad-rev-9760 Revno: 9760 SQL time: 3065 ms Non-sql time: 29668 ms Total time: 32733 ms Statement Count: 676 https://bugs.launchpad.net/ubuntu/+source/vdpau-video/+bug/633809/+create-question This send 115 emails, and by subtracting the time between the last two events and dividing, its ~ 200ms per email, +- say 30. emails are buffered in memory and then spooled once the DB commits (so that we don't mail twice in the event of automatic retry. 672. 6042 1ms SQL-launchpad-main-master SELECT DistributionSourcePackage.bug_count, DistributionSourcePackage.bug_reported_acknowledgement, DistributionSourcePackage.bug_reporting_guidelines, DistributionSourcePackage.distribution, DistributionSourcePackage.id, DistributionSourcePackage.is_upstream_link_allowed, DistributionSourcePackage.max_bug_heat, DistributionSourcePackage.po_message_count, DistributionSourcePackage.sourcepackagename, DistributionSourcePackage.total_bug_heat FROM DistributionSourcePackage WHERE DistributionSourcePackage.sourcepackagename = %s AND DistributionSourcePackage.distribution = %s 673. 32722 1ms SQL-session UPDATE SessionData SET last_accessed = CURRENT_TIMESTAMP WHERE client_id = %s AND last_accessed < CURRENT_TIMESTAMP - '540 seconds'::interval There are a few things that may need looking at here: - why is it taking 200ms to queue a mail - why isn't the offload-to-thread stuff working? There are a couple of things highlighted by this too: - we don't see the commit in the oops details - we're not getting a hard timeout and we should In terms of code, the mail sending code is lp.bugs.browser.bugtask.BugTaskCreateQuestionView which is bug.convertToQuestion which does notify(ObjectModifiedEvent) (Based on looking at where the sends occur relative to the question being made in the action trace.
2010-09-15 08:17:23 Micah Gersten bug added subscriber Micah Gersten
2010-10-14 04:53:39 Robert Collins tags timeout pg83 timeout
2010-10-25 21:53:56 Robert Collins tags pg83 timeout timeout
2010-10-25 21:54:01 Robert Collins description Note that while *this* one is a soft timeout, we've seen hard timeouts too, and the fact that the session is being updated correctly sftrongly suffests that the appserver thread state is being preserved for the whole time,which is undesirable. https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1713N810 Branch: launchpad-rev-9760 Revno: 9760 SQL time: 3065 ms Non-sql time: 29668 ms Total time: 32733 ms Statement Count: 676 https://bugs.launchpad.net/ubuntu/+source/vdpau-video/+bug/633809/+create-question This send 115 emails, and by subtracting the time between the last two events and dividing, its ~ 200ms per email, +- say 30. emails are buffered in memory and then spooled once the DB commits (so that we don't mail twice in the event of automatic retry. 672. 6042 1ms SQL-launchpad-main-master SELECT DistributionSourcePackage.bug_count, DistributionSourcePackage.bug_reported_acknowledgement, DistributionSourcePackage.bug_reporting_guidelines, DistributionSourcePackage.distribution, DistributionSourcePackage.id, DistributionSourcePackage.is_upstream_link_allowed, DistributionSourcePackage.max_bug_heat, DistributionSourcePackage.po_message_count, DistributionSourcePackage.sourcepackagename, DistributionSourcePackage.total_bug_heat FROM DistributionSourcePackage WHERE DistributionSourcePackage.sourcepackagename = %s AND DistributionSourcePackage.distribution = %s 673. 32722 1ms SQL-session UPDATE SessionData SET last_accessed = CURRENT_TIMESTAMP WHERE client_id = %s AND last_accessed < CURRENT_TIMESTAMP - '540 seconds'::interval There are a few things that may need looking at here: - why is it taking 200ms to queue a mail - why isn't the offload-to-thread stuff working? There are a couple of things highlighted by this too: - we don't see the commit in the oops details - we're not getting a hard timeout and we should In terms of code, the mail sending code is lp.bugs.browser.bugtask.BugTaskCreateQuestionView which is bug.convertToQuestion which does notify(ObjectModifiedEvent) (Based on looking at where the sends occur relative to the question being made in the action trace. *** pg8.4 *** OOPS-1759ED1387 Note that while *this* one is a soft timeout, we've seen hard timeouts too, and the fact that the session is being updated correctly sftrongly suffests that the appserver thread state is being preserved for the whole time,which is undesirable. https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1713N810 Branch: launchpad-rev-9760 Revno: 9760 SQL time: 3065 ms Non-sql time: 29668 ms Total time: 32733 ms Statement Count: 676 https://bugs.launchpad.net/ubuntu/+source/vdpau-video/+bug/633809/+create-question This send 115 emails, and by subtracting the time between the last two events and dividing, its ~ 200ms per email, +- say 30. emails are buffered in memory and then spooled once the DB commits (so that we don't mail twice in the event of automatic retry. 672. 6042 1ms SQL-launchpad-main-master SELECT DistributionSourcePackage.bug_count, DistributionSourcePackage.bug_reported_acknowledgement, DistributionSourcePackage.bug_reporting_guidelines, DistributionSourcePackage.distribution, DistributionSourcePackage.id, DistributionSourcePackage.is_upstream_link_allowed, DistributionSourcePackage.max_bug_heat, DistributionSourcePackage.po_message_count, DistributionSourcePackage.sourcepackagename, DistributionSourcePackage.total_bug_heat FROM DistributionSourcePackage WHERE DistributionSourcePackage.sourcepackagename = %s AND DistributionSourcePackage.distribution = %s 673. 32722 1ms SQL-session UPDATE SessionData SET last_accessed = CURRENT_TIMESTAMP WHERE client_id = %s AND last_accessed < CURRENT_TIMESTAMP - '540 seconds'::interval There are a few things that may need looking at here:  - why is it taking 200ms to queue a mail  - why isn't the offload-to-thread stuff working? There are a couple of things highlighted by this too:  - we don't see the commit in the oops details  - we're not getting a hard timeout and we should In terms of code, the mail sending code is lp.bugs.browser.bugtask.BugTaskCreateQuestionView which is bug.convertToQuestion which does notify(ObjectModifiedEvent) (Based on looking at where the sends occur relative to the question being made in the action trace.
2010-11-09 17:17:52 Pedro Villavicencio bug added subscriber Pedro Villavicencio
2010-11-09 17:19:32 Philip Muškovac bug added subscriber Philip Muškovac
2010-11-14 15:47:48 Curtis Hovey affects launchpad-foundations launchpad-answers
2010-11-18 14:55:33 Deryck Hodge bug task added malone
2010-11-18 14:55:45 Deryck Hodge malone: status New Triaged
2010-11-18 14:55:48 Deryck Hodge malone: importance Undecided High
2010-11-18 15:26:57 Abel Deuring bug added subscriber Abel Deuring
2011-01-12 17:02:49 Robert Collins launchpad: importance High Critical
2011-01-13 01:28:37 Jonathan Gossage removed subscriber Jonathan Gossage
2011-03-17 00:32:04 Robert Collins launchpad: status Triaged Fix Released
2011-03-17 00:32:12 Robert Collins launchpad: status Fix Released Triaged
2011-04-21 20:10:38 Curtis Hovey launchpad: assignee Curtis Hovey (sinzui)
2011-04-21 20:10:40 Curtis Hovey launchpad: status Triaged In Progress
2011-04-22 07:01:04 Launchpad QA Bot launchpad: milestone 11.05
2011-04-22 07:01:06 Launchpad QA Bot tags lp-answers lp-bugs timeout lp-answers lp-bugs qa-untestable timeout
2011-04-22 07:01:08 Launchpad QA Bot launchpad: status In Progress Fix Committed
2011-04-22 15:22:20 Launchpad Janitor branch linked lp:~sinzui/launchpad/bugtask-create-question-1
2011-04-22 15:28:11 Curtis Hovey launchpad: status Fix Committed In Progress
2011-04-22 15:28:23 Curtis Hovey tags lp-answers lp-bugs qa-untestable timeout lp-answers lp-bugs timeout
2011-04-23 08:16:18 Launchpad QA Bot tags lp-answers lp-bugs timeout lp-answers lp-bugs qa-needstesting timeout
2011-04-23 08:16:23 Launchpad QA Bot launchpad: status In Progress Fix Committed
2011-04-23 14:15:15 Curtis Hovey tags lp-answers lp-bugs qa-needstesting timeout lp-answers lp-bugs qa-ok timeout
2011-04-25 11:26:14 Данило Шеган launchpad: status Fix Committed Fix Released