DistroSeries:+queue Timeout accepting packages (bug structural subscriptions)
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Launchpad itself |
Fix Released
|
Critical
|
Colin Watson |
Bug Description
https:/
Referrer: https:/
OOPS-1932AU494
SQL time: 7701 ms
Non-sql time: 3425 ms
Total time: 11126 ms
Statement Count: 1209
1200 statements longest 225ms
96 bugsubscription lookups (130ms)
110 batched person-with-account lookups (420ms)
56 archive lookups (80ms)
56 distroarchseries lookups(60ms)
43 individual person-with-account lookups (100ms)
43 packageuploadcustom lookups (70ms)
42 packageuploadbuild lookups (60ms)
37 LFA lookups (50ms)
37 DistributionSou
30 assignee lookups (122ms)
30 bugsubscription lookups (70ms)
27 team membership lookups (120ms)
24 structuralsubsc
3 SourcePackageFi
So while its terrible, the proximate cause is structural bug subscriptions combined with potato programming - querying each bug individually or something like that.
Related branches
- Stuart Bishop (community): Approve (db)
- Benji York (community): Approve (code)
- Robert Collins: Pending (db) requested
-
Diff: 140 lines (+51/-6)5 files modifieddatabase/sampledata/current-dev.sql (+14/-3)
database/sampledata/current.sql (+14/-3)
database/schema/comments.sql (+8/-0)
database/schema/patch-2209-27-2.sql (+13/-0)
database/schema/security.cfg (+2/-0)
- Steve Kowalik (community): Approve (code)
-
Diff: 975 lines (+598/-119)10 files modifiedlib/lp/services/config/schema-lazr.conf (+7/-0)
lib/lp/services/features/flags.py (+6/-0)
lib/lp/soyuz/configure.zcml (+26/-14)
lib/lp/soyuz/interfaces/processacceptedbugsjob.py (+57/-0)
lib/lp/soyuz/model/processacceptedbugsjob.py (+174/-0)
lib/lp/soyuz/scripts/processaccepted.py (+47/-80)
lib/lp/soyuz/scripts/tests/test_processaccepted.py (+3/-3)
lib/lp/soyuz/scripts/tests/test_queue.py (+34/-6)
lib/lp/soyuz/tests/test_processaccepted.py (+17/-16)
lib/lp/soyuz/tests/test_processacceptedbugsjob.py (+227/-0)
- Richard Harding (community): Approve
-
Diff: 118 lines (+4/-43)4 files modifiedlib/lp/services/features/flags.py (+0/-6)
lib/lp/soyuz/model/processacceptedbugsjob.py (+0/-10)
lib/lp/soyuz/scripts/processaccepted.py (+2/-5)
lib/lp/soyuz/scripts/tests/test_queue.py (+2/-22)
Changed in launchpad: | |
status: | New → Triaged |
importance: | Undecided → Critical |
tags: | added: timeout |
description: | updated |
description: | updated |
summary: |
- Timeout accepting packages + DistroSeries:+queue Timeout accepting packages |
Changed in launchpad: | |
assignee: | nobody → Colin Watson (cjwatson) |
status: | Triaged → In Progress |
tags: |
added: qa-ok removed: qa-needstesting |
tags: |
added: qa-ok removed: qa-needstesting |
Changed in launchpad: | |
status: | Fix Committed → Fix Released |
More oops:
(Error ID: OOPS-1916T11)
(Error ID: OOPS-1916F20)
These were accepting two packages (second was a retry of the first).
Doing them one at a time worked for one of them.
(Error ID: OOPS-1916R19)
(Error ID: OOPS-1916V18)
(Error ID: OOPS-1916Q18)
Gave up after three tries on the second.