celery RabbitMQ queue slowly increasing on ackee
Bug #972098 reported by
Haw Loeung
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Launchpad itself |
Fix Released
|
Critical
|
William Grant |
Bug Description
Hi,
The celery RabbitMQ queue is slowly increasing on ackee. 2 hours ago, it was at 53. Now it is at 259:
Any chance someone could take a look?
Thanks,
Haw
Related branches
lp:~abentley/launchpad/celery-job-feature-flag
- Graham Binns (community): Approve (code)
-
Diff: 268 lines (+130/-2)6 files modifiedlib/lp/code/model/branch.py (+11/-2)
lib/lp/code/model/tests/test_branch.py (+53/-0)
lib/lp/services/features/flags.py (+6/-0)
lib/lp/services/job/runner.py (+15/-0)
lib/lp/services/job/tests/test_celeryjob.py (+14/-0)
lib/lp/services/job/tests/test_runner.py (+31/-0)
Changed in launchpad: | |
importance: | Undecided → Critical |
assignee: | nobody → Aaron Bentley (abentley) |
tags: | added: canonical-losa-lp |
Changed in launchpad: | |
status: | New → In Progress |
tags: |
added: qa-ok removed: qa-needstesting |
Changed in launchpad: | |
status: | Fix Committed → Fix Released |
Changed in launchpad: | |
status: | Fix Released → In Progress |
Changed in launchpad: | |
assignee: | Aaron Bentley (abentley) → William Grant (wgrant) |
Changed in launchpad: | |
status: | In Progress → Fix Released |
To post a comment you must log in.
(I asked Haw to assign this to Aaron as he and Abel have been bringing
up the celery stack for LP).
The alert has been squelched for now, but if the growth rate were to
accelerate we'd run into rabbit memory issues - we've got a few days
grace I suspect.