Celery is leaving an ever increasing number of queues behind

[Liam Young]

Celery appears to be leaving an ever increasing number of anonymous (no descriptive prefix) queues in rabbit. https://pastebin.canonical.com/68543/

I have spoken to able and he believes the queues with names that are pure hex digits are celery related. They are created for each running job; they should be deleted when the jobs finish. Looks like a bad config if the queues stay around and they all have a pending message.

[JuanJo Ciarlante (jjo)]

They are indeed celeryresults (see below), non-durable with no consumers, yet holding exactly 1 message (smells like roasted celery-s?):

$ sudo rabbitmqctl -p launchpad.net list_queues messages consumers name durable auto_delete |egrep ^1|head -2
1 0 3e99e12763e24f53ac73b838dba1503d false true
1 0 f1b87ef31d864e279cec76dc65e49844 false true

$ sudo rabbitmqctl -p $vhost list_bindings source_name destination_name routing_key|egrep '(3e99|f1b8)'
        3e99e12763e24f53ac73b838dba1503d 3e99e12763e24f53ac73b838dba1503d
        f1b87ef31d864e279cec76dc65e49844 f1b87ef31d864e279cec76dc65e49844
celeryresults 3e99e12763e24f53ac73b838dba1503d 3e99e12763e24f53ac73b838dba1503d
celeryresults f1b87ef31d864e279cec76dc65e49844 f1b87ef31d864e279cec76dc65e49844

[Launchpad QA Bot (lpqabot)]

Fixed in stable r15548 <http://bazaar.launchpad.net/~launchpad-pqm/launchpad/stable/revision/15548>.

[Abel Deuring (adeuring)]

The merged branch just allows us to get better details about the queues and why they were created.

[Launchpad QA Bot (lpqabot)]

Fixed in stable r15596 <http://bazaar.launchpad.net/~launchpad-pqm/launchpad/stable/revision/15596>.

[Abel Deuring (adeuring)]

still not fixed but there is some progress: we can seen now some more details about the Celery jobs

[Launchpad QA Bot (lpqabot)]

Fixed in stable r15656 <http://bazaar.launchpad.net/~launchpad-pqm/launchpad/stable/revision/15656>.

[Launchpad QA Bot (lpqabot)]

Fixed in stable r15684 <http://bazaar.launchpad.net/~launchpad-pqm/launchpad/stable/revision/15684>.

[David Ames (thedac)]

All the hashed queues had the following paramters:
AD
x-expires=86400000
Last Update: 2012-07-05 14:24:27