Alarm coordinator tests sporadically failed

[Mehdi Abaakouk]

Hi,

Sometime alarms coordinator tests sporadically failed,

This is due to the oslo.messaging listener that don't create the queues at creation time, but at the first bus polling.

The current workaround is to use eventlet.sleep() after the listener object creation and hope it polls the bus one time.

ie: http://git.openstack.org/cgit/openstack/ceilometer/tree/ceilometer/tests/alarm/test_rpc.py#n176

But oslo.messaging needs to be fixed to remove the workaround.

Cheers,

[Mehdi Abaakouk (sileht)]

oslo.messaging fixes: https://review.openstack.org/#/c/100889/

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/100889
Committed: https://git.openstack.org/cgit/openstack/oslo.messaging/commit/?id=e582da68f4c5edd3e4a3cdb62819c210c72dcfad
Submitter: Jenkins
Branch: master

commit e582da68f4c5edd3e4a3cdb62819c210c72dcfad
Author: Mehdi Abaakouk <email address hidden>
Date: Wed Jun 18 14:18:48 2014 +0200

    Ensures listener queues exist in fake driver

    The fanout queues of the fake driver are created at the first executor
    poll, but if we use eventlet executor and the fake driver, when the sender
    delivers a fanout message before the first poll, the message goes to the
    topic queue instead of the server fanout queue.

    The changes fixes that by ensuring the all queues exists when the
    listener is created.

    Closes bug #1331453

    Change-Id: I92e7c01dd87d634b741bbcaea92f48730fdd555e

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/icehouse
Review: https://review.openstack.org/107911

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/107911
Committed: https://git.openstack.org/cgit/openstack/oslo.messaging/commit/?id=d822f6cbf0f41481fb934d8def228a1029eb7b44
Submitter: Jenkins
Branch: stable/icehouse

commit d822f6cbf0f41481fb934d8def228a1029eb7b44
Author: Mehdi Abaakouk <email address hidden>
Date: Wed Jun 18 14:18:48 2014 +0200

    Ensures listener queues exist in fake driver

    The fanout queues of the fake driver are created at the first executor
    poll, but if we use eventlet executor and the fake driver, when the sender
    delivers a fanout message before the first poll, the message goes to the
    topic queue instead of the server fanout queue.

    The changes fixes that by ensuring the all queues exists when the
    listener is created.

    Closes bug #1331453
    Related-Bug: #1334798

    Co-authored-by: Paul Michali <email address hidden>
    Change-Id: I92e7c01dd87d634b741bbcaea92f48730fdd555e
    (cherry picked from commit e582da68f4c5edd3e4a3cdb62819c210c72dcfad)
    (cherry picked from commit 0cfafac2468afe6b601a985495382aae3351b217)

[Eoghan Glynn (eglynn)]

Apparently fixed by the combination of oslo-messaging fixes from Mehdi Abaakouk and Nejc Saje:

   https://review.openstack.org/100889

and:

  https://review.openstack.org/106993

Since olso-messaging 1.3.1 was finally released on Friday July 25th, the disappearance of this issue from the builds is very clear from the relevant log stash queries, e.g.:

  http://bit.ly/test-coordination-presence-failures