Notifications are emitted per-cell instead of globally

Bug #1700496 reported by Sylvain Bauza
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
Undecided
Unassigned
devstack
Invalid
Undecided
Unassigned

Bug Description

With https://review.openstack.org/#/c/436094/ we began using different transport URLs for Nova internal services.
That said, as notifications emit on a different topic but use the same transport URL than the component, it leads to our consumers missing notifications as they only subscribe to the original MQ.

While Nova can use multiple MQs, we should still offer the possibility to have global notifications for Nova so a consumer wouldn't require to modify their configs every time a new cell is issued.

That can be an oslo.messaging config option [1], but we certainly need to be more gentle in Devstack or depending jobs (like for Vitrage) could fail.

[1] https://docs.openstack.org/developer/oslo.messaging/opts.html#oslo_messaging_notifications.transport_url

devstack version: pike

Changed in nova:
status: New → Confirmed
description: updated
Revision history for this message
Matt Riedemann (mriedem) wrote :

We are going to need to document this in the nova cells devref as something to consider when doing multi-cell deployment.

tags: added: cells doc
Revision history for this message
Matt Riedemann (mriedem) wrote :

This does global MQ for notifications in devstack: https://review.openstack.org/#/c/477556/

Revision history for this message
Sean Dague (sdague) wrote :

No version was found in the description, which is required, marking as Incomplete. Please update the bug description to include 'devstack version: ... '.

tags: added: needs.openstack-version
Changed in devstack:
status: New → Incomplete
Sean Dague (sdague)
Changed in nova:
status: Confirmed → In Progress
Sean Dague (sdague)
Changed in devstack:
status: Incomplete → In Progress
Matt Riedemann (mriedem)
description: updated
tags: added: openstack-version.pike
removed: needs.openstack-version
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to devstack (master)

Reviewed: https://review.openstack.org/477556
Committed: https://git.openstack.org/cgit/openstack-dev/devstack/commit/?id=f3d533157267a1568eeb36a349aee637195e9c8a
Submitter: Jenkins
Branch: master

commit f3d533157267a1568eeb36a349aee637195e9c8a
Author: Dan Smith <email address hidden>
Date: Thu Jun 8 08:22:38 2017 -0400

    Fleetify nova conductor for N cells

    This makes us start two levels of nova-conductor processes, and one per cell.

    Note that this also sets the notification transport_url to the top-level mq
    so that we continue to get a unified stream of notifications.

    Related-Bug: #1700496
    Change-Id: I08d7da843d18b426dda8a8a231039d950a4c0ce5
    Depends-On: I64b600b30f6e54db0ec9083c6c176e895c6d0cc2
    Depends-On: If59453f1899e99040c554bcb9ad54c8a506adc56

Revision history for this message
Sean Dague (sdague) wrote :

There are no currently open reviews on this bug, changing the status back to the previous state and unassigning. If there are active reviews related to this bug, please include links in comments.

Changed in nova:
status: In Progress → Confirmed
Revision history for this message
Balazs Gibizer (balazs-gibizer) wrote :

Based on Matt's comment from ML[1] the nova side of this bug has already been fixed by [2]

[1]http://lists.openstack.org/pipermail/openstack-dev/2017-August/121571.html
[2]https://review.openstack.org/#/c/487183/

Changed in nova:
status: Confirmed → Fix Committed
Changed in nova:
status: Fix Committed → Fix Released
Revision history for this message
Dr. Jens Harbott (j-harbott) wrote :

It looks like this issue was fixed via a patch to nova, please update if there is still an issue with devstack.

Changed in devstack:
status: In Progress → Incomplete
Revision history for this message
Dr. Jens Harbott (j-harbott) wrote :

[Closing for devstack because there has been no activity for 60 days.]

Changed in devstack:
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.