No need to restart rabbitmq if there is no version upgrade

Bug #1766636 reported by Albert Mikaelyan
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Ansible
Won't Fix
High
Albert Mikaelyan

Bug Description

According to minor version upgrade guide: https://docs.openstack.org/openstack-ansible/latest/admin/upgrades/minor-updates.html

You should include "rabbitmq_upgrade=true" to setup-infrastructure run (nowhere it says that it's not required).
However, even if user does include this flag, there is no reason to do anything if the version equals to the upgrade version. Unfortunately, it still does stop/start to the service, even if no version upgrade was needed:

See the following include:
https://github.com/openstack/openstack-ansible-rabbitmq_server/blob/stable/ocata/tasks/rabbitmq_upgrade_check.yml#L68

Which results in including this:
https://github.com/openstack/openstack-ansible-rabbitmq_server/blob/stable/ocata/tasks/rabbitmq_upgrade_prep.yml#L26

This results in unnecessary downtime of openstack services. I don't think we need to restart rabbit if there is no version change, even if "rabbitmq_upgrade=true" flag is set.

Changed in openstack-ansible:
status: New → Confirmed
importance: Undecided → High
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-openstack_hosts (master)

Fix proposed to branch: master
Review: https://review.openstack.org/565940

Changed in openstack-ansible:
assignee: nobody → Kevin Carter (kevin-carter)
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-rabbitmq_server (master)

Fix proposed to branch: master
Review: https://review.openstack.org/566017

Changed in openstack-ansible:
assignee: Kevin Carter (kevin-carter) → Albert Mikaelyan (tahvok)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-rabbitmq_server (master)

Reviewed: https://review.openstack.org/566017
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-rabbitmq_server/commit/?id=c78e0b1d026ff34a53143fb897df0fdc8c5f8342
Submitter: Zuul
Branch: master

commit c78e0b1d026ff34a53143fb897df0fdc8c5f8342
Author: Albert Mikaelyan <email address hidden>
Date: Thu May 3 13:03:38 2018 +0300

    Do not restart rabbitmq when no version is changed

    If rabbitmq version in the role equals to already installed version
    there is no reason to stop/start rabbitmq and cause a downtime.

    Change-Id: I523be647b5e82e6f088428bf2db24dc4cd2cfb53
    Closes-Bug: 1766636

Changed in openstack-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-rabbitmq_server (stable/queens)

Fix proposed to branch: stable/queens
Review: https://review.openstack.org/566116

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-rabbitmq_server (stable/pike)

Fix proposed to branch: stable/pike
Review: https://review.openstack.org/566119

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-rabbitmq_server (stable/ocata)

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/566121

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-rabbitmq_server (stable/queens)

Reviewed: https://review.openstack.org/566116
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-rabbitmq_server/commit/?id=bfd11dbb89ce1428a4dc85b64f5df154157b06ab
Submitter: Zuul
Branch: stable/queens

commit bfd11dbb89ce1428a4dc85b64f5df154157b06ab
Author: Albert Mikaelyan <email address hidden>
Date: Thu May 3 13:03:38 2018 +0300

    Do not restart rabbitmq when no version is changed

    If rabbitmq version in the role equals to already installed version
    there is no reason to stop/start rabbitmq and cause a downtime.

    Change-Id: I523be647b5e82e6f088428bf2db24dc4cd2cfb53
    Closes-Bug: 1766636
    (cherry picked from commit c78e0b1d026ff34a53143fb897df0fdc8c5f8342)

tags: added: in-stable-queens
Revision history for this message
Albert Mikaelyan (tahvok) wrote :

Problem found with the latest fix, as the version needs to be always checked, even when running rabbitmq_upgrade

Changed in openstack-ansible:
status: Fix Released → Confirmed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-rabbitmq_server (master)

Fix proposed to branch: master
Review: https://review.openstack.org/566243

Changed in openstack-ansible:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible (master)

Fix proposed to branch: master
Review: https://review.openstack.org/566269

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on openstack-ansible-rabbitmq_server (stable/ocata)

Change abandoned by Albert Mikaelyan (<email address hidden>) on branch: stable/ocata
Review: https://review.openstack.org/566121

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on openstack-ansible (master)

Change abandoned by Albert Mikaelyan (<email address hidden>) on branch: master
Review: https://review.openstack.org/566269
Reason: Going to work on different approach here

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on openstack-ansible-rabbitmq_server (master)

Change abandoned by Albert Mikaelyan (<email address hidden>) on branch: master
Review: https://review.openstack.org/566243

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on openstack-ansible-rabbitmq_server (stable/pike)

Change abandoned by Albert Mikaelyan (<email address hidden>) on branch: stable/pike
Review: https://review.openstack.org/566119

Revision history for this message
Dmitriy Rabotyagov (noonedeadpunk) wrote :

Tbh I can't agree that there's no reason in doing anything when rabbitmq_upgrade is true, but the version is the same. As I really use that flag when I want to re-configure rabbit (ie re-create queues and etc), and this flag works like a magic when rabbit is stuck. So I'd rather either won't touch behaviour of upgrade flag or create another one which would dublicate that behaviour.
And there's no downtime of openstack services, because we use HA queues for rabbit, so we have only single server down, while 2 others continue operations. So no downtime when running with that flag is expected.

Changed in openstack-ansible:
status: In Progress → Won't Fix
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-rabbitmq_server queens-eol

This issue was fixed in the openstack/openstack-ansible-rabbitmq_server queens-eol release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-rabbitmq_server rocky-eol

This issue was fixed in the openstack/openstack-ansible-rabbitmq_server rocky-eol release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-rabbitmq_server stein-eol

This issue was fixed in the openstack/openstack-ansible-rabbitmq_server stein-eol release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-rabbitmq_server train-eol

This issue was fixed in the openstack/openstack-ansible-rabbitmq_server train-eol release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-rabbitmq_server ussuri-eol

This issue was fixed in the openstack/openstack-ansible-rabbitmq_server ussuri-eol release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-rabbitmq_server yoga-eom

This issue was fixed in the openstack/openstack-ansible-rabbitmq_server yoga-eom release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-rabbitmq_server victoria-eom

This issue was fixed in the openstack/openstack-ansible-rabbitmq_server victoria-eom release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-rabbitmq_server wallaby-eom

This issue was fixed in the openstack/openstack-ansible-rabbitmq_server wallaby-eom release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-rabbitmq_server xena-eom

This issue was fixed in the openstack/openstack-ansible-rabbitmq_server xena-eom release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/openstack-ansible-rabbitmq_server zed-eom

This issue was fixed in the openstack/openstack-ansible-rabbitmq_server zed-eom release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.