When upgrade_tasks fail for one controller, other controllers continue upgrading

Bug #1804468 reported by Jiří Stránský
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
High
Jiří Stránský

Bug Description

While looking into a different bug, we noticed that when upgrade_tasks fail on one node, they still continue on other nodes. This can happen when upgrading 3 Controllers at the same time.

tags: added: rocky-backport-potential
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (master)

Fix proposed to branch: master
Review: https://review.openstack.org/619265

Changed in tripleo:
assignee: nobody → Jiří Stránský (jistr)
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (master)

Reviewed: https://review.openstack.org/619265
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=021d1b1efba054a743f73dc596e1b80d38db0bbd
Submitter: Zuul
Branch: master

commit 021d1b1efba054a743f73dc596e1b80d38db0bbd
Author: Jiri Stransky <email address hidden>
Date: Wed Nov 21 15:48:53 2018 +0100

    Stop upgrade if a task on one node fails

    When we were upgrading multiple nodes at the same time,
    e.g. controllers, and a taks on one of the nodes failed, the other
    nodes would keep upgrading. This is undersirable and can be fixed by
    adding any_errors_fatal to the Ansible plays.

    Change-Id: Iad2b5e32e955da41af4d2b8dd8ad8aa1eb5dffa9
    Closes-Bug: #1804468

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/rocky)

Fix proposed to branch: stable/rocky
Review: https://review.openstack.org/620320

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/rocky)

Reviewed: https://review.openstack.org/620320
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=027493c99f074ef685f3e4c131b7b35984a0b026
Submitter: Zuul
Branch: stable/rocky

commit 027493c99f074ef685f3e4c131b7b35984a0b026
Author: Jiri Stransky <email address hidden>
Date: Wed Nov 21 15:48:53 2018 +0100

    Stop upgrade if a task on one node fails

    When we were upgrading multiple nodes at the same time,
    e.g. controllers, and a taks on one of the nodes failed, the other
    nodes would keep upgrading. This is undersirable and can be fixed by
    adding any_errors_fatal to the Ansible plays.

    Change-Id: Iad2b5e32e955da41af4d2b8dd8ad8aa1eb5dffa9
    Closes-Bug: #1804468
    (cherry picked from commit 021d1b1efba054a743f73dc596e1b80d38db0bbd)

tags: added: in-stable-rocky
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 10.2.0

This issue was fixed in the openstack/tripleo-heat-templates 10.2.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 9.2.0

This issue was fixed in the openstack/tripleo-heat-templates 9.2.0 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.