Update serial 1 timeouts badly on bigger environments

Bug #1831617 reported by Lukas Bezdicka
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Lukas Bezdicka

Bug Description

The default setting of serial: 1 will timeout on environments with 10+ nodes. We need to provide reasonable way to parallelize the update.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (master)

Reviewed: https://review.opendev.org/658814
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=a59a188a6b6ef7275d318d95b17d3a692065e16a
Submitter: Zuul
Branch: master

commit a59a188a6b6ef7275d318d95b17d3a692065e16a
Author: Mathieu Bultel <email address hidden>
Date: Mon May 13 15:25:57 2019 +0200

    Force ansible serial to 1 for the Controller

    By introducing update_serial variable we parallelize update
    execution on non-pacemaker enabled nodes. Custom role data users
    need to update their role files. By default we do serial 1 making
    sure nothing changes for users who didn't update their role data.

    Resolves: rhbz#1652057
    Closes-Bug: #1831617

    Change-Id: I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/stein)

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/664225

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/rocky)

Fix proposed to branch: stable/rocky
Review: https://review.opendev.org/664561

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/queens)

Fix proposed to branch: stable/queens
Review: https://review.opendev.org/664567

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/stein)

Reviewed: https://review.opendev.org/664225
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=0339c45d99550a60c8b1df40d9907169b1870053
Submitter: Zuul
Branch: stable/stein

commit 0339c45d99550a60c8b1df40d9907169b1870053
Author: Mathieu Bultel <email address hidden>
Date: Mon May 13 15:25:57 2019 +0200

    Force ansible serial to 1 for the Controller

    By introducing update_serial variable we parallelize update
    execution on non-pacemaker enabled nodes. Custom role data users
    need to update their role files. By default we do serial 1 making
    sure nothing changes for users who didn't update their role data.

    Resolves: rhbz#1652057
    Closes-Bug: #1831617

    Change-Id: I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5
    (cherry picked from commit a59a188a6b6ef7275d318d95b17d3a692065e16a)

tags: added: in-stable-stein
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/rocky)

Reviewed: https://review.opendev.org/664561
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=ab67b737498f511e731e2a2421359427505a9a54
Submitter: Zuul
Branch: stable/rocky

commit ab67b737498f511e731e2a2421359427505a9a54
Author: Mathieu Bultel <email address hidden>
Date: Mon May 13 15:25:57 2019 +0200

    Force ansible serial to 1 for the Controller

    By introducing update_serial variable we parallelize update
    execution on non-pacemaker enabled nodes. Custom role data users
    need to update their role files. By default we do serial 1 making
    sure nothing changes for users who didn't update their role data.

    Resolves: rhbz#1652057
    Closes-Bug: #1831617

    Change-Id: I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5
    (cherry picked from commit a59a188a6b6ef7275d318d95b17d3a692065e16a)

tags: added: in-stable-rocky
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/queens)

Reviewed: https://review.opendev.org/664567
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=cfbf68bdacd5c2af69cde6602da038621b3cca28
Submitter: Zuul
Branch: stable/queens

commit cfbf68bdacd5c2af69cde6602da038621b3cca28
Author: Mathieu Bultel <email address hidden>
Date: Mon May 13 15:25:57 2019 +0200

    Force ansible serial to 1 for the Controller

    By introducing update_serial variable we parallelize update
    execution on non-pacemaker enabled nodes. Custom role data users
    need to update their role files. By default we do serial 1 making
    sure nothing changes for users who didn't update their role data.

    Resolves: rhbz#1652057
    Closes-Bug: #1831617

    Change-Id: I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5
    (cherry picked from commit a59a188a6b6ef7275d318d95b17d3a692065e16a)

tags: added: in-stable-queens
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 10.6.0

This issue was fixed in the openstack/tripleo-heat-templates 10.6.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/671314

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (master)

Reviewed: https://review.opendev.org/671314
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=c2977e3c00c08eca8d5f52f7fb9c61abdf0ef28f
Submitter: Zuul
Branch: master

commit c2977e3c00c08eca8d5f52f7fb9c61abdf0ef28f
Author: Oliver Walsh <email address hidden>
Date: Wed Jul 17 16:08:40 2019 +0100

    Add missing update_serial key to compute roles

    I missed this the changes from I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5 when
    rebasing I9f40a2a3561fcb1d1fec9d9c3c1f9cabaf02650c.

    Add the missing key to the roles and add some validation to catch this.

    Change-Id: I0f38df69777340ebbdc5c419f121524dbc74cad7
    Related-bug: #1831617
    Implements: blueprint nova-backend-per-role

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 11.1.0

This issue was fixed in the openstack/tripleo-heat-templates 11.1.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (stable/stein)

Related fix proposed to branch: stable/stein
Review: https://review.opendev.org/674857

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (stable/rocky)

Related fix proposed to branch: stable/rocky
Review: https://review.opendev.org/674860

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (stable/queens)

Related fix proposed to branch: stable/queens
Review: https://review.opendev.org/674862

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (stable/rocky)

Reviewed: https://review.opendev.org/674860
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=d9dcd8d51677c0435fc74ac7f40a544fa4ac41af
Submitter: Zuul
Branch: stable/rocky

commit d9dcd8d51677c0435fc74ac7f40a544fa4ac41af
Author: Oliver Walsh <email address hidden>
Date: Wed Jul 17 16:08:40 2019 +0100

    Add missing update_serial key to compute roles

    I missed this the changes from I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5 when
    rebasing I9f40a2a3561fcb1d1fec9d9c3c1f9cabaf02650c.

    Add the missing key to the roles and add some validation to catch this.

    Change-Id: I0f38df69777340ebbdc5c419f121524dbc74cad7
    Related-bug: #1831617
    Implements: blueprint nova-backend-per-role
    (cherry picked from commit c2977e3c00c08eca8d5f52f7fb9c61abdf0ef28f)
    (cherry picked from commit 7b72488d2ef12d99524f6926fca0efe310ff453e)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (stable/queens)

Reviewed: https://review.opendev.org/674862
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=3a69cc589e5b4280d259fc49ff7cf342dc9f8cac
Submitter: Zuul
Branch: stable/queens

commit 3a69cc589e5b4280d259fc49ff7cf342dc9f8cac
Author: Oliver Walsh <email address hidden>
Date: Wed Jul 17 16:08:40 2019 +0100

    Add missing update_serial key to compute roles

    I missed this the changes from I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5 when
    rebasing I9f40a2a3561fcb1d1fec9d9c3c1f9cabaf02650c.

    Add the missing key to the roles and add some validation to catch this.

    Change-Id: I0f38df69777340ebbdc5c419f121524dbc74cad7
    Related-bug: #1831617
    Implements: blueprint nova-backend-per-role
    (cherry picked from commit c2977e3c00c08eca8d5f52f7fb9c61abdf0ef28f)
    (cherry picked from commit 7b72488d2ef12d99524f6926fca0efe310ff453e)
    (cherry picked from commit d9dcd8d51677c0435fc74ac7f40a544fa4ac41af)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (stable/stein)

Reviewed: https://review.opendev.org/674857
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=7b72488d2ef12d99524f6926fca0efe310ff453e
Submitter: Zuul
Branch: stable/stein

commit 7b72488d2ef12d99524f6926fca0efe310ff453e
Author: Oliver Walsh <email address hidden>
Date: Wed Jul 17 16:08:40 2019 +0100

    Add missing update_serial key to compute roles

    I missed this the changes from I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5 when
    rebasing I9f40a2a3561fcb1d1fec9d9c3c1f9cabaf02650c.

    Add the missing key to the roles and add some validation to catch this.

    Change-Id: I0f38df69777340ebbdc5c419f121524dbc74cad7
    Related-bug: #1831617
    Implements: blueprint nova-backend-per-role
    (cherry picked from commit c2977e3c00c08eca8d5f52f7fb9c61abdf0ef28f)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 9.4.1

This issue was fixed in the openstack/tripleo-heat-templates 9.4.1 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 8.4.1

This issue was fixed in the openstack/tripleo-heat-templates 8.4.1 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.