Update serial 1 timeouts badly on bigger environments

Bug #1831617 reported by Lukas Bezdicka
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Critical
Lukas Bezdicka

Bug Description

The default setting of serial: 1 will timeout on environments with 10+ nodes. We need to provide reasonable way to parallelize the update.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (master)

Reviewed: https://review.opendev.org/658814
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=a59a188a6b6ef7275d318d95b17d3a692065e16a
Submitter: Zuul
Branch: master

commit a59a188a6b6ef7275d318d95b17d3a692065e16a
Author: Mathieu Bultel <email address hidden>
Date: Mon May 13 15:25:57 2019 +0200

    Force ansible serial to 1 for the Controller

    By introducing update_serial variable we parallelize update
    execution on non-pacemaker enabled nodes. Custom role data users
    need to update their role files. By default we do serial 1 making
    sure nothing changes for users who didn't update their role data.

    Resolves: rhbz#1652057
    Closes-Bug: #1831617

    Change-Id: I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/stein)

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/664225

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/rocky)

Fix proposed to branch: stable/rocky
Review: https://review.opendev.org/664561

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/queens)

Fix proposed to branch: stable/queens
Review: https://review.opendev.org/664567

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/stein)

Reviewed: https://review.opendev.org/664225
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=0339c45d99550a60c8b1df40d9907169b1870053
Submitter: Zuul
Branch: stable/stein

commit 0339c45d99550a60c8b1df40d9907169b1870053
Author: Mathieu Bultel <email address hidden>
Date: Mon May 13 15:25:57 2019 +0200

    Force ansible serial to 1 for the Controller

    By introducing update_serial variable we parallelize update
    execution on non-pacemaker enabled nodes. Custom role data users
    need to update their role files. By default we do serial 1 making
    sure nothing changes for users who didn't update their role data.

    Resolves: rhbz#1652057
    Closes-Bug: #1831617

    Change-Id: I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5
    (cherry picked from commit a59a188a6b6ef7275d318d95b17d3a692065e16a)

tags: added: in-stable-stein
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/rocky)

Reviewed: https://review.opendev.org/664561
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=ab67b737498f511e731e2a2421359427505a9a54
Submitter: Zuul
Branch: stable/rocky

commit ab67b737498f511e731e2a2421359427505a9a54
Author: Mathieu Bultel <email address hidden>
Date: Mon May 13 15:25:57 2019 +0200

    Force ansible serial to 1 for the Controller

    By introducing update_serial variable we parallelize update
    execution on non-pacemaker enabled nodes. Custom role data users
    need to update their role files. By default we do serial 1 making
    sure nothing changes for users who didn't update their role data.

    Resolves: rhbz#1652057
    Closes-Bug: #1831617

    Change-Id: I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5
    (cherry picked from commit a59a188a6b6ef7275d318d95b17d3a692065e16a)

tags: added: in-stable-rocky
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/queens)

Reviewed: https://review.opendev.org/664567
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=cfbf68bdacd5c2af69cde6602da038621b3cca28
Submitter: Zuul
Branch: stable/queens

commit cfbf68bdacd5c2af69cde6602da038621b3cca28
Author: Mathieu Bultel <email address hidden>
Date: Mon May 13 15:25:57 2019 +0200

    Force ansible serial to 1 for the Controller

    By introducing update_serial variable we parallelize update
    execution on non-pacemaker enabled nodes. Custom role data users
    need to update their role files. By default we do serial 1 making
    sure nothing changes for users who didn't update their role data.

    Resolves: rhbz#1652057
    Closes-Bug: #1831617

    Change-Id: I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5
    (cherry picked from commit a59a188a6b6ef7275d318d95b17d3a692065e16a)

tags: added: in-stable-queens
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 10.6.0

This issue was fixed in the openstack/tripleo-heat-templates 10.6.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/671314

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (master)

Reviewed: https://review.opendev.org/671314
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=c2977e3c00c08eca8d5f52f7fb9c61abdf0ef28f
Submitter: Zuul
Branch: master

commit c2977e3c00c08eca8d5f52f7fb9c61abdf0ef28f
Author: Oliver Walsh <email address hidden>
Date: Wed Jul 17 16:08:40 2019 +0100

    Add missing update_serial key to compute roles

    I missed this the changes from I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5 when
    rebasing I9f40a2a3561fcb1d1fec9d9c3c1f9cabaf02650c.

    Add the missing key to the roles and add some validation to catch this.

    Change-Id: I0f38df69777340ebbdc5c419f121524dbc74cad7
    Related-bug: #1831617
    Implements: blueprint nova-backend-per-role

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 11.1.0

This issue was fixed in the openstack/tripleo-heat-templates 11.1.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (stable/stein)

Related fix proposed to branch: stable/stein
Review: https://review.opendev.org/674857

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (stable/rocky)

Related fix proposed to branch: stable/rocky
Review: https://review.opendev.org/674860

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (stable/queens)

Related fix proposed to branch: stable/queens
Review: https://review.opendev.org/674862

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (stable/rocky)

Reviewed: https://review.opendev.org/674860
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=d9dcd8d51677c0435fc74ac7f40a544fa4ac41af
Submitter: Zuul
Branch: stable/rocky

commit d9dcd8d51677c0435fc74ac7f40a544fa4ac41af
Author: Oliver Walsh <email address hidden>
Date: Wed Jul 17 16:08:40 2019 +0100

    Add missing update_serial key to compute roles

    I missed this the changes from I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5 when
    rebasing I9f40a2a3561fcb1d1fec9d9c3c1f9cabaf02650c.

    Add the missing key to the roles and add some validation to catch this.

    Change-Id: I0f38df69777340ebbdc5c419f121524dbc74cad7
    Related-bug: #1831617
    Implements: blueprint nova-backend-per-role
    (cherry picked from commit c2977e3c00c08eca8d5f52f7fb9c61abdf0ef28f)
    (cherry picked from commit 7b72488d2ef12d99524f6926fca0efe310ff453e)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (stable/queens)

Reviewed: https://review.opendev.org/674862
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=3a69cc589e5b4280d259fc49ff7cf342dc9f8cac
Submitter: Zuul
Branch: stable/queens

commit 3a69cc589e5b4280d259fc49ff7cf342dc9f8cac
Author: Oliver Walsh <email address hidden>
Date: Wed Jul 17 16:08:40 2019 +0100

    Add missing update_serial key to compute roles

    I missed this the changes from I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5 when
    rebasing I9f40a2a3561fcb1d1fec9d9c3c1f9cabaf02650c.

    Add the missing key to the roles and add some validation to catch this.

    Change-Id: I0f38df69777340ebbdc5c419f121524dbc74cad7
    Related-bug: #1831617
    Implements: blueprint nova-backend-per-role
    (cherry picked from commit c2977e3c00c08eca8d5f52f7fb9c61abdf0ef28f)
    (cherry picked from commit 7b72488d2ef12d99524f6926fca0efe310ff453e)
    (cherry picked from commit d9dcd8d51677c0435fc74ac7f40a544fa4ac41af)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (stable/stein)

Reviewed: https://review.opendev.org/674857
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=7b72488d2ef12d99524f6926fca0efe310ff453e
Submitter: Zuul
Branch: stable/stein

commit 7b72488d2ef12d99524f6926fca0efe310ff453e
Author: Oliver Walsh <email address hidden>
Date: Wed Jul 17 16:08:40 2019 +0100

    Add missing update_serial key to compute roles

    I missed this the changes from I4ee0110a6c2b9466d81e37e5df27f5f81a6eceb5 when
    rebasing I9f40a2a3561fcb1d1fec9d9c3c1f9cabaf02650c.

    Add the missing key to the roles and add some validation to catch this.

    Change-Id: I0f38df69777340ebbdc5c419f121524dbc74cad7
    Related-bug: #1831617
    Implements: blueprint nova-backend-per-role
    (cherry picked from commit c2977e3c00c08eca8d5f52f7fb9c61abdf0ef28f)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 9.4.1

This issue was fixed in the openstack/tripleo-heat-templates 9.4.1 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 8.4.1

This issue was fixed in the openstack/tripleo-heat-templates 8.4.1 release.

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers