container-puppet-SERVICE name is already in use

Bug #1856086 reported by Luke Short
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Luke Short

Bug Description

When deploying Train, sometimes container-puppet.py will not fully delete a container and then the deployment continues on. Later on, it fails when it tries to create a container that already exists.

Example error reported:
Error: error creating container storage: the container name \"container-puppet-neutron\" is already in use by \"34afb03989a595129c10986722bbc62650cfce2d26fbb5250adcb5eb4bccf6a0\".
You have to remove that container to be able to reuse that name.: that name is already in use"

For more details, see:
https://bugzilla.redhat.com/show_bug.cgi?id=1779165

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/698622

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (master)

Reviewed: https://review.opendev.org/698622
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=2f8964133883a5c795a88b521f2bb30818d448b2
Submitter: Zuul
Branch: master

commit 2f8964133883a5c795a88b521f2bb30818d448b2
Author: Rabi Mishra <email address hidden>
Date: Thu Dec 12 10:43:02 2019 +0530

    Try deleting container for failures too

    We currently retry when podman run returns with exit code 0 and 2.
    in container-puppet.py. It's possible that container storage bits
    are already created for failure. It's better to delete the container
    and it's storage before retrying.

    Change-Id: I4449c52b954c27e31553230cbdbd0949ae6413d6
    Related-Bug: #1856086

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to paunch (stable/train)

Related fix proposed to branch: stable/train
Review: https://review.opendev.org/700902

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (stable/train)

Related fix proposed to branch: stable/train
Review: https://review.opendev.org/701017

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-common (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/701039

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (stable/train)

Reviewed: https://review.opendev.org/701017
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=7148ebd21e899644644dc884d75db49c18d46bf7
Submitter: Zuul
Branch: stable/train

commit 7148ebd21e899644644dc884d75db49c18d46bf7
Author: Rabi Mishra <email address hidden>
Date: Thu Dec 12 10:43:02 2019 +0530

    Try deleting container for failures too

    We currently retry when podman run returns with exit code 0 and 2.
    in container-puppet.py. It's possible that container storage bits
    are already created for failure. It's better to delete the container
    and it's storage before retrying.

    Change-Id: I4449c52b954c27e31553230cbdbd0949ae6413d6
    Related-Bug: #1856086
    (cherry picked from commit 2f8964133883a5c795a88b521f2bb30818d448b2)

tags: added: in-stable-train
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-common (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/702919

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on tripleo-common (master)

Change abandoned by Luke Short (<email address hidden>) on branch: master
Review: https://review.opendev.org/701039
Reason: Prefer the non-Paunch alternative: https://review.opendev.org/#/c/702919/

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-common (stable/train)

Related fix proposed to branch: stable/train
Review: https://review.opendev.org/703482

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-common (master)

Reviewed: https://review.opendev.org/702919
Committed: https://git.openstack.org/cgit/openstack/tripleo-common/commit/?id=ef77f081a21e8483b143558dbf5ace5d909a368f
Submitter: Zuul
Branch: master

commit ef77f081a21e8483b143558dbf5ace5d909a368f
Author: Luke Short <email address hidden>
Date: Thu Jan 16 11:28:27 2020 -0500

    container_update: Retry removing containers.

    Change-Id: Ifd28fd60e4bc1218acc24381d13534c227f2877e
    Related-Bug: #1856086
    Signed-off-by: Luke Short <email address hidden>

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-common (stable/train)

Reviewed: https://review.opendev.org/703482
Committed: https://git.openstack.org/cgit/openstack/tripleo-common/commit/?id=64718a796125dd1197fb4c64ca5cd8db44b750be
Submitter: Zuul
Branch: stable/train

commit 64718a796125dd1197fb4c64ca5cd8db44b750be
Author: Luke Short <email address hidden>
Date: Thu Jan 16 11:28:27 2020 -0500

    container_update: Retry removing containers.

    Change-Id: Ifd28fd60e4bc1218acc24381d13534c227f2877e
    Related-Bug: #1856086
    Signed-off-by: Luke Short <email address hidden>
    (cherry picked from commit ef77f081a21e8483b143558dbf5ace5d909a368f)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-common (stable/stein)

Related fix proposed to branch: stable/stein
Review: https://review.opendev.org/704654

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-common (stable/rocky)

Related fix proposed to branch: stable/rocky
Review: https://review.opendev.org/704655

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-common (stable/queens)

Related fix proposed to branch: stable/queens
Review: https://review.opendev.org/704656

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-common (stable/stein)

Reviewed: https://review.opendev.org/704654
Committed: https://git.openstack.org/cgit/openstack/tripleo-common/commit/?id=179f6953cf4b9623fd7a5f8ada37888b3aad34ca
Submitter: Zuul
Branch: stable/stein

commit 179f6953cf4b9623fd7a5f8ada37888b3aad34ca
Author: Luke Short <email address hidden>
Date: Thu Jan 16 11:28:27 2020 -0500

    container_update: Retry removing containers.

    Change-Id: Ifd28fd60e4bc1218acc24381d13534c227f2877e
    Related-Bug: #1856086
    Signed-off-by: Luke Short <email address hidden>
    (cherry picked from commit ef77f081a21e8483b143558dbf5ace5d909a368f)
    (cherry picked from commit 64718a796125dd1197fb4c64ca5cd8db44b750be)

tags: added: in-stable-stein
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-common (stable/queens)

Reviewed: https://review.opendev.org/704656
Committed: https://git.openstack.org/cgit/openstack/tripleo-common/commit/?id=9ab61955a2155b3ad62fa657a31a02f5123dfe5c
Submitter: Zuul
Branch: stable/queens

commit 9ab61955a2155b3ad62fa657a31a02f5123dfe5c
Author: Luke Short <email address hidden>
Date: Thu Jan 16 11:28:27 2020 -0500

    container_update: Retry removing containers.

    Change-Id: Ifd28fd60e4bc1218acc24381d13534c227f2877e
    Related-Bug: #1856086
    Signed-off-by: Luke Short <email address hidden>
    (cherry picked from commit ef77f081a21e8483b143558dbf5ace5d909a368f)
    (cherry picked from commit 64718a796125dd1197fb4c64ca5cd8db44b750be)
    (cherry picked from commit 179f6953cf4b9623fd7a5f8ada37888b3aad34ca)
    (cherry picked from commit b91249bf7e60b2436f32496dd3df0f1e90c355fb)

tags: added: in-stable-queens
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-common (stable/rocky)

Reviewed: https://review.opendev.org/704655
Committed: https://git.openstack.org/cgit/openstack/tripleo-common/commit/?id=b91249bf7e60b2436f32496dd3df0f1e90c355fb
Submitter: Zuul
Branch: stable/rocky

commit b91249bf7e60b2436f32496dd3df0f1e90c355fb
Author: Luke Short <email address hidden>
Date: Thu Jan 16 11:28:27 2020 -0500

    container_update: Retry removing containers.

    Change-Id: Ifd28fd60e4bc1218acc24381d13534c227f2877e
    Related-Bug: #1856086
    Signed-off-by: Luke Short <email address hidden>
    (cherry picked from commit ef77f081a21e8483b143558dbf5ace5d909a368f)
    (cherry picked from commit 64718a796125dd1197fb4c64ca5cd8db44b750be)
    (cherry picked from commit 179f6953cf4b9623fd7a5f8ada37888b3aad34ca)

tags: added: in-stable-rocky
Luke Short (ekultails)
Changed in tripleo:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.