overcloud deploy fails if any container image pull fails

Bug #1752036 reported by Steve Baker
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
paunch
Fix Released
High
Steve Baker
tripleo
Fix Released
High
Steve Baker

Bug Description

Deployment failure rates will be high when container images are pulled over the internet. Even when using the undercloud registry there have been reports of container image pulls failing leading to the deployment failing.

Having paunch do image pull retries with exponential backoff would significantly reduce the chance of this happening.

Changed in paunch:
status: New → Triaged
importance: Undecided → High
assignee: nobody → Steve Baker (steve-stevebaker)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to paunch (master)

Fix proposed to branch: master
Review: https://review.openstack.org/548230

Changed in tripleo:
status: Triaged → In Progress
Changed in tripleo:
milestone: queens-rc1 → rocky-1
tags: added: queens-backport-potential
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to paunch (master)

Reviewed: https://review.openstack.org/548230
Committed: https://git.openstack.org/cgit/openstack/paunch/commit/?id=5c7a785053b96cf1faf3eee5b673f90a71a2f056
Submitter: Zuul
Branch: master

commit 5c7a785053b96cf1faf3eee5b673f90a71a2f056
Author: Steve Baker <email address hidden>
Date: Tue Feb 27 11:17:04 2018 +0000

    Use tenacity to retry image pulls

    Image pulls often fail due to network or registry load. This change
    implements pull retries, up to 4 times with jittered exponential
    backoff.

    Closes-Bug #1752036

    Change-Id: I09c601f357200e734aa9d887c6ce6b4e53fc2589

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to paunch (stable/queens)

Fix proposed to branch: stable/queens
Review: https://review.openstack.org/550249

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to paunch (stable/queens)

Reviewed: https://review.openstack.org/550249
Committed: https://git.openstack.org/cgit/openstack/paunch/commit/?id=5697cbe9d946b6244f7e53f7c29e9c95ee4539b3
Submitter: Zuul
Branch: stable/queens

commit 5697cbe9d946b6244f7e53f7c29e9c95ee4539b3
Author: Steve Baker <email address hidden>
Date: Tue Feb 27 11:17:04 2018 +0000

    Use tenacity to retry image pulls

    Image pulls often fail due to network or registry load. This change
    implements pull retries, up to 4 times with jittered exponential
    backoff.

    Closes-Bug #1752036

    Change-Id: I09c601f357200e734aa9d887c6ce6b4e53fc2589
    (cherry picked from commit 5c7a785053b96cf1faf3eee5b673f90a71a2f056)

tags: added: in-stable-queens
Changed in paunch:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.