gate: hpcloud build timeouts and failures

Bug #1491749 reported by Jesse Pretorius
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Ansible
Fix Released
Low
Jesse Pretorius
Kilo
Fix Released
Low
Jesse Pretorius
Trunk
Fix Released
Low
Jesse Pretorius

Bug Description

Apt updates/installs are the most common cause of build timeouts
within HP Cloud gate checks.

Currently we use the Rackspace Ubuntu mirror for all builds. In discussion with openstack-infra it's been noted that the Ubuntu archive mirror is most reliable for them.

Ideally we should determine a strategy that gives us reliability in both cloud providers, but also respects AIO builds by developers in that the configuration is not too gate specific for them.

Changed in openstack-ansible:
status: New → In Progress
Revision history for this message
Jesse Pretorius (jesse-pretorius) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (master)

Reviewed: https://review.openstack.org/218611
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=b940e7b7de75bb0842ee36330e69103a98bd3a14
Submitter: Jenkins
Branch: master

commit b940e7b7de75bb0842ee36330e69103a98bd3a14
Author: Jesse Pretorius <email address hidden>
Date: Sun Aug 30 01:16:20 2015 +0100

    Set the Ubuntu mirror used based on the environment

    Apt updates/installs are the most common cause of build timeouts
    within HP Cloud gate checks.

    This patch changes both the AIO and the gate check from using the
    Rackspace Ubuntu mirror for everything to:

    1) The AIO bootstrap will use whichever mirror is already defined
       on the host operating system.

    2) The gate check will use a known mirror which is defined per
       cloud provider. If the cloud provider is not known, or the
       script is being used outside of OpenStack-CI, then the gate
       checkwill fall back to using the AIO's mechanism.

    The idea is to make use of an apt mirror that is as close to the
    instance as possible in order to speed up apt updates and installs.

    Closes-Bug: #1491749
    Change-Id: Ia37100bc198b64b74f27ea98ec5956e7cf084883

Changed in openstack-ansible:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (kilo)

Fix proposed to branch: kilo
Review: https://review.openstack.org/221666

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (kilo)

Reviewed: https://review.openstack.org/221666
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=b3c8fdfeafc9ab0cf8df954456cd50819105c409
Submitter: Jenkins
Branch: kilo

commit b3c8fdfeafc9ab0cf8df954456cd50819105c409
Author: Jesse Pretorius <email address hidden>
Date: Sun Aug 30 01:16:20 2015 +0100

    Set the Ubuntu mirror used based on the environment

    Apt updates/installs are the most common cause of build timeouts
    within HP Cloud gate checks.

    This patch changes both the AIO and the gate check from using the
    Rackspace Ubuntu mirror for everything to:

    1) The AIO bootstrap will use whichever mirror is already defined
       on the host operating system.

    2) The gate check will use a known mirror which is defined per
       cloud provider. If the cloud provider is not known, or the
       script is being used outside of OpenStack-CI, then the gate
       checkwill fall back to using the AIO's mechanism.

    The idea is to make use of an apt mirror that is as close to the
    instance as possible in order to speed up apt updates and installs.

    Closes-Bug: #1491749
    Change-Id: Ia37100bc198b64b74f27ea98ec5956e7cf084883
    (cherry picked from commit b940e7b7de75bb0842ee36330e69103a98bd3a14)

Revision history for this message
Davanum Srinivas (DIMS) (dims-v) wrote : Fix included in openstack/openstack-ansible 11.2.11

This issue was fixed in the openstack/openstack-ansible 11.2.11 release.

Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/openstack-ansible 11.2.12

This issue was fixed in the openstack/openstack-ansible 11.2.12 release.

Revision history for this message
Davanum Srinivas (DIMS) (dims-v) wrote : Fix included in openstack/openstack-ansible 11.2.14

This issue was fixed in the openstack/openstack-ansible 11.2.14 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.