Add retries in calling fuel-mirror due to instability of infra mirrors

Bug #1565857 reported by Alexandr Kostrikov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
High
Alexandr Kostrikov
8.0.x
New
High
Vadim Rovachev
Mitaka
Fix Released
High
Alexandr Kostrikov

Bug Description

Detailed bug description:

Fuel-mirror is failing if some packages were not fetched and does not retry to download it after run.
It is expected that user will execute fuel-mirror until successful return code.

Our mirrors are intstable and sometimes return 404 even if file present[0]

Fuel-qa is calling it one time and does not expect that mirror can have problems.

We need to add retries to be able fuel-mirror download packages.

Expected results:
Fuel-mirror creates mirror even with unstable mirrors

Actual result:
Fuel-mirror fails after first attempt with
request failed: http://mirror.fuel-infra.org/mos-repos/ubuntu/9.0/pool/main/s/sphinx-argparse/python3-sphinx-argparse_0.1.15-1~u14.04+mos1_all.deb - 404(Not Found), retries left - 2.
Task failed: HTTP Error 404: Not Found

[0] https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.multirole/66/testReport/(root)/deploy_multiple_services_local_mirror/deploy_multiple_services_local_mirror/

Tags: area-qa
Changed in fuel:
status: New → Confirmed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-qa (master)

Fix proposed to branch: master
Review: https://review.openstack.org/301619

Changed in fuel:
status: Confirmed → In Progress
Changed in fuel:
milestone: 9.0 → 10.0
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-qa (master)

Reviewed: https://review.openstack.org/301619
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=8778c6b2ccb526cdcb39a71434222838d8891eef
Submitter: Jenkins
Branch: master

commit 8778c6b2ccb526cdcb39a71434222838d8891eef
Author: Alexandr Kostrikov <email address hidden>
Date: Tue Apr 5 15:20:56 2016 +0300

    Add retries on mirror creation

    Fuel-mirror can download files which it failed
    to download in previous attempts.
    Re-run will simply try to download absent files.

    Change-Id: I54e5bbd2bac4904f6b8c1e3ce8392e170e60a1f2
    Closes-bug: #1565857

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-qa (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/316062

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-qa (stable/mitaka)

Reviewed: https://review.openstack.org/316062
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=3b1136591927f3082351b0682a3e9dc0ecca2257
Submitter: Jenkins
Branch: stable/mitaka

commit 3b1136591927f3082351b0682a3e9dc0ecca2257
Author: Alexandr Kostrikov <email address hidden>
Date: Tue Apr 5 15:20:56 2016 +0300

    Add retries on mirror creation

    Fuel-mirror can download files which it failed
    to download in previous attempts.
    Re-run will simply try to download absent files.

    Change-Id: I54e5bbd2bac4904f6b8c1e3ce8392e170e60a1f2
    Closes-bug: #1565857
    (cherry picked from commit 8778c6b2ccb526cdcb39a71434222838d8891eef)

Revision history for this message
Alexandr Kostrikov (akostrikov-mirantis) wrote :

There were no reproduces on swarm: https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.multirole/ at least from iso fuel-9.0-205

Changed in fuel:
status: Fix Committed → Fix Released
Revision history for this message
Vadim Rovachev (vrovachev) wrote :

Reproduced on 8.0 swarm tests.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.