Add retries in calling fuel-mirror due to instability of infra mirrors

Bug #1565857 reported by Alexandr Kostrikov on 2016-04-04
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
High
Alexandr Kostrikov
8.0.x
High
Vadim Rovachev
Mitaka
High
Alexandr Kostrikov

Bug Description

Detailed bug description:

Fuel-mirror is failing if some packages were not fetched and does not retry to download it after run.
It is expected that user will execute fuel-mirror until successful return code.

Our mirrors are intstable and sometimes return 404 even if file present[0]

Fuel-qa is calling it one time and does not expect that mirror can have problems.

We need to add retries to be able fuel-mirror download packages.

Expected results:
Fuel-mirror creates mirror even with unstable mirrors

Actual result:
Fuel-mirror fails after first attempt with
request failed: http://mirror.fuel-infra.org/mos-repos/ubuntu/9.0/pool/main/s/sphinx-argparse/python3-sphinx-argparse_0.1.15-1~u14.04+mos1_all.deb - 404(Not Found), retries left - 2.
Task failed: HTTP Error 404: Not Found

[0] https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.multirole/66/testReport/(root)/deploy_multiple_services_local_mirror/deploy_multiple_services_local_mirror/

Changed in fuel:
status: New → Confirmed

Fix proposed to branch: master
Review: https://review.openstack.org/301619

Changed in fuel:
status: Confirmed → In Progress
Changed in fuel:
milestone: 9.0 → 10.0

Reviewed: https://review.openstack.org/301619
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=8778c6b2ccb526cdcb39a71434222838d8891eef
Submitter: Jenkins
Branch: master

commit 8778c6b2ccb526cdcb39a71434222838d8891eef
Author: Alexandr Kostrikov <email address hidden>
Date: Tue Apr 5 15:20:56 2016 +0300

    Add retries on mirror creation

    Fuel-mirror can download files which it failed
    to download in previous attempts.
    Re-run will simply try to download absent files.

    Change-Id: I54e5bbd2bac4904f6b8c1e3ce8392e170e60a1f2
    Closes-bug: #1565857

Changed in fuel:
status: In Progress → Fix Committed

Reviewed: https://review.openstack.org/316062
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=3b1136591927f3082351b0682a3e9dc0ecca2257
Submitter: Jenkins
Branch: stable/mitaka

commit 3b1136591927f3082351b0682a3e9dc0ecca2257
Author: Alexandr Kostrikov <email address hidden>
Date: Tue Apr 5 15:20:56 2016 +0300

    Add retries on mirror creation

    Fuel-mirror can download files which it failed
    to download in previous attempts.
    Re-run will simply try to download absent files.

    Change-Id: I54e5bbd2bac4904f6b8c1e3ce8392e170e60a1f2
    Closes-bug: #1565857
    (cherry picked from commit 8778c6b2ccb526cdcb39a71434222838d8891eef)

There were no reproduces on swarm: https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.multirole/ at least from iso fuel-9.0-205

Changed in fuel:
status: Fix Committed → Fix Released
Vadim Rovachev (vrovachev) wrote :

Reproduced on 8.0 swarm tests.

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers