tune debootstrap wget options

Bug #1566382 reported by Matthew Mosesohn
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Matthew Mosesohn
Mitaka
Fix Released
High
Matthew Mosesohn

Bug Description

Detailed bug description:
 Sometimes Ubuntu mirrors are unstable, and it may be necessary to set slightly more aggressive wget parameters in order to retrieve packages.
Steps to reproduce:
 Deploy Fuel as normal
Expected results:
 Bootstrap/fuel-agent should build in <20 minutes
Actual result:
 Poor mirror performance can lead to image creation taking >45 mins
Reproducibility:
 Intermittent
Workaround:
 Wait and try again
Impact:
 N/A
Description of the environment:
 Operation system: <put your information here>
 Versions of components: <put your information here>
 Reference architecture: <put your information here>
 Network model: <put your information here>
 Related projects installed: <put your information here>
Additional information:

I suggest we add a /etc/wgetrc inside the chroot, rather than modifying debootstrap itself.
We should set the following settings:
timeout = 60 (default is 900. Applies to dns, connect, and read)
waitretry = 2
tries = 5
dot_style = mega (64k per dot, instead of 1k. Mega means smaller logs and less dot spam)
retry_connrefused = on (without this, no retries are attempted if refused HTTP request)

Changed in fuel:
milestone: none → 9.0
assignee: nobody → Fuel Python Team (fuel-python)
status: New → Confirmed
importance: Undecided → High
tags: added: area-python feature-image-based
Changed in fuel:
assignee: Fuel Python Team (fuel-python) → Georgy Kibardin (gkibardin)
Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (master)

Fix proposed to branch: master
Review: https://review.openstack.org/302725

Changed in fuel:
milestone: 9.0 → 10.0
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/307678

Changed in fuel:
assignee: Georgy Kibardin (gkibardin) → Matthew Mosesohn (raytrac3r)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-main (master)

Change abandoned by Georgy Kibardin (<email address hidden>) on branch: master
Review: https://review.openstack.org/302725

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/307678
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=3733a7b86d04d871f43bc19591ee73032662d416
Submitter: Jenkins
Branch: master

commit 3733a7b86d04d871f43bc19591ee73032662d416
Author: Matthew Mosesohn <email address hidden>
Date: Tue Apr 19 13:44:57 2016 +0400

    Robust wget config for building bootstrap

    More robust wget config can improve debootstrap performance.

    Change-Id: I5303a635a21d9fcd60dc2e02c36b635deafff631
    Closes-Bug: #1566382

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/319943

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/mitaka)

Reviewed: https://review.openstack.org/319943
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=1ebe6e4cd090080fa152f0e50344eb286115dc4f
Submitter: Jenkins
Branch: stable/mitaka

commit 1ebe6e4cd090080fa152f0e50344eb286115dc4f
Author: Matthew Mosesohn <email address hidden>
Date: Tue Apr 19 13:44:57 2016 +0400

    Robust wget config for building bootstrap

    More robust wget config can improve debootstrap performance.

    Change-Id: I5303a635a21d9fcd60dc2e02c36b635deafff631
    Closes-Bug: #1566382
    (cherry picked from commit 3733a7b86d04d871f43bc19591ee73032662d416)

tags: added: on-verification
Revision history for this message
Andrey Lavrentyev (alavrentyev) wrote :

Verified on 9.0-mos #458

[root@nailgun ~]# shotgun2 short-report
cat /etc/fuel_build_id:
 458
cat /etc/fuel_build_number:
 458
cat /etc/fuel_release:
 9.0
cat /etc/fuel_openstack_version:
 mitaka-9.0
rpm -qa | egrep 'fuel|astute|network-checker|nailgun|packetary|shotgun':
 fuel-release-9.0.0-1.mos6349.noarch
 fuel-misc-9.0.0-1.mos8449.noarch
 python-packetary-9.0.0-1.mos140.noarch
 fuel-bootstrap-cli-9.0.0-1.mos285.noarch
 fuel-migrate-9.0.0-1.mos8449.noarch
 rubygem-astute-9.0.0-1.mos750.noarch
 fuel-mirror-9.0.0-1.mos140.noarch
 shotgun-9.0.0-1.mos90.noarch
 fuel-openstack-metadata-9.0.0-1.mos8741.noarch
 fuel-notify-9.0.0-1.mos8449.noarch
 nailgun-mcagents-9.0.0-1.mos750.noarch
 python-fuelclient-9.0.0-1.mos325.noarch
 fuel-9.0.0-1.mos6349.noarch
 fuel-utils-9.0.0-1.mos8449.noarch
 fuel-setup-9.0.0-1.mos6349.noarch
 fuel-provisioning-scripts-9.0.0-1.mos8741.noarch
 fuel-library9.0-9.0.0-1.mos8449.noarch
 network-checker-9.0.0-1.mos74.x86_64
 fuel-agent-9.0.0-1.mos285.noarch
 fuel-ui-9.0.0-1.mos2717.noarch
 fuel-ostf-9.0.0-1.mos935.noarch
 fuelmenu-9.0.0-1.mos273.noarch
 fuel-nailgun-9.0.0-1.mos8741.noarch

tags: removed: on-verification
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.