building a bootstrap image requires a reliable connection to the repository

Bug #1507649 reported by Fedor Tarasenko
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Medium
Alexander Gordeev

Bug Description

It's not possible to create ubuntu bootstrap image if apt-get does not retrieve package for the first time.
apt-get does not reconnect if connection fails, so log file is full of missed packages (different in each run).

I: Retrieving busybox-initramfs 1:1.21.0-1ubuntu1
W: Couldn't download package busybox-initramfs (ver 1:1.21.0-1ubuntu1 arch amd64)

As a workaround, proxy server & http_proxy env variable can be used.

Changed in fuel:
assignee: nobody → Alexei Sheplyakov (asheplyakov)
importance: Undecided → High
milestone: none → 8.0
Revision history for this message
Alexei Sheplyakov (asheplyakov) wrote :

> It's not possible to create ubuntu bootstrap image if apt-get does not retrieve package for the first time.

There's no reliable way to recover from a partial install. If something has failed it's safer (and in fact faster) to rebuild the image.

Revision history for this message
Alexei Sheplyakov (asheplyakov) wrote :

It's the Internet connection which should be fixed, not the image builder script.

Changed in fuel:
status: New → Invalid
summary: - "fuel-bootstrap-image-set ubuntu" fails
+ building a bootstrap image requires a reliable connection to repository
summary: - building a bootstrap image requires a reliable connection to repository
+ building a bootstrap image requires a reliable connection to the
+ repository
Revision history for this message
Alexander Gordeev (a-gordeev) wrote :

> There's no reliable way to recover from a partial install. If something has failed it's safer (and in fact faster) to rebuild the image.

both debootstrap and apt-get are downloading packages at first to process/install them later.

both of them store downloaded files in cache directory. So, it's quite easy and convenient to perform retry.

if we want to retry only on downloading, then both of them are capable of performing downloading only via `--download-only` option.

Revision history for this message
Fedor Tarasenko (ftarasenko) wrote :

Can you force apt-get to retry download for 2-3 times?
There is no problem with internet connection, it's possible that corporate firewall prohibits too many opened connections per second.

Revision history for this message
Alexander Gordeev (a-gordeev) wrote :

Fedor, sounds like you've run into the entirely another issue, please take a look at https://bugs.launchpad.net/fuel/+bug/1470468

Revision history for this message
Fedor Tarasenko (ftarasenko) wrote :

Alexander, the download speed is very fast (about 5 mins for all packages). So It does not look like another issue.
In my case, download misses 5-6 packages and script refuses to continue. Cause package cache is cleared, next run misses another 5-6 packages and so on until I tried to use proxy server.

Revision history for this message
Alexander Gordeev (a-gordeev) wrote :

Ok. So, the issue is still valid. However, it is not high priority. Lowering to medium then.

Changed in fuel:
status: Invalid → Confirmed
importance: High → Medium
tags: added: customer-found
Dmitry Pyzhov (dpyzhov)
tags: added: ubuntu-bootstrap
Dmitry Pyzhov (dpyzhov)
tags: removed: customer-found
tags: added: area-python
Dmitry Pyzhov (dpyzhov)
tags: added: feature-ubuntu-bootstrap
removed: ubuntu-bootstrap
Revision history for this message
Alexei Sheplyakov (asheplyakov) wrote :

I'm in ceph team since September 2015, and this "bug" (or rather a strange feature request) has nothing to do with ceph

Changed in fuel:
assignee: Alexei Sheplyakov (asheplyakov) → nobody
Revision history for this message
Alexander Gordeev (a-gordeev) wrote :

at the moment, for 8.0 ubuntu bootstrap image will be built by fuel-agent.

fuel-agent already has got retrying routine for handling such things.

according to the code, default value is 10 attempts
https://github.com/openstack/fuel-agent/blob/72f6c0ed2603596f414d30940b320f3d4b001017/fuel_agent/manager.py#L112-L116

seems that bug has been resolved.

Changed in fuel:
assignee: nobody → Alexander Gordeev (a-gordeev)
status: Confirmed → Fix Committed
Revision history for this message
Dmitry Kalashnik (dkalashnik) wrote :

Verified on ISO 367

Changed in fuel:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.