fuel-bootstrap-image: support incomplete/broken mirrors

Bug #1486551 reported by Vitaly Parakhin on 2015-08-19
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
High
Vitaly Parakhin

Bug Description

At the moment fuel-bootstrap-image script requires a proper Ubuntu mirror
to build a bootstrap image, in particular it assumes

- the repo contians main, universe, multiverse, and restricted sections
- the repo contains updates and security suites

It would be nice to support broken repositories, i.e. such that all
packages reside in the `main' section (no matter what their license
and support status is), and make updates optional.

It should be noted that a bootstrap image built without `updates'
packages might be difficult to support due to obsolete/buggy software
(in particular Linux kernel).

Ideally nailgun data model and API should be extended with settings
and calls for managing bootstrap images, in particular:

- configuring which APT repositories should be used
- configuring extra packages to be added into the image
- forcibly rebuilding the image

Changed in fuel:
assignee: nobody → Alexei Sheplyakov (asheplyakov)
tags: added: customer-found
Alexei Sheplyakov (asheplyakov) wrote :

> The fuel-bootstrap-image script does not provide enough flexibility in case if customer wants to
> redefine the sources of upstream deb packages

Please explain what exactly is not flexible enough.

There's MIRROR_DISTRO variable to use a different Ubuntu/Debian mirror
There's EXTRA_DEB_REPOS to add extra repositories.

> Ideally, the repo settings should be obtained directly from nailgun.

Except that nailgun has no global repo settings (per cluster ones are not good enough for a bootstrap).

Changed in fuel:
status: New → Incomplete
assignee: Alexei Sheplyakov (asheplyakov) → Vitaly Parakhin (vparakhin)
Alexei Sheplyakov (asheplyakov) wrote :

The problem description is way too sloppy, marking bug as Incomplete and reassigning to the reporter.

Changed in fuel:
milestone: 7.0 → 8.0
Alexei Sheplyakov (asheplyakov) wrote :

> Ideally, the repo settings should be obtained directly from nailgun.

Besides extending nailgun data model and API to allow bootstrap image(s) customization sounds like a feature request

Vitaly Parakhin (vparakhin) wrote :

The upstream mirror format defined by the script is rigid, and does not cover all possible use-cases:

- customer could use own mirror with ${DISTRO_RELEASE} and ${DISTRO_RELEASE}-security suits only
- customer could use own mirror with suites that have the "main" component only
etc

Changed in fuel:
status: Incomplete → New
assignee: Vitaly Parakhin (vparakhin) → Alexei Sheplyakov (asheplyakov)
milestone: 8.0 → 7.0
Alexei Sheplyakov (asheplyakov) wrote :

> - customer could use own mirror with suites that have the "main" component only

That's not going to work since some packages necessary for bootstrap are in universe (ruby libs) and multiverse (linux-firmware-nonfree)

> - customer could use own mirror with ${DISTRO_RELEASE} and ${DISTRO_RELEASE}-security suits only

Such a crippled bootstrap would contain an obsolete software (in particular kernel) and thus will be difficult to support.

Alexei Sheplyakov (asheplyakov) wrote :

Using an incomplete/broken repository is a feature request, adjusting the Importance accordingly.

Changed in fuel:
importance: High → Wishlist
milestone: 7.0 → next
assignee: Alexei Sheplyakov (asheplyakov) → nobody
summary: - Custom upstream mirror configuration is not supported by the Fuel
- bootstrap image build script
+ fuel-bootstrap-image: support incomplete/broken mirrors
description: updated
Changed in fuel:
assignee: nobody → Fuel build team (fuel-build)
Changed in fuel:
assignee: Fuel build team (fuel-build) → Vladimir Kozhukalov (kozhukalov)
Roman Vyalov (r0mikiam) on 2015-08-24
Changed in fuel:
milestone: next → 7.0
importance: Wishlist → High
status: New → In Progress
Roman Vyalov (r0mikiam) on 2015-08-27
Changed in fuel:
milestone: 7.0 → 8.0
status: In Progress → Triaged

In the documentation we need to have the information that in order to build ubuntu based bootstrap image, master node must have internet access (or at least access to full ubuntu mirror and full MOS mirror).

Fix proposed to branch: master
Review: https://review.openstack.org/221297

Changed in fuel:
assignee: Vladimir Kozhukalov (kozhukalov) → Alexander Adamov (aadamov)
status: Triaged → In Progress

Reviewed: https://review.openstack.org/221297
Committed: https://git.openstack.org/cgit/stackforge/fuel-docs/commit/?id=361b660c65c6c38a1c0443fff36d745ecba02337
Submitter: Jenkins
Branch: master

commit 361b660c65c6c38a1c0443fff36d745ecba02337
Author: Alexander Adamov <email address hidden>
Date: Tue Sep 8 16:15:32 2015 +0300

    [RN 7.0]fuel-bootstrap-image: support incomplete/broken mirrors

    Adds information that the master node must have an access to
    the Internet access or access to full Ubuntu and MOS mirrors.

    Change-Id: I28a3327deec6d1ab216dc3d45554c88811907885
    Closes-Bug: #1486551

Changed in fuel:
status: In Progress → Fix Committed

Not all of the patches are merged

Igor Shishkin (teran) on 2015-10-08
no longer affects: fuel/7.0.x
Dmitry Pyzhov (dpyzhov) on 2015-10-09
no longer affects: fuel/8.0.x
Dmitry Pyzhov (dpyzhov) wrote :

I'm not sure if fuel-build team is the right assignee. But docs team is definitely not the right choice.

Changed in fuel:
assignee: Alexander Adamov (aadamov) → Fuel build team (fuel-build)
Roman Vyalov (r0mikiam) on 2015-10-15
Changed in fuel:
status: In Progress → Triaged
Dmitry Borodaenko (angdraug) wrote :

Build team is definitely not the right assignee, this has to be fixed in fuel-bootstrap-image.

Changed in fuel:
assignee: Fuel build team (fuel-build) → nobody
Dmitry Pyzhov (dpyzhov) on 2015-10-16
Changed in fuel:
assignee: nobody → Fuel Library Team (fuel-library)
tags: added: feature
Roman Vyalov (r0mikiam) wrote :

this bug also related to the documentation: comment #9 https://bugs.launchpad.net/fuel/+bug/1486551/comments/9

Dmitry Pyzhov (dpyzhov) on 2015-10-22
tags: added: area-library

Change abandoned by Vladimir Kozhukalov (<email address hidden>) on branch: master
Review: https://review.openstack.org/216285

Ivan Ponomarev (ivanzipfer) wrote :

This functionality was moved to fuel-agent, please recheck this bug

Changed in fuel:
status: Triaged → Incomplete
assignee: Fuel Library Team (fuel-library) → Vitaly Parakhin (vparakhin)
tags: added: area-python
removed: area-library
Vitaly Parakhin (vparakhin) wrote :

Respective fix to fuel-agent was merged in terms of https://bugs.launchpad.net/fuel/+bug/1525133 so closing this one as completed.

Changed in fuel:
status: Incomplete → Fix Released

Change abandoned by Vladimir Kozhukalov (<email address hidden>) on branch: master
Review: https://review.openstack.org/216280

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers