We need to use previous release mirror as a primary mirror during development cycle

[Alexandr Kostrikov]

Detailed bug description:
When we deploy with mirror http://mirror.fuel-infra.org/mos-repos/ubuntu/9.0/ we do not have all packages like aodh-listener because we have different packages in 9.0 [0] and in master [1].

There is a consistency problem with currently created mirror for a new release.
When we create mirror for new release - it is a snapshot of some state.
And when we try to use that mirror we get an error because iso is shipped with another mirror.

Steps to reproduce:
Run tests which use mirror during development cycle when version mirror is not ready [2] and [3]

Expected results:
Environment is deployed with needed packages

Actual result:
Packages are not found/wrong version.

Workaround:
There are number of workarounds like update repo settings, update fuel-mirror config.

Impact:
We can not track packages errors during development cycle.

Description of the environment:
Any fuel deployment.

Additional information:
We can update fuel-mirror or repository settings, but it would be hack on the product, which should not exist.

[0] http://mirror.fuel-infra.org/mos-repos/ubuntu/9.0/pool/main/a/
[1] http://mirror.seed-cz1.fuel-infra.org/mos-repos/ubuntu//snapshots/master-2016-03-11-124501/pool/main/a/
[2] https://bugs.launchpad.net/fuel/+bug/1552353
[3] https://bugs.launchpad.net/fuel/+bug/1556053

[Alexandr Kostrikov (akostrikov-mirantis)]

That should be fixed in 10.0 with data-driven deployment. We should test it with newly implemented deploy tool

[Sergey Kulanov (skulanov)]

@Alexandr, current development flow is just almost you've described, except:
`When we create mirror for new release - it is a snapshot of some state.`

Now this mirror is empty [1] and we should use "master" mirror [2] during development, this process is aligned during ISO build [3] in fuel-main. And the final mirror delivered within ISO, so the question is, what do you expect from the build team?

[1]. http://mirror.fuel-infra.org/mos-repos/ubuntu/10.0/
       http://mirror.fuel-infra.org/mos-repos/centos/mos10.0-centos7/

[2]. http://mirror.fuel-infra.org/mos-repos/ubuntu/master/
       http://mirror.fuel-infra.org/mos-repos/centos/mos-master-centos7/

[3]. http://mirror.fuel-infra.org/mos-repos/ubuntu/master/

[Alexandr Kostrikov (akostrikov-mirantis)]

Sergey, `Now this mirror is empty [1] and we should use "master" mirror [2] during` - is it possible to create daily snapshot of master to 10.0? So we can use in qa tests vanilla fuel, without need to swap master and 10/11/12 versions with our scripts?

[Artem Hrechanychenko (agrechanichenko)]

Hi!
Another feature that need correct fuel-release packet - is Separate Master Node deployment.
and fuel-menu CI gate.

May be need to create some job which will be built correct fuel-release packet for 10.0 until mos10.0 mirrors will be filled

[Alexandr Kostrikov (akostrikov-mirantis)]

Build team, it is safer to setup mirroring of master to version branches, because there are numerous parts of fuel qa depend on it.
So, we have one point of failure in mirrors instead of many in fuel-qa.

[Alexandr Kostrikov (akostrikov-mirantis)]

There are lack of resources to handle that problem correctly, so I closing it as "Won`t fix"

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/321353
Committed: https://git.openstack.org/cgit/openstack/fuel-main/commit/?id=e6b165748a8771a9f15d3416fc0cd05b6e40b63a
Submitter: Jenkins
Branch: master

commit e6b165748a8771a9f15d3416fc0cd05b6e40b63a
Author: Vladimir Kozhukalov <email address hidden>
Date: Thu May 26 08:15:17 2016 +0300

    Modify default repos for fuel and fuelmenu

    In fuel (nailgun) and fuelmenu we have hardcoded
    default repos which we should be able to change
    mostly for test purposes.

    Default ISO build flow uses fuel packages rebuild
    approach, which modifies ubuntu suit as well, eg:
       sync(mos-master) --> (iso)mos10.0 --> deploy(mos10.0)

    To use this feature one must use BUILD_PACKAGES=0,
    this flag turns off:
      * fuel packages building and
      * ubuntu suit update.
    so We consume the same suit as we use during
    debmirroring, eg:
       sync(mos-master) --> iso(mos-master) --> deploy(mos-master)

    DocImpact
    Change-Id: Ia3cefa7c87e35ecd9244a4026b86e772bf569ca9
    Closes-bug: #1556125

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/419563

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/419563
Committed: https://git.openstack.org/cgit/openstack/fuel-main/commit/?id=363fff0cf0a749614a4c29bd1036b1711586dad1
Submitter: Jenkins
Branch: stable/mitaka

commit 363fff0cf0a749614a4c29bd1036b1711586dad1
Author: Vladimir Kozhukalov <email address hidden>
Date: Thu May 26 08:15:17 2016 +0300

    Modify default repos for fuel and fuelmenu

    In fuel (nailgun) and fuelmenu we have hardcoded
    default repos which we should be able to change
    mostly for test purposes.

    Default ISO build flow uses fuel packages rebuild
    approach, which modifies ubuntu suit as well, eg:
       sync(mos-master) --> (iso)mos10.0 --> deploy(mos10.0)

    To use this feature one must use BUILD_PACKAGES=0,
    this flag turns off:
      * fuel packages building and
      * ubuntu suit update.
    so We consume the same suit as we use during
    debmirroring, eg:
       sync(mos-master) --> iso(mos-master) --> deploy(mos-master)

    DocImpact
    Change-Id: Ia3cefa7c87e35ecd9244a4026b86e772bf569ca9
    Closes-bug: #1556125
    (cherry picked from commit e6b165748a8771a9f15d3416fc0cd05b6e40b63a)