make iso fails because mirror miss some packages

[Daniele Pizzolli]

I am not able to build a iso with make iso, in master branch because
of missing packages in the mirror:

  # yumdownloader should fail if some packages are missed
  test `grep "No Match" /vagrant/fuel-main-dev/build/mirror/centos/yumdownloader.log | wc -l` = 0
  make: *** [/vagrant/fuel-main-dev/build/mirror/centos/yum.done] Error 1

a manual inspetcions reveals:

  grep "No Match" /vagrant/fuel-main-dev/build/mirror/centos/yumdownloader.log
  No Match for argument murano-api
  No Match for argument python-prettytable
  No Match for argument sahara-dashboard

the same problem (for different packages) is present for 5.1:

  grep "No Match" /vagrant/fuel-main-dev/build/mirror/centos/yumdownloader.log
  No Match for argument cloud-init
  No Match for argument cloud-utils
  No Match for argument hivex

A manual check on the mirror:

http://mirror.fuel-infra.org/fwm/6.0/centos/os/x86_64/Packages/
http://mirror.fuel-infra.org/fwm/5.1/centos/os/x86_64/Packages/

reveals that the packages are not present (at least at this time).

[Andrey Bubyr (abubyr)]

I have problems only with FUEL 6.0. For 5.1 there is no any missed packages, yumdownloader doesn't fail

[Daniele Pizzolli (daniele-pizzolli)]

Hello Andrey,
maybe do you add/use a custom mirror?

Right now at the default mirror:

http://mirror.fuel-infra.org/fwm/6.0/centos/os/x86_64/Packages/

the murano-* packages are:

murano-2014.2.rc1-fuel6.0.mira6.noarch.rpm 08-Oct-2014 09:22 554740
murano-apps-0.5.2-1.mira2.noarch.rpm 07-Oct-2014 14:15 397100
murano-dashboard-2014.2.rc1-fuel6.0.mira5.noarc..> 07-Oct-2014 17:23 518264

and there is no murano-api.

[Daniele Pizzolli (daniele-pizzolli)]

Sorry, I hit post too early and there is no way to amend a post.

Also in 5.1 there is no cloud-* package right now.

[Dmitry Burmistrov (dburmistrov)]

Hello Daniele.
We have no cloud-* packages at stable/5.1
Are you sure you use stable/5.1 branch and didn't change requirements-rpm.txt file?

[Daniele Pizzolli (daniele-pizzolli)]

Thanks Dmitry,

you guessed right. I only changed PRODUCT_VERSION:=5.1 in config.mk in
the master branch. So this report is valid only for 6.0/master. Sorry
for the noise.

[Dmitry Burmistrov (dburmistrov)]

Hello Daniele,

For about 6.0/master it seems to be yum/yumdownloader issue. As workaround you can try to update packages yum and yum-utils from tusty repos. It works for me.

[Daniele Pizzolli (daniele-pizzolli)]

Hello Dmitry ,
thanks, could you provide the exact command(s)?

From the make output is not easy to understand the differences
between: YUM_REPOS MIRROR_CENTOS EXTRA_RPM_REPOS

And I was not able to find any doc about that.

Best

[Dmitry Burmistrov (dburmistrov)]

Hello Daniele.
To update yum and yum-utils you should run:
wget https://launchpad.net/ubuntu/+archive/primary/+files/yum-utils_1.1.31-2_all.deb
wget https://launchpad.net/ubuntu/+archive/primary/+files/yum_3.4.3-2ubuntu1_all.deb
sudo apt-get install python-iniparse #needed for new yum-utils
sudo dpkg -i yum_3.4.3-2ubuntu1_all.deb
sudo dpkg -i yum-utils_1.1.31-2_all.deb

I don't know about YUM_REPOS.
MIRROR_CENTOS and EXTRA_RPM_REPOS used to specify rpm repositories where make would search needed packages.
MIRROR_CENTOS specifies upstream centos repository (e.g. http://vault.centos.org/centos/6.4 )
EXTRA_RPM_REPOS specifies additional rpm repositories

[Roman Vyalov (r0mikiam)]

Please add workaround https://bugs.launchpad.net/fuel/+bug/1381535/comments/8 to fuel-main/prepare-build-env.sh for Ubuntu precise

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/132958

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/132958
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=0d3f16254760999f90564c384f34fda8d6c82f51
Submitter: Jenkins
Branch: master

commit 0d3f16254760999f90564c384f34fda8d6c82f51
Author: Alexei Sheplyakov <email address hidden>
Date: Thu Nov 6 10:54:04 2014 +0300

    Install newer yum and yum-utils on precise

    Fixes ISO build failure. Apparently the version of yum (and yum-utils)
    shipped with precise is unable to handle OSCI repositories metadata.

    Change-Id: Icf1b4226b7b6a73da821cdc2fef60372b1b4c9a2
    Closes-bug: #1381535

[Thomas Goirand (thomas-goirand)]

FYI, I'm the package maintainer of Yum in Debian, and most likely, it has been sync from it in Ubuntu. If you need a new version of Yum, then I can probably try to upgrade the package. Please let me know if that's something I should work on.