make iso: missing/broken packages in requirements.rpm are silently ignored

[Alexei Sheplyakov]

echo zzzz >> requirements-rpm.txt
make -j4 repo-centos > repo-centos.log 2>&1; echo $?
0

There are some relevant error messages in build/mirror/centos/urls.list.out
No Match for argument #Django-1.3.4-1.el6
No Match for argument zzzz

Apparently yumdownloader raises the error only if the download list appears to be empty:

env \
                TMPDIR="/home/stack/stackforge/fuel-main/build/mirror/centos/dummy_installroot/cache" \
                TMP="/home/stack/stackforge/fuel-main/build/mirror/centos/dummy_installroot/cache" \
        yumdownloader -q --urls \
                --archlist=x86_64 \
                --installroot="/home/stack/stackforge/fuel-main/build/mirror/centos/dummy_installroot" \
                -c /home/stack/stackforge/fuel-main/build/mirror/centos/etc/yum.conf \
                --resolve \
zzzzz; echo "exit status: $?"
No Match for argument zzzzz
Nothing to download
exit status: 1

However if at least one package can be downloaded missing packages/dependencies are ignored:

env \
                TMPDIR="/home/stack/stackforge/fuel-main/build/mirror/centos/dummy_installroot/cache" \
                TMP="/home/stack/stackforge/fuel-main/build/mirror/centos/dummy_installroot/cache" \
        yumdownloader -q --urls \
                --archlist=x86_64 \
                --installroot="/home/stack/stackforge/fuel-main/build/mirror/centos/dummy_installroot" \
                -c /home/stack/stackforge/fuel-main/build/mirror/centos/etc/yum.conf \
                --resolve \
bash zzzzz; echo "exit status: $?"
No Match for argument zzzzzz
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/bash-4.1.2-15.3.mira1.x86_64.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/tzdata-2014e-1.el6.noarch.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/ncurses-libs-5.7-3.20090208.el6.x86_64.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/libattr-2.4.44-7.el6.x86_64.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/filesystem-2.4.30-3.el6.x86_64.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/libcap-2.16-5.5.el6.x86_64.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/libgcc-4.4.7-4.el6.x86_64.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/glibc-common-2.12-1.132.el6_5.2.x86_64.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/ncurses-base-5.7-3.20090208.el6.x86_64.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/setup-2.8.14-20.el6_4.1.noarch.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/glibc-2.12-1.132.el6_5.2.x86_64.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/basesystem-10.0-4.el6.noarch.rpm
http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64//Packages/nss-softokn-freebl-3.14.3-10.el6_5.x86_64.rpm
exit status: 0

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/185023

[Fuel Devops McRobotson (fuel-devops-robot)]

Related fix proposed to branch: master
Change author: Alexei Sheplyakov <email address hidden>
Review: https://review.fuel-infra.org/6896

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/6896
Submitter: Igor Shishkin <email address hidden>
Branch: master

Commit: 61c9dc13a12a083547468478c4e7cae4b7dd4705
Author: Alexei Sheplyakov <email address hidden>
Date: Fri May 22 14:06:07 2015

Add dmraid and parted repositories for CentOS 6

Both dmraid and parted make use of device-mapper-libs shared library.
The latter has been upgraded as a part of lvm2 upgrade, however neither
dmraid no parted has been rebuilt. As a result both dmraid and parted
are uninstallable. For now fuel-main was too permissive and accepted
such problematic packages which caused serious issues (silent removal
of kmod-openvswitch package from the fuel-infra RPM repo, etc).
Since dmraid and parted are in the @Base group excluding them is not
an option. Hence add repositories and relink them with the upgraded
device-mapper-libs.

Related-Bug: #1456459
Related-Bug: #1457382
Related-Bug: #1457871
Change-Id: Ieae7d1e50e67c618e845f93f4c27a8f420467849

[Fuel Devops McRobotson (fuel-devops-robot)]

Related fix proposed to branch: 6.1
Change author: Alexei Sheplyakov <email address hidden>
Review: https://review.fuel-infra.org/6909

[Fuel Devops McRobotson (fuel-devops-robot)]

Related fix proposed to branch: 6.1
Change author: Alexei Sheplyakov <email address hidden>
Review: https://review.fuel-infra.org/6912

[Mike Scherbakov (mihgen)]

Folks, I assume it does not directly affect HCF, so I'm tagging as non-release. I understand it's necessary to resolve asap anyway to prevent some type of bugs. Please remove tag if you think it's directly affect HCF.

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Alexei Sheplyakov <email address hidden> on branch: 6.1
Review: https://review.fuel-infra.org/6912
Reason: The updated device-mapper-libs has a compatible API and ABI

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Alexei Sheplyakov <email address hidden> on branch: 6.1
Review: https://review.fuel-infra.org/6909
Reason: The updated device-mapper-libs has a compatible ABI and API

[Alexei Sheplyakov (asheplyakov)]

The problem has been fixed in MOS 7.0 (patch: https://review.openstack.org/185023).
Let the sustaining team decide if the fix should be backported to MOS 6.1.

[Denis Meltsaykin (dmeltsaykin)]

 It was fixed in 7.0, closing newer milestones as Invalid

[Rodion Tikunov (rtikunov)]

doesn't fit into maintenance updates policy: no user impact