undercloud upgrade fails package conflict nothing provides python3-cliff needed by python3-tripleoclient-18.0.1-0.20221005201652

[Marios Andreou]

At [1][2] (many examples at [3]) the tripleo-ci-centos-9-undercloud-upgrade fails during package installation (before deployment) with conflict:

 2022-10-12 04:13:31 | Warning: failed loading '/etc/yum.repos.d/delorean.repo', skipping.
 2022-10-12 04:13:32 | Last metadata expiration check: 0:00:11 ago on Wed 12 Oct 2022 04:13:21 AM UTC.
 2022-10-12 04:13:32 | Error:
 2022-10-12 04:13:32 | Problem: conflicting requests
 2022-10-12 04:13:32 | - nothing provides python3-cliff needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides validations-common needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides openstack-selinux needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides openstack-tripleo-validations needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides python3-heatclient >= 1.10.0 needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides python3-ironic-inspector-client >= 1.5.0 needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides python3-stevedore >= 1.20.0 needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides python3-ironicclient >= 2.3.0 needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides python3-openstackclient >= 5.2.0 needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides python3-openstacksdk >= 0.48.0 needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides python3-osc-lib >= 2.3.0 needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides python3-taskflow >= 4.5.0 needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | - nothing provides python3-validations-libs >= 1.5.0 needed by python3-tripleoclient-18.0.1-0.20221005201652.d9a542a.el9.noarch
 2022-10-12 04:13:32 | (try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)

This blocks gates - build history at [3]. This started 11 Oct 22 (see screenshot of builds attached here).

[1] https://e07ca6b0c705cfe8e332-9d06690275593a686ed77270ace0c4ac.ssl.cf5.rackcdn.com/859743/1/gate/tripleo-ci-centos-9-undercloud-upgrade/5755ab4/logs/undercloud/home/zuul/install_packages.sh.log
[2] https://1dd38363061c3613145b-83b0835fd19557deaa4055c10b617b58.ssl.cf2.rackcdn.com/854059/4/gate/tripleo-ci-centos-9-undercloud-upgrade/6ac09fe/logs/undercloud/home/zuul/install_packages.sh.log
[3] https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-undercloud-upgrade

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-ci/+/861047

[Marios Andreou (marios-b)]

problem is on our/tripleo-ci side

we updated emit release with zed support there https://review.opendev.org/c/openstack/tripleo-ci/+/860586 but did not update https://opendev.org/openstack/tripleo-ci/src/commit/be36acef68dd864d62142ed14e26191e2a4b33bf/roles/run-test/templates/oooq_common_functions.sh.j2#L22

The bug here is because there is no dlrn repo. From https://e07ca6b0c705cfe8e332-9d06690275593a686ed77270ace0c4ac.ssl.cf5.rackcdn.com/859743/1/gate/tripleo-ci-centos-9-undercloud-upgrade/5755ab4/logs/undercloud/etc/yum.repos.d/delorean.repo

        * <p>The requested URL /centos9-zed/current-tripleo/6c/bf/6cbf1ce854390a66bfd2a86ae866a6bc/delorean.repo was not found on this server.</p>

Because it is trying to fetch *zed* but that hash is a wallaby hash because we forgot to update that function

Hope https://review.opendev.org/c/openstack/tripleo-ci/+/861047 will help lets see

[Marios Andreou (marios-b)]

adding some more info

the fix described in comment #3 is correct (that https://review.opendev.org/c/openstack/tripleo-ci/+/861047/2/roles/run-test/templates/oooq_common_functions.sh.j2 )

however the job then failed because we also need to update the content providers (now zed, not wallaby). THis is included in the same patch with v2. The results from that are good, commented with links @ https://review.opendev.org/c/openstack/tripleo-ci/+/861047/2#message-421a99fce80e6b3ac15011439123269123da4092

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-ci/+/861047
Committed: https://opendev.org/openstack/tripleo-ci/commit/d281e8e2ccf917e972a119ec3ab800dcdaffe707
Submitter: "Zuul (22348)"
Branch: master

commit d281e8e2ccf917e972a119ec3ab800dcdaffe707
Author: Marios Andreou <email address hidden>
Date: Wed Oct 12 12:00:44 2022 +0300

    Adds zed into previous_release_from and fix master upgrades

    We added emit release support with [1] but forgot this case.
    It is the cause of related-bug. We also fix the master upgrade
    template since we now have zed as the previous release so
    replace wallaby with zed content provider in dependencies.

    [1] https://review.opendev.org/c/openstack/tripleo-ci/+/860586

    Related-Bug: 1992560
    Change-Id: I70a4ce03b950038dd0a9b383313bc7b505644329