Wallaby -> Master Standalone upgrade job failing with Error: package python3-tripleoclient-16.2.1-0.20210603174615.c5b1e0c.el8.noarch requires openstack-heat-monolith >= 16.0.0

[Sandeep Yadav]

Description:

Wallaby -> Master Standalone upgrade job failing with Error: package python3-tripleoclient-16.2.1-0.20210603174615.c5b1e0c.el8.noarch requires openstack-heat-monolith >= 16.0.0

https://logserver.rdoproject.org/openstack-component-tripleo/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-upgrade-tripleo-master/7bd3b60/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz

~~~
2021-06-07 20:04:09 | Last metadata expiration check: 0:00:29 ago on Mon 07 Jun 2021 08:03:40 PM UTC.
2021-06-07 20:04:09 | Error:
2021-06-07 20:04:09 | Problem: package python3-tripleoclient-16.2.1-0.20210603174615.c5b1e0c.el8.noarch requires openstack-heat-monolith >= 16.0.0, but none of the providers can be installed
2021-06-07 20:04:09 | - conflicting requests
2021-06-07 20:04:09 | - package openstack-heat-monolith-1:16.0.1-0.20210425080922.7b9ffc5.el8.noarch is filtered out by exclude filtering
2021-06-07 20:04:09 | (try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)
~~~

Following repo is used:-

https://logserver.rdoproject.org/openstack-component-tripleo/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-upgrade-tripleo-master/7bd3b60/logs/undercloud/etc/yum.repos.d/tripleo-component.repo.txt.gz
~~~
[tripleo]
name=tripleo
baseurl=https://trunk.rdoproject.org/centos8-master/component/tripleo/component-ci-testing
gpgcheck=0
enabled=0
priority=1
~~~

https://trunk.rdoproject.org/centos8-master/component/tripleo/component-ci-testing/ consist openstack-heat-monolith-16.1.0-0.20210607110008.2c25e33.el8.noarch.rpm which is >= 16.0.0

~~~
openstack-heat-monolith-16.1.0-0.20210607110008.2c25e33.el8.noarch.rpm 2021-06-07 11:05 13K
~~~

[Sandeep Yadav (sandeepyadav93)]

We have a new rpm now with https://review.rdoproject.org/r/c/openstack/tripleoclient-distgit/+/34024.

Running a testproject to confirm if ^^ fixes the issue.

[Sandeep Yadav (sandeepyadav93)]

Testproject: https://review.rdoproject.org/r/c/testproject/+/28446/48/.zuul.yaml failed with same reason

https://logserver.rdoproject.org/46/28446/48/check/periodic-tripleo-ci-centos-8-standalone-upgrade-tripleo-master/8c9738c/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz

This is failing before standalone deploy, standalone deploy use W bits during deploy and then during upgrade it will start using Master bits.

 https://logserver.rdoproject.org/46/28446/48/check/periodic-tripleo-ci-centos-8-standalone-upgrade-tripleo-master/8c9738c/logs/undercloud/etc/yum.repos.d/delorean.repo.txt.gz

 May be https://review.rdoproject.org/r/c/openstack/tripleoclient-distgit/+/34024 needs a backport to wallaby, i have posted on review.

Marking as promotion blocker as its blocking Tripleo component.

[Ronelle Landy (rlandy)]

https://review.rdoproject.org/r/c/testproject/+/31586 testing here

[Sandeep Yadav (sandeepyadav93)]

Thanks Ronelle,

Patch: https://review.opendev.org/c/openstack/tripleo-quickstart/+/795395 seems to work as per testproject results: https://review.rdoproject.org/r/c/testproject/+/31586

Before this patch tripleo component was disabled in delorean.repo because of presence of tripleo-component.repo(even though it was disabled) and was failing at very early stage during run of install_packages.sh.

~~~
2021-06-07 20:04:09 | Error:
2021-06-07 20:04:09 | Problem: package python3-tripleoclient-16.2.1-0.20210603174615.c5b1e0c.el8.noarch requires openstack-heat-monolith >= 16.0.0, but none of the providers can be installed
2021-06-07 20:04:09 | - conflicting requests
2021-06-07 20:04:09 | - package openstack-heat-monolith-1:16.0.1-0.20210425080922.7b9ffc5.el8.noarch is filtered out by exclude filtering
2021-06-07 20:04:09 | (try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate package
~~~

Repos:-

https://logserver.rdoproject.org/46/28446/48/check/periodic-tripleo-ci-centos-8-standalone-upgrade-tripleo-master/8c9738c/logs/undercloud/etc/yum.repos.d/delorean.repo.txt.gz

~~~
[delorean-component-tripleo]
name=delorean-puppet-openstacklib-c40038800cb1457f186bfde8697d079315e2719f
baseurl=http://mirror.regionone.vexxhost-nodepool-tripleo.rdoproject.org:8080/rdo/centos8-wallaby/component/tripleo/c4/00/c40038800cb1457f186bfde8697d079315e2719f_12f720af
enabled=0 ---> disabled
gpgcheck=0
priority=20
~~~

https://logserver.rdoproject.org/46/28446/48/check/periodic-tripleo-ci-centos-8-standalone-upgrade-tripleo-master/8c9738c/logs/undercloud/etc/yum.repos.d/tripleo-component.repo.txt.gz
~~~
[tripleo]
name=tripleo
baseurl=https://trunk.rdoproject.org/centos8-master/component/tripleo/component-ci-testing
gpgcheck=0
enabled=0 --> disabled
priority=1
~~~

In testproject with depends-On https://review.opendev.org/c/openstack/tripleo-quickstart/+/795395:-

Upgrade job passes the earlier failing step(run of install_packages.sh.) and failed at later step during standalone upgrade.

https://logserver.rdoproject.org/86/31586/64/check/periodic-tripleo-ci-centos-8-standalone-upgrade-tripleo-master/c08a30d/logs/undercloud/home/zuul/standalone_upgrade.log.txt.gz
~~~
Upgrade failed with -standalone' is not an openstack command.
~~~

We have a bug for this: https://bugs.launchpad.net/tripleo/+bug/1930575 where we are awaiting for newer python-tripleoclient, But it looks like this is happening with newer tripleoclient as well, Marked https://bugs.launchpad.net/tripleo/+bug/1930575 as promotion blocker as its blocking tripleo component promotion.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-quickstart/+/795395
Committed: https://opendev.org/openstack/tripleo-quickstart/commit/141194c402da021975ffe6e93c4d5acfa966dfe8
Submitter: "Zuul (22348)"
Branch: master

commit 141194c402da021975ffe6e93c4d5acfa966dfe8
Author: Ronelle Landy <email address hidden>
Date: Tue Jun 8 14:25:53 2021 -0400

    Check component repo before disabling delorean repo

    The upgrade component jobs starts with the component
    repo disabled. As such do not diabled the delorean repo
    unless the component repo exists and is enabled.

    Closes-Bug: #1931207
    Change-Id: Ia32a46826aed6313f47021540287c52c4ca4e32e