tripleo

repo-setup fail: undercloud upgrade for ussuri fails on package dep python3-openstackclient >= 5.2.0

Bug #1905034 reported by wes hayutin on 2020-11-20

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	tripleo	Fix Released	Critical	yatin	tripleo wallaby-1

Bug Description

2020-11-20 01:58:18.916966 | primary | TASK [tripleo-upgrade : Update needed packages prior the undercloud upgrade] ***
2020-11-20 01:58:18.916977 | primary | Friday 20 November 2020 01:58:18 +0000 (0:00:01.350) 0:00:56.280 *******
2020-11-20 01:58:27.290752 | primary | fatal: [undercloud]: FAILED! => {
2020-11-20 01:58:27.290810 | primary | "changed": false,
2020-11-20 01:58:27.290824 | primary | "failures": [],
2020-11-20 01:58:27.291122 | primary | "rc": 1,
2020-11-20 01:58:27.291166 | primary | "results": []
2020-11-20 01:58:27.291189 | primary | }
2020-11-20 01:58:27.291209 | primary |
2020-11-20 01:58:27.291226 | primary | MSG:
2020-11-20 01:58:27.291243 | primary |
2020-11-20 01:58:27.291263 | primary | Depsolve Error occured:
2020-11-20 01:58:27.291280 | primary | Problem: cannot install the best update candidate for package python3-tripleoclient-12.3.2-0.20201118002446.4a5027a.el8.noarch
2020-11-20 01:58:27.291296 | primary | - nothing provides python3-openstackclient >= 5.2.0 needed by python3-tripleoclient-13.4.2-0.20201113043133.6e9fd9b.el8.noarch
2020-11-20 01:58:27.293100 | primary |

https://af8f541e885d71823a86-a17c91d89a0966538758fa02ae1f57d0.ssl.cf2.rackcdn.com/757821/8/check/tripleo-ci-centos-8-undercloud-upgrade-ussuri/9bce46b/job-output.txt

Tags:

Revision history for this message

wes hayutin (weshayutin) wrote on 2020-11-20:

https://af8f541e885d71823a86-a17c91d89a0966538758fa02ae1f57d0.ssl.cf2.rackcdn.com/757821/8/check/tripleo-ci-centos-8-undercloud-upgrade-ussuri/9bce46b/logs/undercloud/var/log/extra/all_available_packages.txt

python3-openstackclient is not available.. dlrn error here

python3-openstackclient-4.0.1-0.20200817052906.bff556c.el8.noarch
is installed

Revision history for this message

wes hayutin (weshayutin) wrote on 2020-11-20:

Looks like it's a blip.. or reposetup is failing to switch the repo correctly

https://2a9801d901a09acae4f4-62593741b623fd737fcd3b17f392bcb8.ssl.cf2.rackcdn.com/757821/8/check/tripleo-ci-centos-8-scenario003-standalone/2405389/logs/undercloud/var/log/extra/all_available_packages.txt

python3-openstackclient-0:5.2.0-0.20200604131927.c5719a1.el8.noarch

Revision history for this message

wes hayutin (weshayutin) wrote on 2020-11-20:

https://af8f541e885d71823a86-a17c91d89a0966538758fa02ae1f57d0.ssl.cf2.rackcdn.com/757821/8/check/tripleo-ci-centos-8-undercloud-upgrade-ussuri/9bce46b/logs/undercloud/etc/yum.repos.d/delorean.repo

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>404 Not Found</title>
</head><body>
<h1>Not Found</h1>
<p>The requested URL /centos8-ussuri/acac7a32b596342e0c8a8afd913ca6a9/delorean.repo was not found on this server.</p>
</body></html>

There you go :)

summary:

- undercloud upgrade for ussuri fails on package dep
+ repo-setup fail: undercloud upgrade for ussuri fails on package dep
python3-openstackclient >= 5.2.0

Revision history for this message

Marios Andreou (marios-b) wrote on 2020-11-20:

17:07 < ykarel> marios|ruck, weshay|ruck
https://ykarel.fedorapeople.org/0001-Handle-DLRN-hash-in-consumer-upgrade-jobs.patch should help in repo setup upgrade issue
17:08 < ykarel> can't submit, as gerrit down currently

Revision history for this message

Marios Andreou (marios-b) wrote on 2020-11-20:

adding some notes as I've been digging here but hopefully ykarel will post a patch per comment #4 once gerrit is back in service

the error we're seeing here is coming from the task in https://opendev.org/openstack/tripleo-upgrade/src/commit/6e4d20c22d30bb0a01e944c8a33fd02a52df98f1/tasks/common/undercloud_prerequisites.yaml#L11

However I don't think the bug is anything to do with the upgrades workflow here per se (especially I can't see any updates in that file in tripleo-upgrade). The error in https://af8f541e885d71823a86-a17c91d89a0966538758fa02ae1f57d0.ssl.cf2.rackcdn.com/757821/8/check/tripleo-ci-centos-8-undercloud-upgrade-ussuri/9bce46b/logs/undercloud/etc/yum.repos.d/delorean.repo is

<h1>Not Found</h1>
<p>The requested URL /centos8-ussuri/acac7a32b596342e0c8a8afd913ca6a9/delorean.repo was not found on this server.</p>

But the repo is there, albeit with the full prefix i.e. at https://trunk.rdoproject.org/centos8-ussuri/current-tripleo/ac/ac/acac7a32b596342e0c8a8afd913ca6a9/ (includes "/ac/ac/")

So hopefully it will be fixed by ykarel patch in comment 4

What is still not clear for me is why we have just started seeing this issue?

Revision history for this message

yatin (yatinkarel) wrote on 2020-11-20:

<< What is still not clear for me is why we have just started seeing this issue?
It's happening in upgrade jobs post switch to provider/consumer jobs, https://ykarel.fedorapeople.org/0001-Handle-DLRN-hash-in-consumer-upgrade-jobs.patch is the patch which should handle this case, if i will be around i can post the patch, else some one can put up the linked patch in gerrit and test in an affected patch.