Master jobs failing during "Install deps from upper-constraints" / "Install openstack clients in venv" with stderr: ERROR: Cannot install oslo.concurrency>=3.26.0 because these package versions have conflicting dependencies.

[Sandeep Yadav]

Description:-

Master jobs including container build/ image build is failing during "Install deps from upper-constraints" step, Logs [1] and [2]

~~~
The conflict is caused by:
    The user requested oslo.concurrency>=3.26.0
    The user requested (constraint) oslo-concurrency===4.5.1

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

:stderr: ERROR: Cannot install oslo.concurrency>=3.26.0 because these package versions have conflicting dependencies.
~~~

OVB check job failing "Install openstack clients in venv" step, logs[3]

~~~
The conflict is caused by:
    python-heatclient 2.3.1 depends on oslo.serialization!=2.19.1 and >=2.18.0
    The user requested (constraint) oslo-serialization===4.1.1

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

:stderr: ERROR: Cannot install python-heatclient==2.3.1 because these package versions have conflicting dependencies.
~~~

[1] https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-9-buildimage-overcloud-hardened-uefi-full-master/665a999/job-output.txt
[2] https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-centos-9-push-master/f4beea6/job-output.txt
[3] https://logserver.rdoproject.org/97/841197/1/openstack-check/tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001/df87632/job-output.txt

[Sandeep Yadav (sandeepyadav93)]

Reproducer step:-

1) git clone https://github.com/openstack/tripleo-ansible.git
2) cd tripleo-ansible
3) python3 -m venv repr
4) source repr/bin/activate
5) pip install -r requirements.txt -c https://raw.githubusercontent.com/openstack/requirements/master/upper-constraints.txt -i http://mirror.regionone.vexxhost-nodepool-tripleo.rdoproject.org/pypi/simple --trusted-host mirror.regionone.vexxhost-nodepool-tripleo.rdoproject.org

If we remove --index-url from vexxhost in above command, we don't hit the issue.

Testing details in pastebin: https://paste.openstack.org/show/b8ummERM4gNZzFBxPXCk/

[Sandeep Yadav (sandeepyadav93)]

Resolved (tested manually)after clearing the vexx pypi mirror cache.

Waiting for line trigger to see iff all okay before closing the bug.

[Sandeep Yadav (sandeepyadav93)]

Green run for image build which was failing earlier.

https://review.rdoproject.org/zuul/build/c72e6f9a5b85406db0ee000a22f47915