tripleo-ci-centos-7-content-provider is failing in gate/check downloading ansible-2.9.24.tar.gz

[Ronelle Landy]

tripleo-ci-centos-7-content-provider is failing in gate/check downloading ansible:

2021-07-26 18:07:51.394917 | primary | Processing /home/zuul/src/opendev.org/openstack/tripleo-upgrade
2021-07-26 18:07:53.197276 | primary | Collecting cmd2>=0.8.5
2021-07-26 18:07:53.208000 | primary | Downloading https://mirror-int.iad.rax.opendev.org/pypifiles/packages/e9/40/a71caa2aaff10c73612a7106e2d35f693e85b8cf6e37ab0774274bca3cf9/cmd2-0.8.9-py2.py3-none-any.whl (53 kB)
2021-07-26 18:07:53.465307 | primary | Collecting ansible<2.10,>=2.9
2021-07-26 18:07:53.476235 | primary | Downloading https://mirror-int.iad.rax.opendev.org/pypifiles/packages/d9/fd/a1420f0f6f2c2e3f045172acb1098b7932f601dab27093e3adcf659d532b/ansible-2.9.24.tar.gz (14.3 MB)
2021-07-26 18:07:59.487526 | primary | ERROR: Exception:
2021-07-26 18:07:59.487711 | primary | Traceback (most recent call last):
2021-07-26 18:07:59.487996 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/cli/base_command.py", line 173, in _main
2021-07-26 18:07:59.488108 | primary | status = self.run(options, args)
2021-07-26 18:07:59.488416 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/cli/req_command.py", line 203, in wrapper
2021-07-26 18:07:59.488530 | primary | return func(self, options, args)
2021-07-26 18:07:59.488805 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/commands/install.py", line 316, in run
2021-07-26 18:07:59.488951 | primary | reqs, check_supported_wheels=not options.target_dir
2021-07-26 18:07:59.489261 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 95, in resolve
2021-07-26 18:07:59.489452 | primary | collected.requirements, max_rounds=try_to_avoid_resolution_too_deep
2021-07-26 18:07:59.489745 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_vendor/resolvelib/resolvers.py", line 472, in resolve
2021-07-26 18:07:59.489915 | primary | state = resolution.resolve(requirements, max_rounds=max_rounds)
2021-07-26 18:07:59.490202 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_vendor/resolvelib/resolvers.py", line 341, in resolve
2021-07-26 18:07:59.490362 | primary | self._add_to_criteria(self.state.criteria, r, parent=None)
2021-07-26 18:07:59.490683 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_vendor/resolvelib/resolvers.py", line 172, in _add_to_criteria
2021-07-26 18:07:59.490787 | primary | if not criterion.candidates:
2021-07-26 18:07:59.491073 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_vendor/resolvelib/structs.py", line 151, in __bool__
2021-07-26 18:07:59.491179 | primary | return bool(self._sequence)
2021-07-26 18:07:59.491523 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 140, in __bool__
2021-07-26 18:07:59.491605 | primary | return any(self)
2021-07-26 18:07:59.491937 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 128, in <genexpr>
2021-07-26 18:07:59.492113 | primary | return (c for c in iterator if id(c) not in self._incompatible_ids)
2021-07-26 18:07:59.492470 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 32, in _iter_built
2021-07-26 18:07:59.492556 | primary | candidate = func()
2021-07-26 18:07:59.492920 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 209, in _make_candidate_from_link
2021-07-26 18:07:59.493000 | primary | version=version,
2021-07-26 18:07:59.493348 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 301, in __init__
2021-07-26 18:07:59.493455 | primary | version=version,
2021-07-26 18:07:59.493781 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 156, in __init__
2021-07-26 18:07:59.493881 | primary | self.dist = self._prepare()
2021-07-26 18:07:59.494198 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 227, in _prepare
2021-07-26 18:07:59.494312 | primary | dist = self._prepare_distribution()
2021-07-26 18:07:59.494669 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 306, in _prepare_distribution
2021-07-26 18:07:59.494781 | primary | self._ireq, parallel_builds=True
2021-07-26 18:07:59.495107 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 508, in prepare_linked_requirement
2021-07-26 18:07:59.495272 | primary | return self._prepare_linked_requirement(req, parallel_builds)
2021-07-26 18:07:59.495613 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 552, in _prepare_linked_requirement
2021-07-26 18:07:59.495712 | primary | self.download_dir, hashes
2021-07-26 18:07:59.496006 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 249, in unpack_url
2021-07-26 18:07:59.496151 | primary | unpack_file(file.path, location, file.content_type)
2021-07-26 18:07:59.496454 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/utils/unpacking.py", line 256, in unpack_file
2021-07-26 18:07:59.496563 | primary | untar_file(filename, location)
2021-07-26 18:07:59.496898 | primary | File "/home/zuul/workspace/.quickstart/lib/python3.6/site-packages/pip/_internal/utils/unpacking.py", line 226, in untar_file
2021-07-26 18:07:59.497016 | primary | with open(path, "wb") as destfp:
2021-07-26 18:07:59.497264 | primary | UnicodeEncodeError: 'ascii' codec can't encode character '\xe9' in position 112: ordinal not in range(128)

This failure happened on rax and other cloud providers:

https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-content-provider

starting on 07/26

[Ronelle Landy (rlandy)]

<mwhahaha> so there's a new pip version
<mwhahaha> 21.2.1
<mwhahaha> vs 21.1.3

 https://github.com/pypa/pip/issues/10214
 https://github.com/pypa/pip/issues/10211
 https://github.com/pypa/pip/issues/10151

Try pinning < 21.2 for c7

[Marios Andreou (marios-b)]

adding some links to fails for reference

        * https://aaca39517b0316f09d28-fe390436bababd65005a5c1c9412b532.ssl.cf2.rackcdn.com/798843/6/check/tripleo-ci-centos-7-content-provider/de85585/job-output.txt

        * https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_9d4/802339/2/check/tripleo-ci-centos-7-content-provider/9d4e2b5/job-output.txt

        * https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f38/801897/2/gate/tripleo-ci-centos-7-content-provider/f389422/job-output.txt

        * https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d94/802401/1/check/tripleo-ci-centos-7-content-provider/d94700f/job-output.txt

[Marios Andreou (marios-b)]

        * DNM: Set pip install version for c7
        * Change-Id: I61d928c0fb39494befc7d6ce882b8dc66e94244f
        * https://review.opendev.org/c/openstack/tripleo-quickstart/+/802395/

[Marios Andreou (marios-b)]

test is at https://review.opendev.org/c/openstack/tripleo-ansible/+/802401 (testing proposed fix at https://review.opendev.org/c/openstack/tripleo-quickstart/+/802395/

[Marios Andreou (marios-b)]

Sent note to the mailing list to try and avoid unnecessary recheck http://lists.openstack.org/pipermail/openstack-discuss/2021-July/023850.html

[Marios Andreou (marios-b)]

10:36 < ykarel> Tengu, marios|ruck we too hit it some of our jobs and resolved with https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/34687

# Workaround https://github.com/pypa/pip/issues/7667
export LANG=en_US.UTF8

i will try that in a sec thanks ykarel

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-quickstart/+/802431

[Marios Andreou (marios-b)]

Alternative and test per comment #6 there

Set LANG before pip install for related-bug https://review.opendev.org/c/openstack/tripleo-quickstart/+/802431
Testing for I6349254c02f33bc43220446d3208eb84b34c0daa https://review.opendev.org/c/openstack/tripleo-ansible/+/802432

[OpenStack Infra (hudson-openstack)]

Change abandoned by "Marios Andreou <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/tripleo-quickstart/+/802395
Reason: https://review.opendev.org/c/openstack/tripleo-quickstart/+/802431

[Marios Andreou (marios-b)]

test is green at https://review.opendev.org/c/openstack/tripleo-ansible/+/802432

we are going with https://review.opendev.org/c/openstack/tripleo-quickstart/+/802431

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-quickstart/+/802431
Committed: https://opendev.org/openstack/tripleo-quickstart/commit/c9bc2dd1df3ce7723f1907794beabada9dd04186
Submitter: "Zuul (22348)"
Branch: master

commit c9bc2dd1df3ce7723f1907794beabada9dd04186
Author: Marios Andreou <email address hidden>
Date: Tue Jul 27 10:51:27 2021 +0300

    Set LANG before pip install for related-bug

    Trying this as an alternative to [1]

    [1] https://review.opendev.org/c/openstack/tripleo-quickstart/+/802395
    Related-Bug: 1938079

    Change-Id: I6349254c02f33bc43220446d3208eb84b34c0daa