tripleo py36 ansible error: UnicodeEncodeError: 'ascii' codec can't encode character '\xe9' in position 112: ordinal not in range(128)

[wes hayutin]

https://zuul.openstack.org/builds?job_name=openstack-tox-py36&project=openstack%2Fpython-tripleoclient

2021-08-17 12:58:26.568390 | ubuntu-bionic | Downloading https://mirror.gra1.ovh.opendev.org/pypifiles/packages/dc/bb/989db37e94c3e162e9932b614cc856e2207677480379208c73115555f0bf/ansible-2.9.25.tar.gz (14.3 MB)
2021-08-17 12:58:26.568397 | ubuntu-bionic | ERROR: Exception:
2021-08-17 12:58:26.568404 | ubuntu-bionic | Traceback (most recent call last):
2021-08-17 12:58:26.568411 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/cli/base_command.py", line 173, in _main
2021-08-17 12:58:26.568418 | ubuntu-bionic | status = self.run(options, args)
2021-08-17 12:58:26.568432 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/cli/req_command.py", line 203, in wrapper
2021-08-17 12:58:26.568439 | ubuntu-bionic | return func(self, options, args)
2021-08-17 12:58:26.568446 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/commands/install.py", line 316, in run
2021-08-17 12:58:26.568453 | ubuntu-bionic | reqs, check_supported_wheels=not options.target_dir
2021-08-17 12:58:26.568460 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 95, in resolve
2021-08-17 12:58:26.568467 | ubuntu-bionic | collected.requirements, max_rounds=try_to_avoid_resolution_too_deep
2021-08-17 12:58:26.568474 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_vendor/resolvelib/resolvers.py", line 472, in resolve
2021-08-17 12:58:26.568481 | ubuntu-bionic | state = resolution.resolve(requirements, max_rounds=max_rounds)
2021-08-17 12:58:26.568488 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_vendor/resolvelib/resolvers.py", line 366, in resolve
2021-08-17 12:58:26.568495 | ubuntu-bionic | failure_causes = self._attempt_to_pin_criterion(name)
2021-08-17 12:58:26.568502 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_vendor/resolvelib/resolvers.py", line 212, in _attempt_to_pin_criterion
2021-08-17 12:58:26.568509 | ubuntu-bionic | criteria = self._get_updated_criteria(candidate)
2021-08-17 12:58:26.568515 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_vendor/resolvelib/resolvers.py", line 203, in _get_updated_criteria
2021-08-17 12:58:26.568522 | ubuntu-bionic | self._add_to_criteria(criteria, requirement, parent=candidate)
2021-08-17 12:58:26.568529 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_vendor/resolvelib/resolvers.py", line 172, in _add_to_criteria
2021-08-17 12:58:26.568536 | ubuntu-bionic | if not criterion.candidates:
2021-08-17 12:58:26.568544 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_vendor/resolvelib/structs.py", line 151, in __bool__
2021-08-17 12:58:26.568550 | ubuntu-bionic | return bool(self._sequence)
2021-08-17 12:58:26.568557 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 140, in __bool__
2021-08-17 12:58:26.568564 | ubuntu-bionic | return any(self)
2021-08-17 12:58:26.568571 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 128, in <genexpr>
2021-08-17 12:58:26.568578 | ubuntu-bionic | return (c for c in iterator if id(c) not in self._incompatible_ids)
2021-08-17 12:58:26.568585 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 32, in _iter_built
2021-08-17 12:58:26.568591 | ubuntu-bionic | candidate = func()
2021-08-17 12:58:26.568598 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 209, in _make_candidate_from_link
2021-08-17 12:58:26.568605 | ubuntu-bionic | version=version,
2021-08-17 12:58:26.568612 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 301, in __init__
2021-08-17 12:58:26.568630 | ubuntu-bionic | version=version,
2021-08-17 12:58:26.568636 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 156, in __init__
2021-08-17 12:58:26.568646 | ubuntu-bionic | self.dist = self._prepare()
2021-08-17 12:58:26.568653 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 227, in _prepare
2021-08-17 12:58:26.568659 | ubuntu-bionic | dist = self._prepare_distribution()
2021-08-17 12:58:26.568666 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 306, in _prepare_distribution
2021-08-17 12:58:26.568673 | ubuntu-bionic | self._ireq, parallel_builds=True
2021-08-17 12:58:26.568690 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 508, in prepare_linked_requirement
2021-08-17 12:58:26.568696 | ubuntu-bionic | return self._prepare_linked_requirement(req, parallel_builds)
2021-08-17 12:58:26.568703 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 552, in _prepare_linked_requirement
2021-08-17 12:58:26.568709 | ubuntu-bionic | self.download_dir, hashes
2021-08-17 12:58:26.568718 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 249, in unpack_url
2021-08-17 12:58:26.568735 | ubuntu-bionic | unpack_file(file.path, location, file.content_type)
2021-08-17 12:58:26.568742 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/utils/unpacking.py", line 256, in unpack_file
2021-08-17 12:58:26.568749 | ubuntu-bionic | untar_file(filename, location)
2021-08-17 12:58:26.568757 | ubuntu-bionic | File "/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/lib/python3.6/site-packages/pip/_internal/utils/unpacking.py", line 226, in untar_file
2021-08-17 12:58:26.568764 | ubuntu-bionic | with open(path, "wb") as destfp:
2021-08-17 12:58:26.568771 | ubuntu-bionic | UnicodeEncodeError: 'ascii' codec can't encode character '\xe9' in position 112: ordinal not in range(128)
2021-08-17 12:58:26.568779 | ubuntu-bionic | WARNING: You are using pip version 21.2.3; however, version 21.2.4 is available.
2021-08-17 12:58:26.568786 | ubuntu-bionic | You should consider upgrading via the '/home/zuul/src/opendev.org/openstack/python-tripleoclient/.tox/py36/bin/python -m pip install --upgrade pip' command.

[wes hayutin (weshayutin)]

first pass https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/804890

[wes hayutin (weshayutin)]

https://stackoverflow.com/questions/38882721/python3-unicodeencodeerror-ascii-codec-cant-encode-character-xfc

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/python-tripleoclient/+/804895

[wes hayutin (weshayutin)]

On second thought... we don't need/want py36 anymore on master.
We have py37 and we should ADD py39
https://review.opendev.org/c/openstack/python-tripleoclient/+/804895

[wes hayutin (weshayutin)]

https://review.opendev.org/c/openstack/python-tripleoclient/+/804897

[OpenStack Infra (hudson-openstack)]

Change abandoned by "wes hayutin <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/python-tripleoclient/+/804895
Reason: just move to 3.8 && 3.9 for now while we get 3.6 fixed

[Rabi Mishra (rabi)]

wallaby is also broken. Are we planning to drop py36 testing from wallaby like master[1] too.

[1] https://review.opendev.org/c/openstack/python-tripleoclient/+/804897

[wes hayutin (weshayutin)]

FIX is here https://review.opendev.org/c/openstack/python-tripleoclient/+/804887

[Jiri Podivin (jpodivin)]

Patches for the VF repos are under the encodingfix topic:
https://review.opendev.org/q/topic:%22encodingfix%22+(status:open%20OR%20status:merged)

[OpenStack Infra (hudson-openstack)]

Change abandoned by "wes hayutin <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/python-tripleoclient/+/804897
Reason: https://review.opendev.org/c/openstack/python-tripleoclient/+/804887

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/validations-common/+/805014
Committed: https://opendev.org/openstack/validations-common/commit/8dd362023d6b6219d8baaf50211944731c33acd8
Submitter: "Zuul (22348)"
Branch: master

commit 8dd362023d6b6219d8baaf50211944731c33acd8
Author: Jiri Podivin <email address hidden>
Date: Wed Aug 18 14:52:59 2021 +0200

    Setting language for the python3.6 tox environment

    By ensuring the locale is set to US utf-8 we can avoid
    encoding errors.

    Closes-Bug: #1940313

    Signed-off-by: Jiri Podivin <email address hidden>
    Change-Id: If117620aebbce07137386f82dfa0c21bd034a1b6

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/validations-libs/+/805013
Committed: https://opendev.org/openstack/validations-libs/commit/c8480cbf80a8a34b7ff5b3d7f535ff5afc942a75
Submitter: "Zuul (22348)"
Branch: master

commit c8480cbf80a8a34b7ff5b3d7f535ff5afc942a75
Author: Jiri Podivin <email address hidden>
Date: Wed Aug 18 09:53:54 2021 +0200

    Setting language for the python3.6 tox environment

    By ensuring the locale is set to US utf-8 we can avoid
    encoding errors.

    Closes-Bug: #1940313

    Signed-off-by: Jiri Podivin <email address hidden>
    Change-Id: I585a433e7480c22d52f402c1661194968ec66307

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/805119
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/580139d2f2f7ba6bdb40106e469e2adda7c73fea
Submitter: "Zuul (22348)"
Branch: master

commit 580139d2f2f7ba6bdb40106e469e2adda7c73fea
Author: Jiri Podivin <email address hidden>
Date: Thu Aug 19 08:11:35 2021 +0200

    Setting language for the python3.6 tox environment

    By ensuring the locale is set to US utf-8 we can avoid
    encoding errors.

    Closes-Bug: #1940313

    Signed-off-by: Jiri Podivin <email address hidden>
    Change-Id: I42b45b5f0ccb4746c83da20cf5be7ef3066a861a

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-validations/+/805114
Committed: https://opendev.org/openstack/tripleo-validations/commit/d0f300328605d181ddcaaccec35b8efb14487d40
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit d0f300328605d181ddcaaccec35b8efb14487d40
Author: Jiri Podivin <email address hidden>
Date: Wed Aug 18 14:54:43 2021 +0200

    Setting language for the python3.6 tox environment

    By ensuring the locale is set to US utf-8 we can avoid
    encoding errors.

    Closes-Bug: #1940313

    Signed-off-by: Jiri Podivin <email address hidden>
    Change-Id: I98916d3f120804e49d6b20ef86d28795f5dba7bf
    (cherry picked from commit 597847a7386916648e1009fdd6db54d30afad946)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-common/+/805117
Committed: https://opendev.org/openstack/tripleo-common/commit/1eef7a5d1b2c3117a80f6280ea31a7c1278e9c98
Submitter: "Zuul (22348)"
Branch: master

commit 1eef7a5d1b2c3117a80f6280ea31a7c1278e9c98
Author: Cédric Jeanneret <email address hidden>
Date: Thu Aug 19 07:54:46 2021 +0200

    Setting language for the python3.6 tox environment

    By ensuring the locale is set to US utf-8 we can avoid
    encoding errors.

    Change-Id: Idc620239c6d43de69f707cf210ce8e5059d6cf01
    Closes-Bug: #1940313

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-validations/+/805015
Committed: https://opendev.org/openstack/tripleo-validations/commit/d00a7f94ff385f4cf9a35a840892688214b38e33
Submitter: "Zuul (22348)"
Branch: master

commit d00a7f94ff385f4cf9a35a840892688214b38e33
Author: Jiri Podivin <email address hidden>
Date: Wed Aug 18 14:54:43 2021 +0200

    Setting language for the python3.6 tox environment

    By ensuring the locale is set to US utf-8 we can avoid
    encoding errors.

    Closes-Bug: #1940313

    Signed-off-by: Jiri Podivin <email address hidden>
    Change-Id: I98916d3f120804e49d6b20ef86d28795f5dba7bf

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-ansible/+/805116
Committed: https://opendev.org/openstack/tripleo-ansible/commit/9e3626a16c383fbdf3f80042a3c43cd2d9567eb9
Submitter: "Zuul (22348)"
Branch: master

commit 9e3626a16c383fbdf3f80042a3c43cd2d9567eb9
Author: Cédric Jeanneret <email address hidden>
Date: Thu Aug 19 07:53:08 2021 +0200

    Setting language for the python3.6 tox environment

    By ensuring the locale is set to US utf-8 we can avoid
    encoding errors.

    Change-Id: I4c8d000425b54ab2bc1275dc1fb74029eef87131
    Closes-Bug: #1940313

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-ansible 4.1.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-common 16.2.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-heat-templates 15.1.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-validations 15.1.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/validations-common 1.4.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/validations-libs 1.4.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-validations 14.3.0 release.