Centos7 Check/Gate jobs failing with UnicodeDecodeError: 'ascii' codec can't decode byte 0xc5 in position 2: ordinal not in range(128)

[Sandeep Yadav]

Log Urls:-

Check/Gate jobs failing with below error:-

https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c87/743301/1/check/tripleo-ci-centos-7-undercloud-containers/c873e2c/job-output.txt

https://d29123bcde0971fd2051-b66a943d9312fbe3ccb3a2881f2cac57.ssl.cf2.rackcdn.com/743432/11/check/tripleo-ci-centos-7-containers-multinode-rocky/a2ba4d4/job-output.txt

Error Snippet:-
~~~
2020-07-29 06:01:05.493003 | primary | Traceback (most recent call last):
2020-07-29 06:01:05.493326 | primary | File "/usr/lib64/python2.7/runpy.py", line 162, in _run_module_as_main
2020-07-29 06:01:05.493584 | primary | "__main__", fname, loader, pkg_name)
2020-07-29 06:01:05.493862 | primary | File "/usr/lib64/python2.7/runpy.py", line 72, in _run_code
2020-07-29 06:01:05.493995 | primary | exec code in run_globals
2020-07-29 06:01:05.494364 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/__main__.py", line 26, in <module>
2020-07-29 06:01:05.494474 | primary | sys.exit(_main())
2020-07-29 06:01:05.494889 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_internal/cli/main.py", line 75, in main
2020-07-29 06:01:05.495038 | primary | return command.main(cmd_args)
2020-07-29 06:01:05.495453 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_internal/cli/base_command.py", line 121, in main
2020-07-29 06:01:05.495598 | primary | return self._main(args)
2020-07-29 06:01:05.495842 | primary | File "/usr/lib64/python2.7/contextlib.py", line 24, in __exit__
2020-07-29 06:01:05.495945 | primary | self.gen.next()
2020-07-29 06:01:05.496386 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_internal/cli/command_context.py", line 28, in main_context
2020-07-29 06:01:05.496459 | primary | yield
2020-07-29 06:01:05.496885 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/contextlib2.py", line 479, in __exit__
2020-07-29 06:01:05.497076 | primary | _reraise_with_existing_context(exc_details)
2020-07-29 06:01:05.497565 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/contextlib2.py", line 353, in _reraise_with_existing_context
2020-07-29 06:01:05.497771 | primary | exec("raise exc_type, exc_value, exc_tb")
2020-07-29 06:01:05.498211 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/contextlib2.py", line 468, in __exit__
2020-07-29 06:01:05.498335 | primary | if cb(*exc_details):
2020-07-29 06:01:05.498783 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/contextlib2.py", line 396, in _exit_wrapper
2020-07-29 06:01:05.498942 | primary | return cm_exit(cm, *exc_details)
2020-07-29 06:01:05.499182 | primary | File "/usr/lib64/python2.7/contextlib.py", line 24, in __exit__
2020-07-29 06:01:05.499283 | primary | self.gen.next()
2020-07-29 06:01:05.499757 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_internal/utils/temp_dir.py", line 46, in global_tempdir_manager
2020-07-29 06:01:05.499932 | primary | _tempdir_manager = old_tempdir_manager
2020-07-29 06:01:05.500331 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/contextlib2.py", line 479, in __exit__
2020-07-29 06:01:05.500548 | primary | _reraise_with_existing_context(exc_details)
2020-07-29 06:01:05.501020 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/contextlib2.py", line 353, in _reraise_with_existing_context
2020-07-29 06:01:05.501199 | primary | exec("raise exc_type, exc_value, exc_tb")
2020-07-29 06:01:05.501618 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/contextlib2.py", line 468, in __exit__
2020-07-29 06:01:05.501739 | primary | if cb(*exc_details):
2020-07-29 06:01:05.502156 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/contextlib2.py", line 396, in _exit_wrapper
2020-07-29 06:01:05.502308 | primary | return cm_exit(cm, *exc_details)
2020-07-29 06:01:05.502749 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_internal/utils/temp_dir.py", line 175, in __exit__
2020-07-29 06:01:05.502853 | primary | self.cleanup()
2020-07-29 06:01:05.503264 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_internal/utils/temp_dir.py", line 199, in cleanup
2020-07-29 06:01:05.503413 | primary | rmtree(ensure_text(self._path))
2020-07-29 06:01:05.503821 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/retrying.py", line 49, in wrapped_f
2020-07-29 06:01:05.504035 | primary | return Retrying(*dargs, **dkw).call(f, *args, **kw)
2020-07-29 06:01:05.504413 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/retrying.py", line 212, in call
2020-07-29 06:01:05.504543 | primary | raise attempt.get()
2020-07-29 06:01:05.504927 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/retrying.py", line 247, in get
2020-07-29 06:01:05.505152 | primary | six.reraise(self.value[0], self.value[1], self.value[2])
2020-07-29 06:01:05.505546 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_vendor/retrying.py", line 200, in call
2020-07-29 06:01:05.505789 | primary | attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
2020-07-29 06:01:05.506185 | primary | File "/home/zuul/workspace/.quickstart/lib/python2.7/site-packages/pip/_internal/utils/misc.py", line 139, in rmtree
2020-07-29 06:01:05.506326 | primary | onerror=rmtree_errorhandler)
2020-07-29 06:01:05.506564 | primary | File "/usr/lib64/python2.7/shutil.py", line 247, in rmtree
2020-07-29 06:01:05.506744 | primary | rmtree(fullname, ignore_errors, onerror)
2020-07-29 06:01:05.506967 | primary | File "/usr/lib64/python2.7/shutil.py", line 247, in rmtree
2020-07-29 06:01:05.507142 | primary | rmtree(fullname, ignore_errors, onerror)
2020-07-29 06:01:05.507365 | primary | File "/usr/lib64/python2.7/shutil.py", line 247, in rmtree
2020-07-29 06:01:05.507557 | primary | rmtree(fullname, ignore_errors, onerror)
2020-07-29 06:01:05.507784 | primary | File "/usr/lib64/python2.7/shutil.py", line 247, in rmtree
2020-07-29 06:01:05.507964 | primary | rmtree(fullname, ignore_errors, onerror)
2020-07-29 06:01:05.508242 | primary | File "/usr/lib64/python2.7/shutil.py", line 247, in rmtree
2020-07-29 06:01:05.508427 | primary | rmtree(fullname, ignore_errors, onerror)
2020-07-29 06:01:05.508669 | primary | File "/usr/lib64/python2.7/shutil.py", line 241, in rmtree
2020-07-29 06:01:05.508834 | primary | fullname = os.path.join(path, name)
2020-07-29 06:01:05.509139 | primary | File "/home/zuul/workspace/.quickstart/lib64/python2.7/posixpath.py", line 80, in join
2020-07-29 06:01:05.509241 | primary | path += '/' + b
2020-07-29 06:01:05.509589 | primary | UnicodeDecodeError: 'ascii' codec can't decode byte 0xc5 in position 2: ordinal not in range(128)
~~~

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/743691

[Sandeep Yadav (sandeepyadav93)]

Hi,

Latest pip-20.2(released today) break Centos7 jobs. The issue we seeing are seeing is in venv.

For temporary workaround we are trying to pin pip version to the last good version 20.1.1.

[OpenStack Infra (hudson-openstack)]

Change abandoned by Sagi Shnaidman (<email address hidden>) on branch: master
Review: https://review.opendev.org/743691

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/743691
Committed: https://git.openstack.org/cgit/openstack/tripleo-quickstart/commit/?id=031aa65b26263af24b3226c46d496953b11589fe
Submitter: Zuul
Branch: master

commit 031aa65b26263af24b3226c46d496953b11589fe
Author: Sandeep Yadav <email address hidden>
Date: Wed Jul 29 13:50:15 2020 +0530

    Pin pip to last good version - 20.1.1 for c7

    pip-20.2 break c7 jobs, details in bug[1]. With this patch we are
    pinning pip to last good version for Centos7.

    [1] https://bugs.launchpad.net/tripleo/+bug/1889357

    Change-Id: I5302e4ac3dfaeefa106cf308ab41e5b25f520df9
    Partial-Bug: #1889357

[yatin (yatinkarel)]

For reference upstream issue is https://github.com/pypa/pip/issues/8658

[Marios Andreou (marios-b)]

after the pin merged https://review.opendev.org/#/c/743691/5 looks like it is pretty green at [1] for example (the job reference in the description).

I will move fix released please move back if you disagree.

[1] https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-undercloud-containers