openstack-tox-linters failing with ModuleNotFoundError: No module named 'six'

[Marios Andreou]

at [1][2][3] the openstack-tox-linters job fails to import the six module trace like:

        2020-02-26 14:51:17.741847 | ubuntu-bionic | Installing collected packages: setuptools, setuptools-scm, setuptools-scm-git-archive, wheel, MarkupSafe, jinja2, PyYAML, pycparser, cffi, six, cryptography, ansible, ruamel.yaml.clib, ruamel.yaml
        2020-02-26 14:51:17.741856 | ubuntu-bionic | ERROR: Exception:
        2020-02-26 14:51:17.741865 | ubuntu-bionic | Traceback (most recent call last):
        ...
        2020-02-26 14:51:17.742146 | ubuntu-bionic | module = import_module(module_name)
        2020-02-26 14:51:17.742160 | ubuntu-bionic | File "/usr/lib/python3.6/importlib/__init__.py", line 126, in import_module
        2020-02-26 14:51:17.742171 | ubuntu-bionic | return _bootstrap._gcd_import(name[level:], package, level)
        2020-02-26 14:51:17.742180 | ubuntu-bionic | File "<frozen importlib._bootstrap>", line 994, in _gcd_import
        2020-02-26 14:51:17.742189 | ubuntu-bionic | File "<frozen importlib._bootstrap>", line 971, in _find_and_load
        2020-02-26 14:51:17.742199 | ubuntu-bionic | File "<frozen importlib._bootstrap>", line 941, in _find_and_load_unlocked
        2020-02-26 14:51:17.742208 | ubuntu-bionic | File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
        2020-02-26 14:51:17.742217 | ubuntu-bionic | File "<frozen importlib._bootstrap>", line 994, in _gcd_import
        2020-02-26 14:51:17.742226 | ubuntu-bionic | File "<frozen importlib._bootstrap>", line 971, in _find_and_load
        2020-02-26 14:51:17.742240 | ubuntu-bionic | File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
        2020-02-26 14:51:17.742262 | ubuntu-bionic | File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
        2020-02-26 14:51:17.742275 | ubuntu-bionic | File "<frozen importlib._bootstrap_external>", line 678, in exec_module
        2020-02-26 14:51:17.742294 | ubuntu-bionic | File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
        2020-02-26 14:51:17.742304 | ubuntu-bionic | File "/home/zuul/.cache/pre-commit/repo3np8p3cb/lib/ansiblelint/__init__.py", line 27, in <module>
        2020-02-26 14:51:17.742313 | ubuntu-bionic | import six
        2020-02-26 14:51:17.742322 | ubuntu-bionic | ModuleNotFoundError: No module named 'six'

Also seen in ci-config repo at [4]

[1] https://e8dabbe3d00824f512de-e25d1f8bae8601aed7ec89510f7333bc.ssl.cf2.rackcdn.com/709837/6/gate/openstack-tox-linters/ab853de/job-output.txt
[2] https://ef542942f55810504313-258e10c2898eead8733af072f71435b9.ssl.cf5.rackcdn.com/702931/6/check/openstack-tox-linters/b0af1eb/job-output.txt
[3] https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c38/709972/3/check/openstack-tox-linters/c38daab/job-output.txt
[4] https://logserver.rdoproject.org/99/24699/18/check/tox-linters/2ee3430/job-output.txt

[Marios Andreou (marios-b)]

14:34 <@zbr> weshay|ruck: look at https://hackmd.io/mJtmKdsKSqG4H2IweaCfPg -- should help fixing the issue

[Sorin Sbarnea (ssbarnea)]

The problem is specific to py27, so easiest way to avoid it is assure we use python3.

I already started working on a fix in ansible-lint itself at https://github.com/ansible/ansible-lint/pull/688 -- hopefully I will get it working today and get a hotfix released.

[Marios Andreou (marios-b)]

folks is anyone aware of any other fixes here ? I see from https://bugs.launchpad.net/tripleo/+bug/1865000/comments/2 Sorin points to https://github.com/ansible/ansible-lint/pull/688

but looking here now I see the job very green in both upstream and rdo like [1][2]

Discussing just now with Sorin on irc

15:54 < marios|ruck> zbr: wondering if something else fixed it?
15:54 <@zbr> that error appears on certain cases only version mix of setuptools&co
15:55 <@zbr> something that cannot be controlled by deps
15:55 <@zbr> because the issue is around the build-env, not the destination env.

[1] http://zuul.openstack.org/builds?job_name=openstack-tox-linters
[2] https://review.rdoproject.org/zuul/builds?job_name=tox-linters

[Marios Andreou (marios-b)]

maybe we can consider reducing the severity if this is no longer blocking at least Sorin wdyt? Not critical?

[Marios Andreou (marios-b)]

moving this to fix-released as per https://bugs.launchpad.net/tripleo/+bug/1865000/comments/3 please move back if you disagree thanks