Wrong setuptools version installed on stable branches gate

[Slawek Kaplonski]

On branches like Train or Stein sometimes wrong version of setuptools is installed and it causes error:

2020-10-02 04:39:27.457139 | controller | DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality.
2020-10-02 04:39:27.581885 | controller | Looking in indexes: https://mirror.bhs1.ovh.opendev.org/pypi/simple, https://mirror.bhs1.ovh.opendev.org/wheel/ubuntu-18.04-x86_64
2020-10-02 04:39:27.751342 | controller | Collecting pip!=8,<10
2020-10-02 04:39:27.754880 | controller | Downloading https://mirror.bhs1.ovh.opendev.org/pypifiles/packages/ac/95/a05b56bb975efa78d3557efa36acaf9cf5d2fd0ee0062060493687432e03/pip-9.0.3-py2.py3-none-any.whl (1.4 MB)
2020-10-02 04:39:28.264619 | controller | Collecting setuptools
2020-10-02 04:39:28.268304 | controller | Downloading https://mirror.bhs1.ovh.opendev.org/pypifiles/packages/7c/1b/9b68465658cda69f33c31c4dbd511ac5648835680ea8de87ce05c81f95bf/setuptools-50.3.0.zip (2.2 MB)
2020-10-02 04:39:28.422670 | controller | ERROR: Command errored out with exit status 1:
2020-10-02 04:39:28.422738 | controller | command: /usr/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-sJEK66/setuptools/setup.py'"'"'; __file__='"'"'/tmp/pip-install-sJEK66/setuptools/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-Leb6gP
2020-10-02 04:39:28.422763 | controller | cwd: /tmp/pip-install-sJEK66/setuptools/
2020-10-02 04:39:28.422786 | controller | Complete output (10 lines):
2020-10-02 04:39:28.422800 | controller | Traceback (most recent call last):
2020-10-02 04:39:28.422812 | controller | File "<string>", line 1, in <module>
2020-10-02 04:39:28.422824 | controller | File "setuptools/__init__.py", line 16, in <module>
2020-10-02 04:39:28.422836 | controller | import setuptools.version
2020-10-02 04:39:28.422848 | controller | File "setuptools/version.py", line 1, in <module>
2020-10-02 04:39:28.422860 | controller | import pkg_resources
2020-10-02 04:39:28.422872 | controller | File "pkg_resources/__init__.py", line 1365
2020-10-02 04:39:28.422884 | controller | raise SyntaxError(e) from e
2020-10-02 04:39:28.422896 | controller | ^
2020-10-02 04:39:28.422907 | controller | SyntaxError: invalid syntax

It happens on releases which still uses py27 and it seems that issue is only on OVH BHS1 mirrors.

[Rodolfo Alonso (rodolfo-alonso-hernandez)]

Hello:

There is a problem with the OVH pypi mirrors. From [1]:

(fungi) my guess is that if we start dissecting the apache cache on the ovh-bhs1 mirror we're going to find some cached copies of the setuptools version index which doesn't have requires-python metadata, indicating fastly served it from pypi's bandersnatch mirror fallback and not warehouse

This problem is not in the pypi servers or the projects (pip, setuptools), but in the server caches.

We should keep this bug open to track it.

I'll push a patch to devstack as a temporary workaround.

Regards.

[1]http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2020-10-02.log.html#t2020-10-02T12:26:00

[Rodolfo Alonso (rodolfo-alonso-hernandez)]

Related patch: https://review.opendev.org/#/c/755783/