openstack-tox-* are failing in opendev with "env name py38 conflicting with base python python3"

[Ronelle Landy]

openstack-tox-* are failing in opendev with the following error:

2023-01-05 19:16:15.170283 | ubuntu-focal | .pkg: 425 D accepted PythonInfo(spec=CPython3.8.10.final.0-64, system=/usr/bin/python3.8, exe=/home/zuul/.local/tox/bin/python3, platform=linux, version='3.8.10 (default, Nov 14 2022, 12:59:47) \n[GCC 9.4.0]', encoding_fs_io=utf-8-utf-8) [virtualenv/discovery/builtin.py:65]
2023-01-05 19:16:15.173218 | ubuntu-focal | Traceback (most recent call last):
2023-01-05 19:16:15.173263 | ubuntu-focal | File "/home/zuul/.local/tox/bin/tox", line 8, in <module>
2023-01-05 19:16:15.173272 | ubuntu-focal | sys.exit(run())
2023-01-05 19:16:15.173279 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/run.py", line 19, in run
2023-01-05 19:16:15.173286 | ubuntu-focal | result = main(sys.argv[1:] if args is None else args)
2023-01-05 19:16:15.173292 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/run.py", line 45, in main
2023-01-05 19:16:15.173299 | ubuntu-focal | result = handler(state)
2023-01-05 19:16:15.173306 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/session/cmd/legacy.py", line 111, in legacy
2023-01-05 19:16:15.173313 | ubuntu-focal | return run_sequential(state)
2023-01-05 19:16:15.173319 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/session/cmd/run/sequential.py", line 22, in run_sequential
2023-01-05 19:16:15.173325 | ubuntu-focal | return execute(state, max_workers=1, has_spinner=False, live=True)
2023-01-05 19:16:15.173331 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/session/cmd/run/common.py", line 213, in execute
2023-01-05 19:16:15.173353 | ubuntu-focal | state.envs.ensure_only_run_env_is_active()
2023-01-05 19:16:15.173366 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/session/env_select.py", line 365, in ensure_only_run_env_is_active
2023-01-05 19:16:15.173373 | ubuntu-focal | envs, active = self._defined_envs, self._env_name_to_active()
2023-01-05 19:16:15.173379 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/session/env_select.py", line 225, in _defined_envs
2023-01-05 19:16:15.173385 | ubuntu-focal | raise failed[next(iter(failed_to_create))]
2023-01-05 19:16:15.173392 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/session/env_select.py", line 202, in _defined_envs
2023-01-05 19:16:15.173401 | ubuntu-focal | run_env.package_env = self._build_pkg_env(pkg_name_type, name, env_name_to_active)
2023-01-05 19:16:15.173421 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/session/env_select.py", line 270, in _build_pkg_env
2023-01-05 19:16:15.173425 | ubuntu-focal | name_type = next(child_package_envs)
2023-01-05 19:16:15.173430 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/tox_env/python/virtual_env/package/pyproject.py", line 141, in register_run_env
2023-01-05 19:16:15.173435 | ubuntu-focal | yield from super().register_run_env(run_env)
2023-01-05 19:16:15.173439 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/tox_env/python/package.py", line 110, in register_run_env
2023-01-05 19:16:15.173444 | ubuntu-focal | pkg_env = run_env.conf["wheel_build_env"]
2023-01-05 19:16:15.173448 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/config/sets.py", line 114, in __getitem__
2023-01-05 19:16:15.173454 | ubuntu-focal | return self.load(item)
2023-01-05 19:16:15.173459 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/config/sets.py", line 125, in load
2023-01-05 19:16:15.173463 | ubuntu-focal | return config_definition.__call__(self._conf, self.loaders, ConfigLoadArgs(chain, self.name, self.env_name))
2023-01-05 19:16:15.173467 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/config/of_type.py", line 110, in __call__
2023-01-05 19:16:15.173472 | ubuntu-focal | value = self.default(conf, args.env_name) if callable(self.default) else self.default
2023-01-05 19:16:15.173476 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/tox_env/python/package.py", line 90, in default_wheel_tag
2023-01-05 19:16:15.173481 | ubuntu-focal | run_py = cast(Python, run_env).base_python
2023-01-05 19:16:15.173487 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/tox_env/python/api.py", line 235, in base_python
2023-01-05 19:16:15.173493 | ubuntu-focal | base_pythons: list[str] = self.conf["base_python"]
2023-01-05 19:16:15.173498 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/config/sets.py", line 114, in __getitem__
2023-01-05 19:16:15.173502 | ubuntu-focal | return self.load(item)
2023-01-05 19:16:15.173507 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/config/sets.py", line 125, in load
2023-01-05 19:16:15.173511 | ubuntu-focal | return config_definition.__call__(self._conf, self.loaders, ConfigLoadArgs(chain, self.name, self.env_name))
2023-01-05 19:16:15.173515 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/config/of_type.py", line 112, in __call__
2023-01-05 19:16:15.173519 | ubuntu-focal | value = self.post_process(value)
2023-01-05 19:16:15.173524 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/tox_env/python/api.py", line 60, in validate_base_python
2023-01-05 19:16:15.173528 | ubuntu-focal | return self._validate_base_python(self.name, value, self.core["ignore_base_python_conflict"])
2023-01-05 19:16:15.173532 | ubuntu-focal | File "/home/zuul/.local/tox/lib/python3.8/site-packages/tox/tox_env/python/api.py", line 162, in _validate_base_python
2023-01-05 19:16:15.173536 | ubuntu-focal | raise Fail(msg)
2023-01-05 19:16:15.173541 | ubuntu-focal | tox.tox_env.errors.Fail: env name py38 conflicting with base python python3

Example logs:

https://7c830b912b5951e3da88-240d4aa44573f96d2050363ab0d496a6.ssl.cf5.rackcdn.com/868663/2/check/openstack-tox-py38/d904fda/job-output.txt

https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b8f/869020/4/gate/openstack-tox-pep8/b8f7ed4/job-output.txt

https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_251/869020/4/gate/openstack-tox-py39/251d84e/job-output.txt

^^ is a py39 test - with error:

tox.tox_env.errors.Fail: env name py39 conflicting with base python python3

[Ronelle Landy (rlandy)]

This error just started to be visible in check/gate - seen in tripleo-ansile and THT jobs

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/869417
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/0c0def6f81b6a71f2a07ae4bec9834d8048edb25
Submitter: "Zuul (22348)"
Branch: master

commit 0c0def6f81b6a71f2a07ae4bec9834d8048edb25
Author: rabi <email address hidden>
Date: Fri Jan 6 09:13:05 2023 +0530

    Fix issues with tox 4.2.4

    tox now hard fails if there is mismatch in spec
    attributes[1]. This works around the issue
    temporarily. We probably have to drop py38 jobs
    and specify basepython for py39 target in the
    future.

    [1] https://github.com/tox-dev/tox/pull/2824/

    Closes-Bug: #2002035
    Change-Id: I4256a51afd011048eaaaf5d3c225ab36f75708ed

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-ansible/+/869429

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-ansible/+/869429
Committed: https://opendev.org/openstack/tripleo-ansible/commit/b88008dd64049de8a3ae7e38ee76d563134af2ef
Submitter: "Zuul (22348)"
Branch: master

commit b88008dd64049de8a3ae7e38ee76d563134af2ef
Author: rabi <email address hidden>
Date: Tue Jan 3 09:34:32 2023 +0530

    Fix issues with tox 4.2.4

    tox now hard fails if there is mismatch in spec
    attributes[1]. This works around the issue
    temporarily. We probably have to drop py38 jobs
    and specify basepython for py39 target in the
    future.

    Removes ansible-galaxy --timeout for py* jobs to
    workaround. We may hit the timeout with py* jobs.

    [1] https://github.com/tox-dev/tox/pull/2824/

    Closes-Bug: #2001602
    Closes-Bug: #2002035
    Change-Id: Iad2455193885205236e03c1219352102bb931de8

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/zed
Review: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/869329

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/868464
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/80dc72e26c2868fbeb6000897f5a16c6f7a6aa30
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit 80dc72e26c2868fbeb6000897f5a16c6f7a6aa30
Author: wu.shiming <email address hidden>
Date: Sat Sep 18 11:55:07 2021 +0800

    Changed minversion in tox to 3.18.0

    The patch bumps min version of tox to 3.18.0 in order to
    replace tox's whitelist_externals by allowlist_externals option:
    https://github.com/tox-dev/tox/blob/master/docs/changelog.rst#v3180-2020-07-23

    Also removes skipdist=True as in
    Ib0fca00c92ef56fce57eb6355cb6be36e478a744.

    Also inlcludes:

    Fix issues with tox 4.2.4

    tox now hard fails if there is mismatch in spec
    attributes[1]. This works around the issue
    temporarily. We probably have to drop py38 jobs
    and specify basepython for py39 target in the
    future.

    [1] https://github.com/tox-dev/tox/pull/2824/

    Conflicts:
            tox.ini

    Backport note:
    This is now required to adapt to the new tox 4.0 release, which no
    longer supports the old deprecated options.

    Closes-Bug: #2002035
    Change-Id: I5792c86745b875d074f670d92fe78a84a907bd74
    (cherry picked from commit 3cb006d53215d9b6e13f9671f8ad1c9c3648d1fd
     and 7fd4519b222166edc5a02121a4a04c113ab671be)
    (cherry picked from commit 0c0def6f81b6a71f2a07ae4bec9834d8048edb25)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/869329
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/04d09fec3a75df4fc49b804449f41b56eb304cc3
Submitter: "Zuul (22348)"
Branch: stable/zed

commit 04d09fec3a75df4fc49b804449f41b56eb304cc3
Author: rabi <email address hidden>
Date: Fri Jan 6 09:13:05 2023 +0530

    Fix issues with tox 4.2.4

    tox now hard fails if there is mismatch in spec
    attributes[1]. This works around the issue
    temporarily. We probably have to drop py38 jobs
    and specify basepython for py39 target in the
    future.

    [1] https://github.com/tox-dev/tox/pull/2824/

    Closes-Bug: #2002035
    Change-Id: I4256a51afd011048eaaaf5d3c225ab36f75708ed
    (cherry picked from commit 0c0def6f81b6a71f2a07ae4bec9834d8048edb25)