[instack-undercloud] openstack-tox-py35 fails with dependency issue

[Carlos Camacho]

Collecting pyparsing===2.2.0 (from -c https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt (line 376))
  Using cached https://files.pythonhosted.org/packages/6a/8a/718fd7d3458f9fab8e67186b00abdd345b639976bc7fb3ae722e1b026a50/pyparsing-2.2.0-py2.py3-none-any.whl
Collecting stevedore===1.28.0 (from -c https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt (line 383))
  Using cached https://files.pythonhosted.org/packages/17/6b/3b7d6d08b2ab3e5ef09e01c9f7b3b590ee135f289bb94553419e40922c25/stevedore-1.28.0-py2.py3-none-any.whl
Collecting openstacksdk===0.14.0 (from -c https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt (line 413))
  Using cached https://files.pythonhosted.org/packages/d2/50/709f8d7dc0e7aa281f280805e65ae655ea5b559f68219bc95b7744617365/openstacksdk-0.14.0-py2.py3-none-any.whl
Collecting six===1.11.0 (from -c https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt (line 414))
  Using cached https://files.pythonhosted.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl
Collecting dulwich===0.19.3 (from -c https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt (line 415))
  Using cached https://files.pythonhosted.org/packages/f4/43/efec01f4eb07d51a7967688a7c52bc7a90619110f836d466e28718676a6c/dulwich-0.19.3.tar.gz
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-ph6c_nsn/dulwich/setup.py", line 96, in <module>
        **setup_kwargs
      File "/repos/instack-undercloud/.tox/py36/lib/python3.6/site-packages/setuptools/__init__.py", line 128, in setup
        _install_setup_requires(attrs)
      File "/repos/instack-undercloud/.tox/py36/lib/python3.6/site-packages/setuptools/__init__.py", line 121, in _install_setup_requires
        dist.parse_config_files(ignore_option_errors=True)
      File "/repos/instack-undercloud/.tox/py36/lib/python3.6/site-packages/setuptools/dist.py", line 492, in parse_config_files
        _Distribution.parse_config_files(self, filenames=filenames)
      File "/usr/lib64/python3.6/distutils/dist.py", line 395, in parse_config_files
        parser.read(filename)
      File "/usr/lib64/python3.6/configparser.py", line 697, in read
        self._read(fp, filename)
      File "/usr/lib64/python3.6/configparser.py", line 1015, in _read
        for lineno, line in enumerate(fp, start=1):
      File "/repos/instack-undercloud/.tox/py36/lib64/python3.6/encodings/ascii.py", line 26, in decode
        return codecs.ascii_decode(input, self.errors)[0]
    UnicodeDecodeError: 'ascii' codec can't decode byte 0xc4 in position 48: ordinal not in range(128)

    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-ph6c_nsn/dulwich/

ERROR: could not install deps [-chttps://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt, -r/repos/instack-undercloud/test-requirements.txt, -r/repos/instack-undercloud/requirements.txt]; v = InvocationError('/repos/instack-undercloud/.tox/py36/bin/pip install -chttps://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt -r/repos/instack-undercloud/test-requirements.txt -r/repos/instack-undercloud/requirements.txt (see /repos/instack-undercloud/.tox/py36/log/py36-1.log)', 1)
_____________________________________________________________________________________________________ summary _____________________________________________________________________________________________________
ERROR: py36: could not install deps [-chttps://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt, -r/repos/instack-undercloud/test-requirements.txt, -r/repos/instack-undercloud/requirements.txt]; v = InvocationError('/repos/instack-undercloud/.tox/py36/bin/pip install -chttps://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt -r/repos/instack-undercloud/test-requirements.txt -r/repos/instack-undercloud/requirements.txt (see /repos/instack-undercloud/.tox/py36/log/py36-1.log)', 1)

[Carlos Camacho (ccamacho)]

Failing example: https://review.openstack.org/#/c/576165/

[Sofer Athlan-Guyot (sofer-athlan-guyot)]

Hi,

so the rogue character is in the setup.cfg file in the author name. That setup.cfg file was added in 0.19.3 [1] and 0.19.4 is not yet released.

[1] https://github.com/dulwich/dulwich/commit/1b6509fa3dbd05c458990b71fadff91af095f733

[Carlos Camacho (ccamacho)]

We just need to wait for dulwich 0.19.4

0.19.4 UNRELEASED

+ IMPROVEMENTS
+
+ * Add ``porcelain.ls_files``. (Jelmer Vernooij)
+
+ BUG FIXES
+
+ * Avoid unicode characters (e.g. the digraph ij in my surname) in setup.cfg,
+ since setuptools doesn't deal well with them. See
+ https://github.com/pypa/setuptools/issues/1062. (Jelmer Vernooij, #637)
+
 0.19.3 2018-06-17

Until then we shouldn't use 0.19.3

[Carlos Camacho (ccamacho)]

Fix proposed: https://review.openstack.org/#/c/577106

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/577193

[OpenStack Infra (hudson-openstack)]

Change abandoned by Alex Schultz (<email address hidden>) on branch: master
Review: https://review.openstack.org/577193
Reason: https://review.openstack.org/#/c/577106

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/577791
Committed: https://git.openstack.org/cgit/openstack/osprofiler/commit/?id=4a2f00200510d9c8659c1f59f52054ee4615fcaa
Submitter: Zuul
Branch: master

commit 4a2f00200510d9c8659c1f59f52054ee4615fcaa
Author: Tovin Seven <email address hidden>
Date: Mon Jun 25 18:29:36 2018 +0700

    Add minimum version and fix dulwich issue

    Main changes:
    - Add minimum version for requirements [1]
    - Fix dulwich issue that broke py35 gate [2]

    Trivial changes:
    - Re-format multi-line deps in tox.ini
    - Verify and change constraints of pymongo, prettytable
      to match global requirements

    ---
    requirements without minimum version definitaions may cause CI failure

    Merge https://review.openstack.org/#/c/574367/ made requirements job
    check for minimum version definitions, requirements without minimum version
    may cause CI failure.

    This patch sync the requirements with lower-constraints

    ---
    Start using upper-constraints in tox venvs

    Without this we are exposed to any breakages in dependencies, which
    is currently blocking the repo because of a broken dulwich release.

    Note that this required the removal of the explicit .[oslo_config]
    requirement. I'm not sure why that was there since it will be
    pulled in by oslo.concurrency anyway and it broke the venv creation
    when constraints were added. Since I'm not sure why it was split
    out as a separate thing I'm leaving the setup.cfg target but
    removing it from tox.ini.

    We also need to pin dulwich in lower-constraints, even though it's a
    transitive dependency. Otherwise the lower-constraints job installs
    the broken latest version.

    Transitive dependency that we need to pin due to
    https://bugs.launchpad.net/tripleo/+bug/1778004
    ---

    [1] https://review.openstack.org/#/c/575691
    [2] https://review.openstack.org/#/c/577462

    Co-Authored-By: Kevin_Zheng <email address hidden>
    Co-Authored-By: Ben Nemec <email address hidden>

    Change-Id: Ibfe5f460139849ba39b369321360f6f5a0e9e2a0
    Closes-Bug: #1777083
    Closes-Bug: #1778004

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/osprofiler 2.2.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements rocky-eol release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements stein-eol release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements yoga-eom release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements train-eol release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements ussuri-eol release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements victoria-eom release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements wallaby-eom release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements xena-eom release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements zed-eom release.