Number of jobs fail with RETRY_LIMIT, No module named 'setuptools_rust

Bug #1915101 reported by Rabi Mishra
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
tripleo
Critical
Sandeep Yadav

Bug Description

Noticed at:

https://772bfaaa5f1677964fcd-ed6d5537e7456b4e326815c6a7a50125.ssl.cf5.rackcdn.com/773847/2/gate/tripleo-buildimage-overcloud-full-centos-8/f5f8ac2/job-output.txt

Looks like newly released cryptography 3.4.1 is broken.

I've proposed a requirements patch to bump uc.

https://review.opendev.org/c/openstack/requirements/+/774577

We can probably also pin cryptography till that merges.

2021-02-08 23:32:13.070337 | primary | ERROR: Item: tripleo-common
2021-02-08 23:32:13.070658 | primary | {
2021-02-08 23:32:13.070759 | primary | "ansible_loop_var": "item",
2021-02-08 23:32:13.070850 | primary | "item": "tripleo-common",
2021-02-08 23:32:13.070948 | primary | "msg": "stdout: Collecting oslo.concurrency===4.4.0 (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 24))\n Downloading https://mirror-int.ord.rax.opendev.org/pypifiles/packages/30/2d/d9dd1b17bdbcd8f269c025052677b7bc3b54b6f91c3df6ba7732c4152327/oslo.concurrency-4.4.0-py3-none-any.whl (47kB)\nCollecting python-ironic-inspector-client===4.4.0 (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 29))\n Downloading https://mirror-int.ord.rax.opendev.org/pypifiles/packages/3c/f4/dc10c616c1ec6dd30ac2db813e00e423abe9dd636294d05bbbf10e3b21f6/python_ironic_inspector_client-4.4.0-py3-none-any.whl\nRequirement already satisfied: pbr===5.5.1 in /home/zuul/workspace/venv/lib/python3.6/site-packages (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 46))\nCollecting oslo.i18n===5.0.1 (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 52))\n Downloading https://mirror-int.ord.rax.opendev.org/pypifiles/packages/89/ac/b71a66e54c8fcf22c4205efe2b5f94dbf282c194f9f07dbf0a1ac52d4633/oslo.i18n-5.0.1-py3-none-any.whl (42kB)\nCollecting python-mistralclient===4.2.0 (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 54))\n Downloading https://mirror-int.ord.rax.opendev.org/pypifiles/packages/d2/3b/2ea2e0434107fa6fe3a3168d7e2ccd6f2cb7f1ee22ca06187c5b4ace057c/python_mistralclient-4.2.0-py3-none-any.whl (142kB)\nCollecting python-glanceclient===3.2.2 (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 116))\n Downloading https://mirror-int.ord.rax.opendev.org/pypifiles/packages/e6/b7/084a58c4540443baae244880ffb4ff881be02d591234e4b91f7766213b62/python_glanceclient-3.2.2-py3-none-any.whl (189kB)\nCollecting netaddr===0.8.0 (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 135))\n Downloading https://mirror-int.ord.rax.opendev.org/pypifiles/packages/ff/cd/9cdfea8fc45c56680b798db6a55fa60a22e2d3d3ccf54fc729d083b50ce4/netaddr-0.8.0-py2.py3-none-any.whl (1.9MB)\nCollecting prettytable===0.7.2 (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 143))\n Downloading https://mirror-int.ord.rax.opendev.org/pypifiles/packages/ef/30/4b0746848746ed5941f052479e7c23d2b56d174b82f4fd34a25e389831f5/prettytable-0.7.2.tar.bz2\nCollecting eventlet===0.30.1 (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 157))\n Downloading https://mirror-int.ord.rax.opendev.org/pypifiles/packages/95/31/8daea2c6d5b6a9c567da07e976f8b4112dd18df0612a67ae9f990754c4a5/eventlet-0.30.1-py2.py3-none-any.whl (224kB)\nCollecting paramiko===2.7.2 (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 167))\n Downloading https://mirror-int.ord.rax.opendev.org/pypifiles/packages/95/19/124e9287b43e6ff3ebb9cdea3e5e8e88475a873c05ccdf8b7e20d2c4201e/paramiko-2.7.2-py2.py3-none-any.whl (206kB)\nRequirement already satisfied: PyYAML===5.4.1 in /home/zuul/workspace/venv/lib/python3.6/site-packages (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 181))\nCollecting cryptography===3.4.1 (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 185))\n Downloading https://mirror-int.ord.rax.opendev.org/pypifiles/packages/06/ed/cb79cc94ec58d9d92557238fc6c629cd6e07d72334d2de556aecc2211370/cryptography-3.4.1.tar.gz (544kB)\n Complete output from command python setup.py egg_info:\n \n =============================DEBUG ASSISTANCE==========================\n If you are seeing an error here please try the following to\n successfully install cryptography:\n \n Upgrade to the latest pip and try again. This will fix errors for most\n users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip\n =============================DEBUG ASSISTANCE==========================\n \n Traceback (most recent call last):\n File \"<string>\", line 1, in <module>\n File \"/tmp/pip-build-b4vatkr1/cryptography/setup.py\", line 14, in <module>\n from setuptools_rust import RustExtension\n ModuleNotFoundError: No module named 'setuptools_rust'\n \n ----------------------------------------\n\n:stderr: Ignoring scipy: markers 'python_version == \"3.8\"' don't match your environment\nIgnoring numpy: markers 'python_version == \"3.8\"' don't match your environment\nIgnoring importlib-resources: markers 'python_version == \"3.8\"' don't match your environment\nCommand \"python setup.py egg_info\" failed with error code 1 in /tmp/pip-build-b4vatkr1/cryptography/\nYou are using pip version 9.0.3, however version 21.0.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n"

Rabi Mishra (rabi)
Changed in tripleo:
status: New → Triaged
importance: Undecided → Critical
Revision history for this message
wes hayutin (weshayutin) wrote :

FYI...

not sure it's fixed in all cases, but..

[11:24:49] <weshay|ruck> any insight into "no module named setuptools_rust" http://logstash.openstack.org/#dashboard/file/logstash.json?query=(message%3A%5C%22No%20module%20named%20'setuptools_rust'%5C%22)%20AND%20tags%3Aconsole%20AND%20voting%3A1

[11:27:26] <clarkb> weshay|ruck: cryptography pushed new sdists without wheels so pip tried to install cryptography from source and failed due to missing build deps. They pushed wheels and now things are happy again

Revision history for this message
Rabi Mishra (rabi) wrote :
tags: added: promotion-blocker
Revision history for this message
Rabi Mishra (rabi) wrote :

I these image build jobs we've an old pip that's why it's not installing[1] a pre-compiled wheel.

[1] https://github.com/openstack/tripleo-ci/blob/master/roles/oooci-build-images/defaults/main.yaml#L12

Revision history for this message
Rabi Mishra (rabi) wrote :

Looks like upgrading to 3.4.3 probably is not helping due to [1].

We would need to upgrade pip in the venv to fix it like what Sandeep is trying with https://review.opendev.org/c/openstack/tripleo-ci/+/774597

[1] https://github.com/pyca/cryptography/blob/master/setup.py#L14-L27

Changed in tripleo:
milestone: none → wallaby-3
assignee: nobody → Sandeep Yadav (sandeepyadav93)
Revision history for this message
Sandeep Yadav (sandeepyadav93) wrote :
Changed in tripleo:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers