masakari-monitors wheel building failed for libvirt-python

[Jules Dorison]

Trying to deploy Openstack with openstack-ansible on Ubuntu 18.04 Server.
Sever is fresh installed.

All others modules are installed succesfully

When installing masakari-monitor package on computes hosts, a fail occurs :

[infra1]: FAILED! => {"attempts": 5, "changed": false, "cmd": ["/openstack/venvs/masakari-20.1.2/bin/pip3", "install", "-U", "--constraint", "/openstack/venvs/masakari-20.1.2/global-constraints.txt", "--constraint", "/openstack/venvs/masakari-20.1.2/constraints.txt", "--pre", "--log", "/var/log/python_venv_build.log", "--find-links", "http://openstack-int.ataraxie.fr:8181/os-releases/20.1.2/ubuntu-18.04-x86_64", "--trusted-host", "openstack-int.ataraxie.fr", "masakari-monitors", "systemd-python"], "msg": "stdout: Ignoring argparse: markers 'python_version == \"2.7\"' don't match your environment
Ignoring rally-openstack: markers 'python_version == \"2.7\"' don't match your environment
Looking in links: http://openstack-int.ataraxie.fr:8181/os-releases/20.1.2/ubuntu-18.04-x86_64
Requirement already up-to-date: systemd_python==234 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 108)) (234)
Collecting masakari-monitors
  Using cached https://files.pythonhosted.org/packages/fc/32/23f024646486634e3d43d6db5c2612dd6c4a0ee609ffe0275a31d2c1ed0a/masakari_monitors-9.0.0-py3-none-any.whl
Requirement already up-to-date: oslo.config==6.11.2 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 4)) (6.11.2)
Requirement already up-to-date: oslo.concurrency==3.30.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 28)) (3.30.0)
Requirement already up-to-date: pbr==5.4.3 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 51)) (5.4.3)
Requirement already up-to-date: openstacksdk==0.36.3 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 10)) (0.36.3)
Requirement already up-to-date: oslo.service==1.40.2 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 64)) (1.40.2)
Requirement already up-to-date: oslo.log==3.44.1 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 75)) (3.44.1)
Requirement already up-to-date: oslo.utils==3.41.5 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 9)) (3.41.5)
Requirement already up-to-date: oslo.i18n==3.24.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 32)) (3.24.0)
Requirement already satisfied, skipping upgrade: oslo.privsep>=1.23.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from masakari-monitors) (2.2.1)
Requirement already up-to-date: six==1.12.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 91)) (1.12.0)
Requirement already up-to-date: oslo.middleware==3.38.1 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 84)) (3.38.1)
Requirement already up-to-date: automaton==1.17.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 95)) (1.17.0)
Collecting libvirt-python!=4.1.0,>=3.5.0
  Using cached https://files.pythonhosted.org/packages/6c/8c/16c42af8651b31587e5437c5d9ebd51a4d6007265a0e4182d5d16f409694/libvirt-python-6.4.0.tar.gz
Requirement already up-to-date: oslo.cache==1.37.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 47)) (1.37.0)
Requirement already satisfied, skipping upgrade: lxml!=3.7.0,>=3.4.1 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from masakari-monitors) (4.5.1)
Requirement already up-to-date: netaddr==0.7.19 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 87)) (0.7.19)
Requirement already up-to-date: rfc3986==1.3.2 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 115)) (1.3.2)
Requirement already up-to-date: stevedore==1.31.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 85)) (1.31.0)
Requirement already up-to-date: debtcollector==1.22.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 78)) (1.22.0)
Requirement already up-to-date: pyyaml==5.1.2 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 77)) (5.1.2)
Requirement already up-to-date: requests==2.22.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 8)) (2.22.0)
Requirement already up-to-date: fasteners==0.14.1 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 67)) (0.14.1)
Requirement already up-to-date: appdirs==1.4.3 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 70)) (1.4.3)
Requirement already up-to-date: dogpile.cache==0.7.1 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 46)) (0.7.1)
Requirement already up-to-date: netifaces==0.10.9 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 65)) (0.10.9)
Requirement already up-to-date: os_service_types==1.7.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 88)) (1.7.0)
Requirement already up-to-date: cryptography==2.7 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 49)) (2.7)
Requirement already up-to-date: jsonpatch==1.24 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 117)) (1.24)
Requirement already up-to-date: requestsexceptions==1.4.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 73)) (1.4.0)
Requirement already up-to-date: keystoneauth1==3.17.2 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 116)) (3.17.2)
Requirement already up-to-date: munch==2.3.2 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 94)) (2.3.2)
Requirement already up-to-date: iso8601==0.1.12 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 2)) (0.1.12)
Requirement already up-to-date: decorator==4.4.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 113)) (4.4.0)
Requirement already up-to-date: jmespath==0.9.4 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 17)) (0.9.4)
Requirement already up-to-date: pastedeploy==2.0.1 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 62)) (2.0.1)
Requirement already up-to-date: eventlet==0.25.1 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 72)) (0.25.1)
Requirement already up-to-date: webob==1.8.5 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 45)) (1.8.5)
Requirement already up-to-date: fixtures==3.0.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 40)) (3.0.0)
Requirement already up-to-date: paste==3.2.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 29)) (3.2.0)
Requirement already up-to-date: yappi==1.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 7)) (1.0)
Requirement already up-to-date: routes==2.4.1 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 102)) (2.4.1)
Requirement already up-to-date: greenlet==0.4.15 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 93)) (0.4.15)
Requirement already up-to-date: oslo.context==2.23.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 52)) (2.23.0)
Requirement already up-to-date: pyinotify==0.9.6 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 83)) (0.9.6)
Requirement already up-to-date: python_dateutil==2.8.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 27)) (2.8.0)
Requirement already up-to-date: oslo.serialization==2.29.2 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 82)) (2.29.2)
Requirement already up-to-date: pytz==2019.2 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 104)) (2019.2)
Requirement already up-to-date: pyparsing==2.4.2 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 60)) (2.4.2)
Requirement already up-to-date: babel==2.7.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 30)) (2.7.0)
Requirement already up-to-date: cffi==1.12.3 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 109)) (1.12.3)
Requirement already up-to-date: msgpack==0.6.1 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 57)) (0.6.1)
Requirement already up-to-date: jinja2==2.10.1 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 99)) (2.10.1)
Requirement already up-to-date: statsd==3.3.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 31)) (3.3.0)
Requirement already up-to-date: prettytable==0.7.2 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 97)) (0.7.2)
Requirement already up-to-date: wrapt==1.11.2 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 69)) (1.11.2)
Requirement already up-to-date: idna==2.8 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 100)) (2.8)
Requirement already up-to-date: chardet==3.0.4 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 59)) (3.0.4)
Requirement already up-to-date: certifi==2019.6.16 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 33)) (2019.6.16)
Requirement already up-to-date: urllib3==1.25.3 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 103)) (1.25.3)
Requirement already up-to-date: monotonic==1.5 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 68)) (1.5)
Requirement already up-to-date: asn1crypto==0.24.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 11)) (0.24.0)
Requirement already up-to-date: jsonpointer==2.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 20)) (2.0)
Requirement already up-to-date: dnspython==1.15.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 50)) (1.15.0)
Requirement already up-to-date: testtools==2.3.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 107)) (2.3.0)
Requirement already up-to-date: repoze.lru==0.7 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 86)) (0.7)
Requirement already up-to-date: pycparser==2.19 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 112)) (2.19)
Requirement already up-to-date: markupsafe==1.1.1 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 48)) (1.1.1)
Requirement already up-to-date: extras==1.0.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 81)) (1.0.0)
Requirement already up-to-date: unittest2==1.1.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 26)) (1.1.0)
Requirement already up-to-date: traceback2==1.4.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 90)) (1.4.0)
Requirement already up-to-date: python_mimeparse==1.6.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 55)) (1.6.0)
Requirement already up-to-date: argparse==1.4.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 106)) (1.4.0)
Requirement already up-to-date: linecache2==1.0.0 in /openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages (from -c /openstack/venvs/masakari-20.1.2/constraints.txt (line 19)) (1.0.0)
Building wheels for collected packages: libvirt-python
  Building wheel for libvirt-python (setup.py): started
  Building wheel for libvirt-python (setup.py): finished with status 'error'
  Running setup.py clean for libvirt-python
Failed to build libvirt-python
Installing collected packages: libvirt-python, masakari-monitors
    Running setup.py install for libvirt-python: started
    Running setup.py install for libvirt-python: finished with status 'error'

:stderr: ERROR: Failed building wheel for libvirt-python
ERROR: Command errored out with exit status 1: /openstack/venvs/masakari-20.1.2/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '\"'\"'/tmp/pip-install-_qho_khz/libvirt-python/setup.py'\"'\"'; __file__='\"'\"'/tmp/pip-install-_qho_khz/libvirt-python/setup.py'\"'\"';f=getattr(tokenize, '\"'\"'open'\"'\"', open)(__file__);code=f.read().replace('\"'\"'\\r\
'\"'\"', '\"'\"'\
'\"'\"');f.close();exec(compile(code, __file__, '\"'\"'exec'\"'\"'))' install --record /tmp/pip-record-8f4rurr3/install-record.txt --single-version-externally-managed --compile --install-headers /openstack/venvs/masakari-20.1.2/include/site/python3.6/libvirt-python Check the logs for full command output.
WARNING: You are using pip version 19.3; however, version 20.1.1 is available.

[Dmitriy Rabotyagov (noonedeadpunk)]

Hi,

Can you also kindly check, /var/log/python_venv_build.log on masakari-monitors and utility host? THere can be more details about why libvirt-python has failed to build wheels.

[Jules Dorison (berthe01)]

Hi,

Here's the end of the log file /var/log/python_venv_build.log :

2020-07-07T19:50:57,186 Building wheels for collected packages: libvirt-python
2020-07-07T19:50:57,186 Created temporary directory: /tmp/pip-wheel-ou5u6dgn
2020-07-07T19:50:57,186 Building wheel for libvirt-python (setup.py): started
2020-07-07T19:50:57,187 Destination directory: /tmp/pip-wheel-ou5u6dgn
2020-07-07T19:50:57,187 Running command /openstack/venvs/masakari-20.1.2/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-pwvirrp7/libvirt-python/setup.py'"'"'; __file__='"'"'/tmp/pip-install-pwvirrp7/libvirt-python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-ou5u6dgn --python-tag cp36
2020-07-07T19:50:57,484 running bdist_wheel
2020-07-07T19:50:57,487 running build
2020-07-07T19:50:57,487 Traceback (most recent call last):
2020-07-07T19:50:57,488 File "<string>", line 1, in <module>
2020-07-07T19:50:57,488 File "/tmp/pip-install-pwvirrp7/libvirt-python/setup.py", line 374, in <module>
2020-07-07T19:50:57,488 "Programming Language :: Python :: 3.8",
2020-07-07T19:50:57,488 File "/usr/lib/python3.6/distutils/core.py", line 148, in setup
2020-07-07T19:50:57,488 dist.run_commands()
2020-07-07T19:50:57,488 File "/usr/lib/python3.6/distutils/dist.py", line 955, in run_commands
2020-07-07T19:50:57,489 self.run_command(cmd)
2020-07-07T19:50:57,489 File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
2020-07-07T19:50:57,489 cmd_obj.run()
2020-07-07T19:50:57,489 File "/openstack/venvs/masakari-20.1.2/lib/python3.6/site-packages/wheel/bdist_wheel.py", line 192, in run
2020-07-07T19:50:57,489 self.run_command('build')
2020-07-07T19:50:57,489 File "/usr/lib/python3.6/distutils/cmd.py", line 313, in run_command
2020-07-07T19:50:57,489 self.distribution.run_command(command)
2020-07-07T19:50:57,490 File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
2020-07-07T19:50:57,490 cmd_obj.run()
2020-07-07T19:50:57,490 File "/tmp/pip-install-pwvirrp7/libvirt-python/setup.py", line 151, in run
2020-07-07T19:50:57,490 check_minimum_libvirt_version()
2020-07-07T19:50:57,490 File "/tmp/pip-install-pwvirrp7/libvirt-python/setup.py", line 44, in check_minimum_libvirt_version
2020-07-07T19:50:57,490 spawn([get_pkgcfg(),
2020-07-07T19:50:57,490 File "/tmp/pip-install-pwvirrp7/libvirt-python/setup.py", line 40, in get_pkgcfg
2020-07-07T19:50:57,490 raise Exception("pkg-config binary is required to compile libvirt-python")
2020-07-07T19:50:57,490 Exception: pkg-config binary is required to compile libvirt-python
2020-07-07T19:50:57,513 Building wheel for libvirt-python (setup.py): finished with status 'error'
2020-07-07T19:50:57,513 ERROR: Failed building wheel for libvirt-python
2020-07-07T19:50:57,514 Running setup.py clean for libvirt-python
2020-07-07T19:50:57,514 Running command /openstack/venvs/masakari-20.1.2/bin/python3 -u -c 'import sys, setu...

[Jules Dorison (berthe01)]

After manually install the pkg-config package on the host with :

-> apt-get install pkg-config

Another error occurs (python_venv_build.log) :

2020-07-08T10:13:25,242 Building wheels for collected packages: libvirt-python
2020-07-08T10:13:25,243 Created temporary directory: /tmp/pip-wheel-vpksdxua
2020-07-08T10:13:25,243 Building wheel for libvirt-python (setup.py): started
2020-07-08T10:13:25,243 Destination directory: /tmp/pip-wheel-vpksdxua
2020-07-08T10:13:25,243 Running command /openstack/venvs/masakari-20.1.2/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-ei67pgjj/libvirt-python/setup.py'"'"'; __file__='"'"'/tmp/pip-install-ei67pgjj/libvirt-python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-vpksdxua --python-tag cp36
2020-07-08T10:13:25,503 Package libvirt was not found in the pkg-config search path.
2020-07-08T10:13:25,503 Perhaps you should add the directory containing `libvirt.pc'
2020-07-08T10:13:25,503 to the PKG_CONFIG_PATH environment variable
2020-07-08T10:13:25,504 No package 'libvirt' found
2020-07-08T10:13:25,507 Package libvirt was not found in the pkg-config search path.
2020-07-08T10:13:25,507 Perhaps you should add the directory containing `libvirt.pc'
2020-07-08T10:13:25,507 to the PKG_CONFIG_PATH environment variable
2020-07-08T10:13:25,507 No package 'libvirt' found
2020-07-08T10:13:25,549 running bdist_wheel
2020-07-08T10:13:25,553 running build
2020-07-08T10:13:25,553 /usr/bin/pkg-config --print-errors --atleast-version=0.9.11 libvirt
2020-07-08T10:13:25,557 Package libvirt was not found in the pkg-config search path.
2020-07-08T10:13:25,558 Perhaps you should add the directory containing `libvirt.pc'
2020-07-08T10:13:25,558 to the PKG_CONFIG_PATH environment variable
2020-07-08T10:13:25,558 No package 'libvirt' found
2020-07-08T10:13:25,558 error: command '/usr/bin/pkg-config' failed with exit status 1
2020-07-08T10:13:25,586 Building wheel for libvirt-python (setup.py): finished with status 'error'
2020-07-08T10:13:25,587 ERROR: Failed building wheel for libvirt-python
2020-07-08T10:13:25,587 Running setup.py clean for libvirt-python
2020-07-08T10:13:25,587 Running command /openstack/venvs/masakari-20.1.2/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-ei67pgjj/libvirt-python/setup.py'"'"'; __file__='"'"'/tmp/pip-install-ei67pgjj/libvirt-python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' clean --all
2020-07-08T10:13:25,849 Package libvirt was not found in the pkg-config search path.
2020-07-08T10:13:25,850 Perhaps you should add the directory containing `libvirt.pc'
2020-07-08T10:13:25,850 to the PKG_CONFIG_PATH environment variable
2020-07-08T10:13:25,850 No package 'libvirt' found
2020-07-08T10:13:25,854 Package libvirt was not found in the pkg-config search path.
2020-07-08T10:13:25,85...

[Dmitriy Rabotyagov (noonedeadpunk)]

Do you have libvirt-dev installed?

Eventually, I think, that is not supposed to be built, but it's expected to be symlinked. inside venv. However, this doesn't happen because of the wheel build, so that may be pretty valid issue.

[Dmitriy Rabotyagov (noonedeadpunk)]

Also would be great to have have ansible's stdout int terms of the name of the task where it failed as well as several previous ones for the context

[Jules Dorison (berthe01)]

Cmd -> openstack-ansible os-masakari-install.yml

I'm using the Train version (20.1.2) of OSA.

Here the Ansible stdout (just before the error) :

TASK [python_venv_build : Install python packages into the venv] *********************************************************************************************************************************************
skipping: [infra1_masakari_api_container-7ca6b70e]
skipping: [infra2_masakari_api_container-169cf7c3]
skipping: [infra3_masakari_api_container-004c66d5]
FAILED - RETRYING: Install python packages into the venv (5 retries left).
FAILED - RETRYING: Install python packages into the venv (5 retries left).
FAILED - RETRYING: Install python packages into the venv (5 retries left).
FAILED - RETRYING: Install python packages into the venv (4 retries left).
FAILED - RETRYING: Install python packages into the venv (4 retries left).
FAILED - RETRYING: Install python packages into the venv (4 retries left).
FAILED - RETRYING: Install python packages into the venv (3 retries left).
FAILED - RETRYING: Install python packages into the venv (3 retries left).
FAILED - RETRYING: Install python packages into the venv (3 retries left).
FAILED - RETRYING: Install python packages into the venv (2 retries left).
FAILED - RETRYING: Install python packages into the venv (2 retries left).
FAILED - RETRYING: Install python packages into the venv (2 retries left).
FAILED - RETRYING: Install python packages into the venv (1 retries left).
FAILED - RETRYING: Install python packages into the venv (1 retries left).
FAILED - RETRYING: Install python packages into the venv (1 retries left).

Then it displays my first posted outpout.

I'll try to install libvirt-dev and restart the masakari install.

[Jules Dorison (berthe01)]

Failed again with libvirt-dev installed but seems better :

x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I. -I/usr/include/python3.6m -I/openstack/venvs/masakari-20.1.2/include/python3.6m -c libvirt-override.c -o build/temp.linux-x86_64-3.6/libvirt-override.o
2020-07-11T19:27:32,443 libvirt-override.c:20:10: fatal error: Python.h: No such file or directory
2020-07-11T19:27:32,443 #include <Python.h>
2020-07-11T19:27:32,443 ^~~~~~~~~~
2020-07-11T19:27:32,443 compilation terminated.
2020-07-11T19:27:32,463 error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
2020-07-11T19:27:32,498 Running setup.py install for libvirt-python: finished with status 'error'

So I'll install python3-dev and try again...

[Jules Dorison (berthe01)]

So compilation/installation seems to succeed after :

apt-get update && apt-get -y install python3-dev pkg-config libvirt-dev

on the host before launching the masakari playbook.

Perhaps this should be done by the playbook ?
Or did I missed something ?

There is still an error but I think it is due to the fact that I only launch the 'os-masakari-install' playbook

fatal: [infra1]: FAILED! => {"msg": "'nova_venv_tag' is undefined"}

I'll try to launch the 'setup-everything.yml' playbook and tell you.

Thanks for the help :)

[Jules Dorison (berthe01)]

After running the 'setup-everything.yml' playbook I still get the following error :

TASK [os_masakari : Deploy masakari configuration files] *****************************************************************************************************************************************************
ok: [infra1_masakari_api_container-7ca6b70e] => (item={'src': 'api-paste.ini.j2', 'dest': '/etc/masakari/api-paste.ini', 'config_overrides': {}, 'config_type': 'ini', 'condition': True})
ok: [infra2_masakari_api_container-169cf7c3] => (item={'src': 'api-paste.ini.j2', 'dest': '/etc/masakari/api-paste.ini', 'config_overrides': {}, 'config_type': 'ini', 'condition': True})
skipping: [infra1] => (item={'src': 'api-paste.ini.j2', 'dest': '/etc/masakari/api-paste.ini', 'config_overrides': {}, 'config_type': 'ini', 'condition': False})
skipping: [infra1] => (item={'src': 'masakari.conf.j2', 'dest': '/etc/masakari/masakari.conf', 'config_overrides': {}, 'config_type': 'ini', 'condition': False})
skipping: [infra1] => (item={'src': 'policy.json.j2', 'dest': '/etc/masakari/policy.json', 'config_overrides': {}, 'config_type': 'json', 'condition': False})
ok: [infra3_masakari_api_container-004c66d5] => (item={'src': 'api-paste.ini.j2', 'dest': '/etc/masakari/api-paste.ini', 'config_overrides': {}, 'config_type': 'ini', 'condition': True})
ok: [infra1] => (item={'src': 'masakarimonitors.conf.j2', 'dest': '/etc/masakarimonitors/masakarimonitors.conf', 'config_overrides': {}, 'config_type': 'ini', 'condition': True})
ok: [infra1_masakari_api_container-7ca6b70e] => (item={'src': 'masakari.conf.j2', 'dest': '/etc/masakari/masakari.conf', 'config_overrides': {}, 'config_type': 'ini', 'condition': True})
skipping: [infra2] => (item={'src': 'api-paste.ini.j2', 'dest': '/etc/masakari/api-paste.ini', 'config_overrides': {}, 'config_type': 'ini', 'condition': False})
skipping: [infra2] => (item={'src': 'masakari.conf.j2', 'dest': '/etc/masakari/masakari.conf', 'config_overrides': {}, 'config_type': 'ini', 'condition': False})
skipping: [infra2] => (item={'src': 'policy.json.j2', 'dest': '/etc/masakari/policy.json', 'config_overrides': {}, 'config_type': 'json', 'condition': False})
fatal: [infra1]: FAILED! => {"msg": "'nova_venv_tag' is undefined"}
ok: [infra2_masakari_api_container-169cf7c3] => (item={'src': 'masakari.conf.j2', 'dest': '/etc/masakari/masakari.conf', 'config_overrides': {}, 'config_type': 'ini', 'condition': True})
ok: [infra1_masakari_api_container-7ca6b70e] => (item={'src': 'policy.json.j2', 'dest': '/etc/masakari/policy.json', 'config_overrides': {}, 'config_type': 'json', 'condition': True})
ok: [infra2] => (item={'src': 'masakarimonitors.conf.j2', 'dest': '/etc/masakarimonitors/masakarimonitors.conf', 'config_overrides': {}, 'config_type': 'ini', 'condition': True})
skipping: [infra1_masakari_api_container-7ca6b70e] => (item={'src': 'masakarimonitors.conf.j2', 'dest': '/etc/masakarimonitors/masakarimonitors.conf', 'config_overrides': {}, 'config_type': 'ini', 'condition': False})
skipping: [infra1_masakari_api_container-7ca6b70e] => (item={'src': 'process_list.yaml.j2', 'dest': '/etc/masakarimonitors/process_list.yaml', 'config_overrides': {}, 'config_type...