Scenario 12 standalone deployment tests Ironic.
On CentOS-8, standalone deployment is failing with following errors:
Error: error checking path "/run/libvirt": stat /run/libvirt: no such file or directory while doing nova_migration_target. Need to find out why that /run/libvirt volume does not exists.
https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/deployment/nova/nova-migration-target-container-puppet.yaml#L164
https://cafad8e8711b8bb6facf-ca89416a8fe69de9445ee46610790deb.ssl.cf2.rackcdn.com/711599/4/check/tripleo-ci-centos-8-scenario012-standalone/51dcac3/logs/undercloud/home/zuul/standalone_deploy.log
020-03-11 07:51:10 | TASK [tripleo_container_manage : Check podman create status] *******************
2020-03-11 07:51:10 | Wednesday 11 March 2020 07:51:10 +0000 (0:00:02.628) 0:34:50.072 *******
2020-03-11 07:51:11 | changed: [standalone] => (item={'started': 1, 'finished': 0, 'ansible_job_id': '970278244752.73127', 'results_file': '/tmp/.ansible_async/970278244752.73127', 'changed': True, 'failed': False, 'container_data': {'swift_account_reaper': {'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'TRIPLEO_CONFIG_HASH': '2ba558f662c507b5ff0c97c729b8722a'}, 'image': '192.168.24.1:8787/tripleomaster/centos-binary-swift-account:3621159be13b41f8ead2e873b357f4a5-updated-20200311070217', 'net': 'host', 'restart': 'always', 'user': 'swift', 'volumes': ['/etc/hosts:/etc/hosts:ro', '/etc/localtime:/etc/localtime:ro', '/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro', '/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro', '/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro', '/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '/dev/log:/dev/log', '/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro', '/etc/puppet:/etc/puppet:ro', '/var/lib/kolla/config_files/swift_account_reaper.json:/var/lib/kolla/config_files/config.json:ro', '/var/lib/config-data/puppet-generated/swift:/var/lib/kolla/config_files/src:ro', '/srv/node:/srv/node:z', '/dev:/dev', '/var/cache/swift:/var/cache/swift:z', '/var/log/containers/swift:/var/log/swift:z'], 'start_order': 0}}, 'ansible_loop_var': 'container_data'})
2020-03-11 07:51:11 | changed: [standalone] => (item={'started': 1, 'finished': 0, 'ansible_job_id': '512366054307.73143', 'results_file': '/tmp/.ansible_async/512366054307.73143', 'changed': True, 'failed': False, 'container_data': {'cinder_api_cron': {'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'TRIPLEO_CONFIG_HASH': 'ac3b68d14e9b8373a30382f164198105'}, 'healthcheck': {'test': '/usr/share/openstack-tripleo-common/healthcheck/cron cinder'}, 'image': '192.168.24.1:8787/tripleomaster/centos-binary-cinder-api:3621159be13b41f8ead2e873b357f4a5-updated-20200311070217', 'net': 'host', 'privileged': False, 'restart': 'always', 'user': 'root', 'volumes': ['/etc/hosts:/etc/hosts:ro', '/etc/localtime:/etc/localtime:ro', '/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro', '/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro', '/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro', '/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '/dev/log:/dev/log', '/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro', '/etc/puppet:/etc/puppet:ro', '/var/lib/kolla/config_files/cinder_api_cron.json:/var/lib/kolla/config_files/config.json:ro', '/var/lib/config-data/puppet-generated/cinder:/var/lib/kolla/config_files/src:ro', '/var/log/containers/cinder:/var/log/cinder:z', '/var/log/containers/httpd/cinder-api:/var/log/httpd:z'], 'start_order': 0}}, 'ansible_loop_var': 'container_data'})
2020-03-11 07:51:11 | changed: [standalone] => (item={'started': 1, 'finished': 0, 'ansible_job_id': '349840308982.73189', 'results_file': '/tmp/.ansible_async/349840308982.73189', 'changed': True, 'failed': False, 'container_data': {'ovn_north_db_server': {'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'TRIPLEO_CONFIG_HASH': ''}, 'image': '192.168.24.1:8787/tripleomaster/centos-binary-ovn-nb-db-server:3621159be13b41f8ead2e873b357f4a5-updated-20200311070217', 'net': 'host', 'privileged': False, 'restart': 'always', 'start_order': 0, 'volumes': ['/etc/hosts:/etc/hosts:ro', '/etc/localtime:/etc/localtime:ro', '/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro', '/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro', '/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro', '/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '/dev/log:/dev/log', '/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro', '/etc/puppet:/etc/puppet:ro', '/var/lib/kolla/config_files/ovn_north_db_server.json:/var/lib/kolla/config_files/config.json:ro', '/lib/modules:/lib/modules:ro', '/var/lib/openvswitch/ovn:/var/lib/openvswitch:shared,z', '/var/lib/openvswitch/ovn:/run/openvswitch:shared,z', '/var/log/containers/openvswitch:/var/log/openvswitch:z', '/var/lib/openvswitch/ovn:/var/lib/ovn:shared,z', '/var/lib/openvswitch/ovn:/etc/openvswitch:shared,z', '/var/lib/openvswitch/ovn:/etc/ovn:shared,z', '/var/lib/openvswitch/ovn:/run/ovn:shared,z', '/var/log/containers/openvswitch:/var/log/ovn:z']}}, 'ansible_loop_var': 'container_data'})
2020-03-11 07:51:12 | test: /openstack/healthcheck
2020-03-11 07:51:12 | image: 192.168.24.1:8787/tripleomaster/centos-binary-nova-compute:3621159be13b41f8ead2e873b357f4a5-updated-20200311070217
2020-03-11 07:51:12 | net: host
2020-03-11 07:51:12 | privileged: true
2020-03-11 07:51:12 | restart: always
2020-03-11 07:51:12 | start_order: 0
2020-03-11 07:51:12 | user: root
2020-03-11 07:51:12 | volumes:
2020-03-11 07:51:12 | - /etc/hosts:/etc/hosts:ro
2020-03-11 07:51:12 | - /etc/localtime:/etc/localtime:ro
2020-03-11 07:51:12 | - /etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro
2020-03-11 07:51:12 | - /etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro
2020-03-11 07:51:12 | - /etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro
2020-03-11 07:51:12 | - /etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro
2020-03-11 07:51:12 | - /etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro
2020-03-11 07:51:12 | - /dev/log:/dev/log
2020-03-11 07:51:12 | - /etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro
2020-03-11 07:51:12 | - /etc/puppet:/etc/puppet:ro
2020-03-11 07:51:12 | - /var/lib/kolla/config_files/nova-migration-target.json:/var/lib/kolla/config_files/config.json:ro
2020-03-11 07:51:12 | - /var/lib/config-data/puppet-generated/nova_libvirt:/var/lib/kolla/config_files/src:ro
2020-03-11 07:51:12 | - /etc/ssh/:/host-ssh/:ro
2020-03-11 07:51:12 | - /run/libvirt:/run/libvirt
2020-03-11 07:51:12 | - /var/lib/nova:/var/lib/nova:shared,z
2020-03-11 07:51:12 | failed: false
2020-03-11 07:51:12 | finished: 0
2020-03-11 07:51:12 | results_file: /tmp/.ansible_async/501458712500.73277
2020-03-11 07:51:12 | started: 1
2020-03-11 07:51:12 | finished: 1
2020-03-11 07:51:12 | msg: Can't run container nova_migration_target
2020-03-11 07:51:12 | stderr: |-
2020-03-11 07:51:12 | Error: error checking path "/run/libvirt": stat /run/libvirt: no such file or directory
2020-03-11 07:51:12 | stderr_lines: <omitted>
2020-03-11 07:51:12 | stdout: ''
2020-03-11 07:51:12 | stdout_lines: <omitted>
It was also coming on CentOS-7 job. The job was in non-voting from long time. It was failing from long time. It is a tracker bug so that, we can work together to get it fixed.
Probably linked to the removal of libvirt-related packages from the host. We might need to create it manually, using the tmpfile systemd service, that will ensure it's present even after a reboot.
Or we might move that /run/libvirt in some other location, since we don't share anything with the host now - the socket(s) are shared between containers only...