2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ceilometer-compute-agent. 2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T08:03:31+01:00 systemd[1]: Starting Service for snap application openstack-hypervisor.ovsdb-server... 2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.virtlogd. 2024-04-23T08:03:35+01:00 openstack-hypervisor.virtlogd[2923]: update.go:85: cannot change mount namespace according to change mount (/var/lib/snapd/hostfs/boot /boot none bind,ro 0 0): permission denied 2024-04-23T08:03:39+01:00 -[2329]: libvirt version: 8.0.0 2024-04-23T08:03:39+01:00 -[2329]: hostname: mz640 2024-04-23T08:03:39+01:00 -[2329]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:03:39+01:00 openstack-hypervisor.ovsdb-server[3707]: * Starting ovsdb-server 2024-04-23T08:03:39+01:00 ovs-vsctl[4022]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- init -- set Open_vSwitch . db-version=8.4.0 2024-04-23T08:03:39+01:00 ovs-vsctl[4249]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait set Open_vSwitch . ovs-version=3.2.0 "external-ids:system-id=\"mz640\"" "external-ids:rundir=\"/var/snap/openstack-hypervisor/common/run/openvswitch\"" "system-type=\"ubuntu-core\"" "system-version=\"22\"" 2024-04-23T08:03:39+01:00 openstack-hypervisor.ovsdb-server[3707]: * Configuring Open vSwitch system IDs 2024-04-23T08:03:39+01:00 ovs-vsctl[4259]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait add Open_vSwitch . external-ids hostname=mz640 2024-04-23T08:03:39+01:00 openstack-hypervisor.ovsdb-server[3707]: * Enabling remote OVSDB managers 2024-04-23T08:03:40+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ovsdb-server. 2024-04-23T08:03:40+01:00 systemd[1]: Starting Service for snap application openstack-hypervisor.ovs-vswitchd... 2024-04-23T08:03:40+01:00 openstack-hypervisor.ovs-vswitchd[4275]: * Starting ovs-vswitchd 2024-04-23T08:03:40+01:00 ovs-vsctl[4511]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait add Open_vSwitch . external-ids hostname=mz640 2024-04-23T08:03:40+01:00 openstack-hypervisor.ovs-vswitchd[4275]: * Enabling remote OVSDB managers 2024-04-23T08:03:40+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ovs-vswitchd. 2024-04-23T08:03:40+01:00 systemd[1]: Starting Service for snap application openstack-hypervisor.ovn-controller... 2024-04-23T08:03:40+01:00 openstack-hypervisor.ovn-controller[4515]: * Starting ovn-controller 2024-04-23T08:03:40+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ovn-controller. 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.533 5199 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.544 5199 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.544 5199 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils yield 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils self.run() 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils 2024-04-23T08:03:45+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:45.002 3691 INFO cotyledon._service_manager [-] Child 5199 exited with status 2 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.027 5203 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.030 5203 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.031 5203 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils yield 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils self.run() 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils 2024-04-23T08:03:45+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:45.351 3691 INFO cotyledon._service_manager [-] Child 5203 exited with status 2 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:45.352 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:03:47+01:00 nova-api-metadata[3690]: 2024-04-23 08:03:47.491 3690 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T08:03:47+01:00 nova-api-metadata[3690]: 2024-04-23 08:03:47.729 3690 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T08:03:47+01:00 nova-api-metadata[3690]: 2024-04-23 08:03:47.730 3690 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T08:03:48+01:00 nova-compute[3689]: 2024-04-23 08:03:48.452 3689 INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs 2024-04-23T08:03:48+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:03:48.779 3688 INFO neutron.common.config [-] Logging enabled! 2024-04-23T08:03:48+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:03:48.780 3688 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T08:03:49+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:03:49.000 3688 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T08:03:49+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:03:49.000 3688 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T08:03:49+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:03:49.011 3688 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.365 5701 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.369 5701 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.370 5701 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils yield 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils self.run() 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils 2024-04-23T08:03:50+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:50.711 3691 INFO cotyledon._service_manager [-] Child 5701 exited with status 2 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:50.721 5833 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:50.725 5833 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:50.726 5833 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils yield 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils self.run() 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils 2024-04-23T08:03:51+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:51.056 3691 INFO cotyledon._service_manager [-] Child 5833 exited with status 2 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:51.057 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:03:52+01:00 nova-api-metadata[5265]: 2024-04-23 08:03:52.774 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 1.0 seconds): TimeoutError: timed out 2024-04-23T08:03:52+01:00 nova-api-metadata[5262]: 2024-04-23 08:03:52.774 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 1.0 seconds): TimeoutError: timed out 2024-04-23T08:03:52+01:00 nova-api-metadata[5264]: 2024-04-23 08:03:52.774 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 1.0 seconds): TimeoutError: timed out 2024-04-23T08:03:52+01:00 nova-api-metadata[5263]: 2024-04-23 08:03:52.774 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 1.0 seconds): TimeoutError: timed out 2024-04-23T08:03:54+01:00 nova-compute[3689]: 2024-04-23 08:03:54.226 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 1.0 seconds): TimeoutError: timed out 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.069 7929 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.072 7929 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.073 7929 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils yield 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils self.run() 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils 2024-04-23T08:03:56+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:56.382 3691 INFO cotyledon._service_manager [-] Child 7929 exited with status 2 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.392 7988 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.396 7988 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.396 7988 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils yield 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils self.run() 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils 2024-04-23T08:03:56+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:56.712 3691 INFO cotyledon._service_manager [-] Child 7988 exited with status 2 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:56.713 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:03:58+01:00 nova-api-metadata[5265]: 2024-04-23 08:03:58.786 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 3.0 seconds): TimeoutError: timed out 2024-04-23T08:03:58+01:00 nova-api-metadata[5262]: 2024-04-23 08:03:58.789 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 3.0 seconds): TimeoutError: timed out 2024-04-23T08:03:58+01:00 nova-api-metadata[5264]: 2024-04-23 08:03:58.791 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 3.0 seconds): TimeoutError: timed out 2024-04-23T08:03:58+01:00 nova-api-metadata[5263]: 2024-04-23 08:03:58.795 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 3.0 seconds): TimeoutError: timed out 2024-04-23T08:04:00+01:00 nova-compute[3689]: 2024-04-23 08:04:00.234 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 3.0 seconds): TimeoutError: timed out 2024-04-23T08:04:01+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:01.725 10057 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:01+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:01.729 10057 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:01+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:01.730 10057 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils yield 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils self.run() 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils 2024-04-23T08:04:02+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:02.046 3691 INFO cotyledon._service_manager [-] Child 10057 exited with status 2 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.054 10307 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.057 10307 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.058 10307 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils yield 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils self.run() 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils 2024-04-23T08:04:02+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:02.362 3691 INFO cotyledon._service_manager [-] Child 10307 exited with status 2 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:02.363 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:04:06+01:00 nova-api-metadata[5265]: 2024-04-23 08:04:06.793 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 5.0 seconds): TimeoutError: timed out 2024-04-23T08:04:06+01:00 nova-api-metadata[5262]: 2024-04-23 08:04:06.797 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 5.0 seconds): TimeoutError: timed out 2024-04-23T08:04:06+01:00 nova-api-metadata[5264]: 2024-04-23 08:04:06.797 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 5.0 seconds): TimeoutError: timed out 2024-04-23T08:04:06+01:00 nova-api-metadata[5263]: 2024-04-23 08:04:06.805 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 5.0 seconds): TimeoutError: timed out 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.373 11317 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.377 11317 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.378 11317 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils yield 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils self.run() 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils 2024-04-23T08:04:07+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:07.690 3691 INFO cotyledon._service_manager [-] Child 11317 exited with status 2 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:07.699 11362 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:07.703 11362 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:07.703 11362 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils yield 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils self.run() 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils 2024-04-23T08:04:08+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:08.019 3691 INFO cotyledon._service_manager [-] Child 11362 exited with status 2 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:08.020 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:04:08+01:00 nova-compute[3689]: 2024-04-23 08:04:08.241 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 5.0 seconds): TimeoutError: timed out 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.034 13424 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.038 13424 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.039 13424 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils yield 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils self.run() 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils 2024-04-23T08:04:13+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:13.360 3691 INFO cotyledon._service_manager [-] Child 13424 exited with status 2 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.373 13566 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.378 13566 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.378 13566 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils yield 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils self.run() 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils 2024-04-23T08:04:13+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:13.718 3691 INFO cotyledon._service_manager [-] Child 13566 exited with status 2 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:13.719 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:04:16+01:00 nova-api-metadata[5265]: 2024-04-23 08:04:16.801 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 7.0 seconds): TimeoutError: timed out 2024-04-23T08:04:16+01:00 nova-api-metadata[5262]: 2024-04-23 08:04:16.805 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 7.0 seconds): TimeoutError: timed out 2024-04-23T08:04:16+01:00 nova-api-metadata[5264]: 2024-04-23 08:04:16.805 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 7.0 seconds): TimeoutError: timed out 2024-04-23T08:04:16+01:00 nova-api-metadata[5263]: 2024-04-23 08:04:16.821 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 7.0 seconds): TimeoutError: timed out 2024-04-23T08:04:18+01:00 nova-compute[3689]: 2024-04-23 08:04:18.250 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 7.0 seconds): TimeoutError: timed out 2024-04-23T08:04:18+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:18.731 16436 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:18+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:18.734 16436 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:18+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:18.735 16436 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils yield 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils self.run() 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils 2024-04-23T08:04:19+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:19.050 3691 INFO cotyledon._service_manager [-] Child 16436 exited with status 2 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.059 16484 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.064 16484 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.065 16484 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils yield 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils self.run() 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils 2024-04-23T08:04:19+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:19.384 3691 INFO cotyledon._service_manager [-] Child 16484 exited with status 2 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:19.385 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:04:20+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.ceilometer-compute-agent... 2024-04-23T08:04:20+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:20.831 3691 INFO cotyledon._service_manager [-] Caught SIGTERM signal, graceful exiting of master process 2024-04-23T08:04:24+01:00 openstack-hypervisor.ceilometer-compute-agent[17631]: 2024-04-23 08:04:24.398 17631 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:24+01:00 openstack-hypervisor.ceilometer-compute-agent[17631]: 2024-04-23 08:04:24.402 17631 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:24+01:00 openstack-hypervisor.ceilometer-compute-agent[17631]: 2024-04-23 08:04:24.403 17631 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:24+01:00 openstack-hypervisor.ceilometer-compute-agent[17631]: 2024-04-23 08:04:24.715 17631 INFO cotyledon._service [-] Caught SIGTERM signal, graceful exiting of service AgentManager(0) [17631] 2024-04-23T08:04:24+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:25+01:00 systemd[1]: snap.openstack-hypervisor.ceilometer-compute-agent.service: Deactivated successfully. 2024-04-23T08:04:25+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.ceilometer-compute-agent. 2024-04-23T08:04:28+01:00 nova-api-metadata[5265]: 2024-04-23 08:04:28.814 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 9.0 seconds): TimeoutError: timed out 2024-04-23T08:04:28+01:00 nova-api-metadata[5264]: 2024-04-23 08:04:28.817 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 9.0 seconds): TimeoutError: timed out 2024-04-23T08:04:28+01:00 nova-api-metadata[5262]: 2024-04-23 08:04:28.817 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 9.0 seconds): TimeoutError: timed out 2024-04-23T08:04:28+01:00 nova-api-metadata[5263]: 2024-04-23 08:04:28.835 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 9.0 seconds): TimeoutError: timed out 2024-04-23T08:04:30+01:00 nova-compute[3689]: 2024-04-23 08:04:30.266 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 9.0 seconds): TimeoutError: timed out 2024-04-23T08:04:42+01:00 nova-api-metadata[5265]: 2024-04-23 08:04:42.829 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 11.0 seconds): TimeoutError: timed out 2024-04-23T08:04:42+01:00 nova-api-metadata[5264]: 2024-04-23 08:04:42.833 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 11.0 seconds): TimeoutError: timed out 2024-04-23T08:04:42+01:00 nova-api-metadata[5262]: 2024-04-23 08:04:42.834 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 11.0 seconds): TimeoutError: timed out 2024-04-23T08:04:42+01:00 nova-api-metadata[5263]: 2024-04-23 08:04:42.849 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 11.0 seconds): TimeoutError: timed out 2024-04-23T08:04:44+01:00 nova-compute[3689]: 2024-04-23 08:04:44.281 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 11.0 seconds): TimeoutError: timed out 2024-04-23T08:04:58+01:00 nova-api-metadata[5265]: 2024-04-23 08:04:58.846 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 13.0 seconds): TimeoutError: timed out 2024-04-23T08:04:58+01:00 nova-api-metadata[5262]: 2024-04-23 08:04:58.849 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 13.0 seconds): TimeoutError: timed out 2024-04-23T08:04:58+01:00 nova-api-metadata[5264]: 2024-04-23 08:04:58.850 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 13.0 seconds): TimeoutError: timed out 2024-04-23T08:04:58+01:00 nova-api-metadata[5263]: 2024-04-23 08:04:58.865 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 13.0 seconds): TimeoutError: timed out 2024-04-23T08:05:00+01:00 nova-compute[3689]: 2024-04-23 08:05:00.297 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 13.0 seconds): TimeoutError: timed out 2024-04-23T08:05:16+01:00 nova-api-metadata[5264]: 2024-04-23 08:05:16.866 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 15.0 seconds): TimeoutError: timed out 2024-04-23T08:05:16+01:00 nova-api-metadata[5265]: 2024-04-23 08:05:16.866 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 15.0 seconds): TimeoutError: timed out 2024-04-23T08:05:16+01:00 nova-api-metadata[5262]: 2024-04-23 08:05:16.869 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 15.0 seconds): TimeoutError: timed out 2024-04-23T08:05:16+01:00 nova-api-metadata[5263]: 2024-04-23 08:05:16.885 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 15.0 seconds): TimeoutError: timed out 2024-04-23T08:05:18+01:00 nova-compute[3689]: 2024-04-23 08:05:18.313 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 15.0 seconds): TimeoutError: timed out 2024-04-23T08:05:36+01:00 nova-api-metadata[5264]: 2024-04-23 08:05:36.885 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 17.0 seconds): TimeoutError: timed out 2024-04-23T08:05:36+01:00 nova-api-metadata[5265]: 2024-04-23 08:05:36.885 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 17.0 seconds): TimeoutError: timed out 2024-04-23T08:05:36+01:00 nova-api-metadata[5262]: 2024-04-23 08:05:36.889 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 17.0 seconds): TimeoutError: timed out 2024-04-23T08:05:36+01:00 nova-api-metadata[5263]: 2024-04-23 08:05:36.912 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 17.0 seconds): TimeoutError: timed out 2024-04-23T08:05:38+01:00 nova-compute[3689]: 2024-04-23 08:05:38.335 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 17.0 seconds): TimeoutError: timed out 2024-04-23T08:05:58+01:00 nova-api-metadata[5264]: 2024-04-23 08:05:58.908 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 19.0 seconds): TimeoutError: timed out 2024-04-23T08:05:58+01:00 nova-api-metadata[5262]: 2024-04-23 08:05:58.909 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 19.0 seconds): TimeoutError: timed out 2024-04-23T08:05:58+01:00 nova-api-metadata[5265]: 2024-04-23 08:05:58.909 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 19.0 seconds): TimeoutError: timed out 2024-04-23T08:05:58+01:00 nova-api-metadata[5263]: 2024-04-23 08:05:58.936 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 19.0 seconds): TimeoutError: timed out 2024-04-23T08:06:00+01:00 nova-compute[3689]: 2024-04-23 08:06:00.354 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 19.0 seconds): TimeoutError: timed out 2024-04-23T08:06:03+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:06:03.740 3688 ERROR ovsdbapp.backend.ovs_idl.idlutils [-] Unable to open stream to ssl:10.20.21.10:6642 to retrieve schema: Exec format error 2024-04-23T08:06:22+01:00 nova-api-metadata[5264]: 2024-04-23 08:06:22.930 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 21.0 seconds): TimeoutError: timed out 2024-04-23T08:06:22+01:00 nova-api-metadata[5262]: 2024-04-23 08:06:22.931 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 21.0 seconds): TimeoutError: timed out 2024-04-23T08:06:22+01:00 nova-api-metadata[5265]: 2024-04-23 08:06:22.933 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 21.0 seconds): TimeoutError: timed out 2024-04-23T08:06:22+01:00 nova-api-metadata[5263]: 2024-04-23 08:06:22.958 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 21.0 seconds): TimeoutError: timed out 2024-04-23T08:06:24+01:00 nova-compute[3689]: 2024-04-23 08:06:24.375 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 21.0 seconds): TimeoutError: timed out 2024-04-23T08:06:48+01:00 nova-api-metadata[5264]: 2024-04-23 08:06:48.953 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 23.0 seconds): TimeoutError: timed out 2024-04-23T08:06:48+01:00 nova-api-metadata[5262]: 2024-04-23 08:06:48.961 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 23.0 seconds): TimeoutError: timed out 2024-04-23T08:06:48+01:00 nova-api-metadata[5265]: 2024-04-23 08:06:48.961 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 23.0 seconds): TimeoutError: timed out 2024-04-23T08:06:48+01:00 nova-api-metadata[5263]: 2024-04-23 08:06:48.984 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 23.0 seconds): TimeoutError: timed out 2024-04-23T08:06:50+01:00 nova-compute[3689]: 2024-04-23 08:06:50.401 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 23.0 seconds): TimeoutError: timed out 2024-04-23T08:07:17+01:00 nova-api-metadata[5265]: 2024-04-23 08:07:17.009 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 25.0 seconds): TimeoutError: timed out 2024-04-23T08:07:17+01:00 nova-api-metadata[5264]: 2024-04-23 08:07:17.012 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 25.0 seconds): TimeoutError: timed out 2024-04-23T08:07:17+01:00 nova-api-metadata[5262]: 2024-04-23 08:07:17.022 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 25.0 seconds): TimeoutError: timed out 2024-04-23T08:07:17+01:00 nova-api-metadata[5263]: 2024-04-23 08:07:17.050 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 25.0 seconds): TimeoutError: timed out 2024-04-23T08:07:18+01:00 nova-compute[3689]: 2024-04-23 08:07:18.513 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 25.0 seconds): TimeoutError: timed out 2024-04-23T08:07:47+01:00 nova-api-metadata[5264]: 2024-04-23 08:07:47.045 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 27.0 seconds): TimeoutError: timed out 2024-04-23T08:07:47+01:00 nova-api-metadata[5265]: 2024-04-23 08:07:47.047 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 27.0 seconds): TimeoutError: timed out 2024-04-23T08:07:47+01:00 nova-api-metadata[5262]: 2024-04-23 08:07:47.065 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 27.0 seconds): TimeoutError: timed out 2024-04-23T08:07:47+01:00 nova-api-metadata[5263]: 2024-04-23 08:07:47.088 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 27.0 seconds): TimeoutError: timed out 2024-04-23T08:07:48+01:00 nova-compute[3689]: 2024-04-23 08:07:48.548 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 27.0 seconds): TimeoutError: timed out 2024-04-23T08:07:53+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent... 2024-04-23T08:07:53+01:00 systemd[1]: snap.openstack-hypervisor.neutron-ovn-metadata-agent.service: Deactivated successfully. 2024-04-23T08:07:53+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:07:55+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:07:55+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-compute... 2024-04-23T08:07:55+01:00 systemd[1]: snap.openstack-hypervisor.nova-compute.service: Deactivated successfully. 2024-04-23T08:07:55+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T08:07:57+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T08:07:58+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-api-metadata... 2024-04-23T08:07:58+01:00 nova-api-metadata[5262]: 2024-04-23 08:07:58.098 5262 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T08:07:58+01:00 nova-api-metadata[5265]: 2024-04-23 08:07:58.099 5265 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T08:07:58+01:00 nova-api-metadata[5263]: 2024-04-23 08:07:58.099 5263 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.103 3690 INFO oslo_service.service [-] Caught SIGTERM, stopping children 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.105 3690 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.105 3690 INFO oslo_service.service [-] Waiting on 4 children to exit 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.106 3690 INFO oslo_service.service [-] Child 5262 exited with status 0 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.106 3690 INFO oslo_service.service [-] Child 5264 killed by signal 15 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.106 3690 INFO oslo_service.service [-] Child 5265 killed by signal 15 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.108 3690 INFO oslo_service.service [-] Child 5263 killed by signal 15 2024-04-23T08:07:58+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Deactivated successfully. 2024-04-23T08:07:58+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T08:07:59+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T08:08:03+01:00 neutron-ovn-metadata-agent[73186]: 2024-04-23 08:08:03.242 73186 INFO neutron.common.config [-] Logging enabled! 2024-04-23T08:08:03+01:00 neutron-ovn-metadata-agent[73186]: 2024-04-23 08:08:03.243 73186 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T08:08:03+01:00 neutron-ovn-metadata-agent[73186]: 2024-04-23 08:08:03.266 73186 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T08:08:03+01:00 neutron-ovn-metadata-agent[73186]: 2024-04-23 08:08:03.267 73186 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T08:08:03+01:00 neutron-ovn-metadata-agent[73186]: 2024-04-23 08:08:03.277 73186 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T08:08:05+01:00 nova-compute[73270]: 2024-04-23 08:08:05.619 73270 INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs 2024-04-23T08:08:06+01:00 nova-compute[73270]: 2024-04-23 08:08:06.262 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:07+01:00 nova-api-metadata[73458]: 2024-04-23 08:08:07.000 73458 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T08:08:07+01:00 nova-api-metadata[73458]: 2024-04-23 08:08:07.202 73458 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T08:08:07+01:00 nova-api-metadata[73458]: 2024-04-23 08:08:07.203 73458 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T08:08:07+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:07.242 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:07+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:07.242 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:07+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:07.246 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:07+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:07.246 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:07+01:00 nova-compute[73270]: 2024-04-23 08:08:07.266 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:08+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:08.248 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:08+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:08.250 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:08+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:08.252 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:08+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:08.254 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:10+01:00 nova-compute[73270]: 2024-04-23 08:08:10.270 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:11+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:11.252 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:11+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:11.255 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:11+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:11.257 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:11+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:11.258 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:15+01:00 nova-compute[73270]: 2024-04-23 08:08:15.274 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:16+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:16.258 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:16+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:16.260 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:16+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:16.262 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:16+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:16.263 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:22+01:00 nova-compute[73270]: 2024-04-23 08:08:22.280 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:23+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:23.266 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:23+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:23.267 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:23+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:23.270 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:23+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:23.271 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:31+01:00 nova-compute[73270]: 2024-04-23 08:08:31.290 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:32+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:32.276 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:32+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:32.277 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:32+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:32.279 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:32+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:32.281 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:42+01:00 nova-compute[73270]: 2024-04-23 08:08:42.300 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:43+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:43.289 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:43+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:43.289 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:43+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:43.290 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:43+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:43.292 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:55+01:00 nova-compute[73270]: 2024-04-23 08:08:55.310 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:56+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:56.302 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:56+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:56.303 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:56+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:56.304 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:56+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:56.304 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:56+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent... 2024-04-23T08:08:56+01:00 systemd[1]: snap.openstack-hypervisor.neutron-ovn-metadata-agent.service: Deactivated successfully. 2024-04-23T08:08:56+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:08:58+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.372 77543 INFO neutron.common.config [-] Logging enabled! 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.373 77543 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.396 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.396 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.407 77543 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.438 77543 INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.443 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connecting... 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.452 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connected 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.470 77543 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.namespace_cmd', '--privsep_sock_path', '/tmp/tmpe7nt6kl5/privsep.sock'] 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.471 77543 INFO eventlet.wsgi.server [-] (77543) wsgi starting up on http:/var/snap/openstack-hypervisor/common/lib/metadata_proxy 2024-04-23T08:09:08+01:00 privsep-helper[78185]: 2024-04-23 08:09:08.132 78185 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:09:08+01:00 privsep-helper[78185]: 2024-04-23 08:09:08.139 78185 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:09:08+01:00 privsep-helper[78185]: 2024-04-23 08:09:08.142 78185 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:09:08+01:00 privsep-helper[78185]: 2024-04-23 08:09:08.143 78185 INFO oslo.privsep.daemon [-] privsep daemon running as pid 78185 2024-04-23T08:09:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:08.271 77543 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T08:09:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:08.132 78185 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:09:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:08.139 78185 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:09:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:08.142 78185 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:09:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:08.143 78185 INFO oslo.privsep.daemon [-] privsep daemon running as pid 78185 2024-04-23T08:09:10+01:00 nova-compute[73270]: 2024-04-23 08:09:10.324 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:11+01:00 nova-api-metadata[73985]: 2024-04-23 08:09:11.317 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:11+01:00 nova-api-metadata[73986]: 2024-04-23 08:09:11.318 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:11+01:00 nova-api-metadata[73987]: 2024-04-23 08:09:11.319 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:11+01:00 nova-api-metadata[73984]: 2024-04-23 08:09:11.324 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:12+01:00 privsep-helper[78185]: 2024-04-23 08:09:12.896 78185 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:09:12+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:12.896 78185 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:09:27+01:00 nova-compute[73270]: 2024-04-23 08:09:27.338 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:28+01:00 nova-api-metadata[73985]: 2024-04-23 08:09:28.334 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:28+01:00 nova-api-metadata[73986]: 2024-04-23 08:09:28.336 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:28+01:00 nova-api-metadata[73987]: 2024-04-23 08:09:28.337 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:28+01:00 nova-api-metadata[73984]: 2024-04-23 08:09:28.338 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:46+01:00 nova-compute[73270]: 2024-04-23 08:09:46.356 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:47+01:00 nova-api-metadata[73985]: 2024-04-23 08:09:47.354 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:47+01:00 nova-api-metadata[73986]: 2024-04-23 08:09:47.354 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:47+01:00 nova-api-metadata[73987]: 2024-04-23 08:09:47.355 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:47+01:00 nova-api-metadata[73984]: 2024-04-23 08:09:47.356 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:07+01:00 nova-compute[73270]: 2024-04-23 08:10:07.373 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:08+01:00 nova-api-metadata[73984]: 2024-04-23 08:10:08.375 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:08+01:00 nova-api-metadata[73986]: 2024-04-23 08:10:08.375 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:08+01:00 nova-api-metadata[73987]: 2024-04-23 08:10:08.377 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:08+01:00 nova-api-metadata[73985]: 2024-04-23 08:10:08.377 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:30+01:00 nova-compute[73270]: 2024-04-23 08:10:30.394 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:31+01:00 nova-api-metadata[73984]: 2024-04-23 08:10:31.394 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:31+01:00 nova-api-metadata[73986]: 2024-04-23 08:10:31.398 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:31+01:00 nova-api-metadata[73985]: 2024-04-23 08:10:31.400 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:31+01:00 nova-api-metadata[73987]: 2024-04-23 08:10:31.400 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:55+01:00 nova-compute[73270]: 2024-04-23 08:10:55.416 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:56+01:00 nova-api-metadata[73984]: 2024-04-23 08:10:56.417 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:56+01:00 nova-api-metadata[73987]: 2024-04-23 08:10:56.423 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:56+01:00 nova-api-metadata[73986]: 2024-04-23 08:10:56.423 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:56+01:00 nova-api-metadata[73985]: 2024-04-23 08:10:56.425 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:22+01:00 nova-compute[73270]: 2024-04-23 08:11:22.440 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:23+01:00 nova-api-metadata[73984]: 2024-04-23 08:11:23.445 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:23+01:00 nova-api-metadata[73987]: 2024-04-23 08:11:23.447 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:23+01:00 nova-api-metadata[73985]: 2024-04-23 08:11:23.448 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:23+01:00 nova-api-metadata[73986]: 2024-04-23 08:11:23.448 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:51+01:00 nova-compute[73270]: 2024-04-23 08:11:51.469 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:52+01:00 nova-api-metadata[73984]: 2024-04-23 08:11:52.473 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:52+01:00 nova-api-metadata[73987]: 2024-04-23 08:11:52.476 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:52+01:00 nova-api-metadata[73986]: 2024-04-23 08:11:52.477 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:52+01:00 nova-api-metadata[73985]: 2024-04-23 08:11:52.478 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:12:07+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:12:07.662 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connection closed by peer 2024-04-23T08:12:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:12:08.670 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connecting... 2024-04-23T08:12:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:12:08.687 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connected 2024-04-23T08:12:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:12:08.703 77543 INFO neutron.agent.ovn.metadata.agent [-] Connection to OVSDB established, doing a full sync 2024-04-23T08:12:23+01:00 nova-api-metadata[73984]: 2024-04-23 08:12:23.582 73984 INFO nova.metadata.wsgi.server [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] (73984) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:12:23+01:00 nova-api-metadata[73985]: 2024-04-23 08:12:23.615 73985 INFO nova.metadata.wsgi.server [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] (73985) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:12:23+01:00 nova-api-metadata[73987]: 2024-04-23 08:12:23.628 73987 INFO nova.metadata.wsgi.server [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] (73987) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:12:23+01:00 nova-api-metadata[73986]: 2024-04-23 08:12:23.645 73986 INFO nova.metadata.wsgi.server [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] (73986) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:12:23+01:00 nova-compute[73270]: 2024-04-23 08:12:23.736 73270 INFO nova.virt.driver [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Loading compute driver 'libvirt.LibvirtDriver' 2024-04-23T08:12:24+01:00 nova-compute[73270]: 2024-04-23 08:12:24.598 73270 INFO nova.compute.provider_config [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. 2024-04-23T08:12:24+01:00 nova-compute[73270]: 2024-04-23 08:12:24.648 73270 INFO nova.service [-] Starting compute node (version 28.0.0) 2024-04-23T08:12:24+01:00 nova-compute[73270]: 2024-04-23 08:12:24.665 73270 INFO nova.virt.node [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] Determined node identity 1abf047e-3df5-4ce9-9e86-4ad5779eafe4 from /var/snap/openstack-hypervisor/common/lib/nova/compute_id 2024-04-23T08:12:24+01:00 nova-compute[73270]: 2024-04-23 08:12:24.685 73270 INFO nova.virt.libvirt.driver [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] Connection event '1' reason 'None' 2024-04-23T08:12:24+01:00 -[2329]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:12:24+01:00 -[2329]: Failed to get host power management capabilities 2024-04-23T08:12:26+01:00 nova-compute[73270]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T08:12:26+01:00 -[2329]: invalid argument: KVM is not supported by '/snap/openstack-hypervisor/123/usr/bin/qemu-system-aarch64' on this host 2024-04-23T08:12:26+01:00 nova-compute[73270]: 2024-04-23 08:12:26.567 73270 INFO nova.virt.libvirt.host [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] Secure Boot support detected 2024-04-23T08:12:26+01:00 nova-compute[73270]: 2024-04-23 08:12:26.652 73270 INFO nova.virt.node [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] Determined node identity 1abf047e-3df5-4ce9-9e86-4ad5779eafe4 from /var/snap/openstack-hypervisor/common/lib/nova/compute_id 2024-04-23T08:12:26+01:00 nova-compute[73270]: 2024-04-23 08:12:26.748 73270 INFO nova.compute.manager [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host 2024-04-23T08:12:32+01:00 nova-compute[73270]: 2024-04-23 08:12:32.658 73270 INFO nova.virt.libvirt.host [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] kernel doesn't support AMD SEV 2024-04-23T08:12:54+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-api-metadata... 2024-04-23T08:12:54+01:00 nova-api-metadata[73987]: 2024-04-23 08:12:54.976 73987 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T08:13:24+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: State 'final-sigterm' timed out. Killing. 2024-04-23T08:13:24+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Killing process 73458 (python3) with signal SIGKILL. 2024-04-23T08:13:24+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Failed with result 'timeout'. 2024-04-23T08:13:24+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Unit process 73458 (python3) remains running after unit stopped. 2024-04-23T08:13:24+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T08:13:26+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T08:13:27+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent... 2024-04-23T08:13:27+01:00 systemd[1]: snap.openstack-hypervisor.neutron-ovn-metadata-agent.service: Deactivated successfully. 2024-04-23T08:13:27+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:13:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:13:33+01:00 nova-api-metadata[109004]: 2024-04-23 08:13:33.653 109004 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T08:13:33+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-compute... 2024-04-23T08:13:33+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:13:33+01:00 systemd[1]: snap.openstack-hypervisor.nova-compute.service: Deactivated successfully. 2024-04-23T08:13:33+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T08:13:33+01:00 nova-api-metadata[109004]: 2024-04-23 08:13:33.862 109004 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T08:13:33+01:00 nova-api-metadata[109004]: 2024-04-23 08:13:33.863 109004 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T08:13:33+01:00 nova-api-metadata[109216]: 2024-04-23 08:13:33.941 109216 INFO nova.metadata.wsgi.server [None req-c3fe50da-e02f-4e9a-acb2-2673c3d322a3 - - - - - -] (109216) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:13:33+01:00 nova-api-metadata[109215]: 2024-04-23 08:13:33.952 109215 INFO nova.metadata.wsgi.server [None req-90a78731-a84e-45f5-86f3-c0916e9824f9 - - - - - -] (109215) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:13:33+01:00 nova-api-metadata[109217]: 2024-04-23 08:13:33.952 109217 INFO nova.metadata.wsgi.server [None req-09326c72-370f-493d-bc59-02e907ef4ff7 - - - - - -] (109217) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:13:33+01:00 nova-api-metadata[109218]: 2024-04-23 08:13:33.952 109218 INFO nova.metadata.wsgi.server [None req-f448e1bf-58f8-4512-937f-018da708ae26 - - - - - -] (109218) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:13:35+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.795 109200 INFO neutron.common.config [-] Logging enabled! 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.796 109200 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.819 109200 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.820 109200 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.830 109200 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.863 109200 INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.870 109200 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connecting... 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.879 109200 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connected 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.899 109200 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.namespace_cmd', '--privsep_sock_path', '/tmp/tmp3k7glpx8/privsep.sock'] 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.900 109200 INFO eventlet.wsgi.server [-] (109200) wsgi starting up on http:/var/snap/openstack-hypervisor/common/lib/metadata_proxy 2024-04-23T08:13:41+01:00 privsep-helper[109688]: 2024-04-23 08:13:41.560 109688 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:13:41+01:00 privsep-helper[109688]: 2024-04-23 08:13:41.568 109688 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:13:41+01:00 privsep-helper[109688]: 2024-04-23 08:13:41.572 109688 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:13:41+01:00 privsep-helper[109688]: 2024-04-23 08:13:41.572 109688 INFO oslo.privsep.daemon [-] privsep daemon running as pid 109688 2024-04-23T08:13:41+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:41.703 109200 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T08:13:41+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:41.560 109688 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:13:41+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:41.568 109688 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:13:41+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:41.572 109688 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:13:41+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:41.572 109688 INFO oslo.privsep.daemon [-] privsep daemon running as pid 109688 2024-04-23T08:13:43+01:00 nova-compute[109453]: 2024-04-23 08:13:43.640 109453 INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.071 109453 INFO nova.virt.driver [None req-69469530-2fb2-4748-90a5-95976ac3c036 - - - - - -] Loading compute driver 'libvirt.LibvirtDriver' 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.737 109453 INFO nova.compute.provider_config [None req-69469530-2fb2-4748-90a5-95976ac3c036 - - - - - -] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.778 109453 INFO nova.service [-] Starting compute node (version 28.0.0) 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.797 109453 INFO nova.virt.node [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] Determined node identity 1abf047e-3df5-4ce9-9e86-4ad5779eafe4 from /var/snap/openstack-hypervisor/common/lib/nova/compute_id 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.809 109453 INFO nova.virt.libvirt.driver [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] Connection event '1' reason 'None' 2024-04-23T08:13:45+01:00 -[2329]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:13:45+01:00 -[2329]: Failed to get host power management capabilities 2024-04-23T08:13:45+01:00 nova-compute[109453]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T08:13:45+01:00 -[2329]: invalid argument: KVM is not supported by '/snap/openstack-hypervisor/123/usr/bin/qemu-system-aarch64' on this host 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.872 109453 INFO nova.virt.libvirt.host [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] Secure Boot support detected 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.927 109453 INFO nova.virt.node [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] Determined node identity 1abf047e-3df5-4ce9-9e86-4ad5779eafe4 from /var/snap/openstack-hypervisor/common/lib/nova/compute_id 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.987 109453 INFO nova.compute.manager [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host 2024-04-23T08:13:46+01:00 privsep-helper[109688]: 2024-04-23 08:13:46.247 109688 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:13:46+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:46.247 109688 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:13:48+01:00 nova-compute[109453]: 2024-04-23 08:13:48.603 109453 INFO nova.virt.libvirt.host [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] kernel doesn't support AMD SEV 2024-04-23T08:14:31+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent... 2024-04-23T08:14:31+01:00 systemd[1]: snap.openstack-hypervisor.neutron-ovn-metadata-agent.service: Deactivated successfully. 2024-04-23T08:14:31+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:14:33+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.586 112632 INFO neutron.common.config [-] Logging enabled! 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.587 112632 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.610 112632 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.611 112632 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.622 112632 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.653 112632 INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.660 112632 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.20.21.10:6642: connecting... 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.668 112632 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.20.21.10:6642: connected 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.688 112632 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.namespace_cmd', '--privsep_sock_path', '/tmp/tmpxn_zcfg3/privsep.sock'] 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.690 112632 INFO eventlet.wsgi.server [-] (112632) wsgi starting up on http:/var/snap/openstack-hypervisor/common/lib/metadata_proxy 2024-04-23T08:14:43+01:00 privsep-helper[113041]: 2024-04-23 08:14:43.366 113041 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:14:43+01:00 privsep-helper[113041]: 2024-04-23 08:14:43.373 113041 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:14:43+01:00 privsep-helper[113041]: 2024-04-23 08:14:43.377 113041 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:14:43+01:00 privsep-helper[113041]: 2024-04-23 08:14:43.378 113041 INFO oslo.privsep.daemon [-] privsep daemon running as pid 113041 2024-04-23T08:14:43+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:43.511 112632 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T08:14:43+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:43.366 113041 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:14:43+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:43.373 113041 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:14:43+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:43.377 113041 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:14:43+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:43.378 113041 INFO oslo.privsep.daemon [-] privsep daemon running as pid 113041 2024-04-23T08:14:48+01:00 privsep-helper[113041]: 2024-04-23 08:14:48.060 113041 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:14:48+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:48.060 113041 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:53:44+01:00 nova-compute[109453]: 2024-04-23 08:53:44.320 109453 WARNING nova.virt.libvirt.imagecache [None req-1c6ec8dc-f1f3-4642-a992-5c4d8bbc5738 - - - - - -] Unknown base file: /var/snap/openstack-hypervisor/common/lib/nova/instances/_base/10196b30b7d57e26216b8dbf13f03153701aeecc 2024-04-23T08:53:44+01:00 nova-compute[109453]: 2024-04-23 08:53:44.322 109453 INFO nova.virt.libvirt.imagecache [None req-1c6ec8dc-f1f3-4642-a992-5c4d8bbc5738 - - - - - -] Removable base files: /var/snap/openstack-hypervisor/common/lib/nova/instances/_base/10196b30b7d57e26216b8dbf13f03153701aeecc 2024-04-23T08:53:44+01:00 nova-compute[109453]: 2024-04-23 08:53:44.323 109453 INFO nova.virt.libvirt.imagecache [None req-1c6ec8dc-f1f3-4642-a992-5c4d8bbc5738 - - - - - -] Base, swap or ephemeral file too young to remove: /var/snap/openstack-hypervisor/common/lib/nova/instances/_base/10196b30b7d57e26216b8dbf13f03153701aeecc 2024-04-23T08:56:43+01:00 nova-compute[109453]: 2024-04-23 08:56:43.516 109453 INFO nova.compute.claims [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Claim successful on node mz640 2024-04-23T08:56:43+01:00 nova-compute[109453]: 2024-04-23 08:56:43.836 109453 INFO nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names 2024-04-23T08:56:43+01:00 nova-compute[109453]: 2024-04-23 08:56:43.992 109453 INFO nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Creating image(s) 2024-04-23T08:56:43+01:00 nova-compute[109453]: 2024-04-23 08:56:43.995 109453 INFO oslo.privsep.daemon [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf.d', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpt10y7hcd/privsep.sock'] 2024-04-23T08:56:45+01:00 nova-compute[109453]: 2024-04-23 08:56:45.826 109453 INFO oslo.privsep.daemon [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Spawned new privsep daemon via rootwrap 2024-04-23T08:56:45+01:00 nova-compute[109453]: 2024-04-23 08:56:45.672 273260 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:45+01:00 nova-compute[109453]: 2024-04-23 08:56:45.680 273260 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:45+01:00 nova-compute[109453]: 2024-04-23 08:56:45.684 273260 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T08:56:45+01:00 nova-compute[109453]: 2024-04-23 08:56:45.684 273260 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273260 2024-04-23T08:56:48+01:00 nova-compute[109453]: 2024-04-23 08:56:48.398 109453 INFO oslo.privsep.daemon [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf.d', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpx768lfm_/privsep.sock'] 2024-04-23T08:56:50+01:00 nova-compute[109453]: 2024-04-23 08:56:50.277 109453 INFO oslo.privsep.daemon [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Spawned new privsep daemon via rootwrap 2024-04-23T08:56:50+01:00 nova-compute[109453]: 2024-04-23 08:56:50.104 273330 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:50+01:00 nova-compute[109453]: 2024-04-23 08:56:50.111 273330 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:50+01:00 nova-compute[109453]: 2024-04-23 08:56:50.115 273330 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none 2024-04-23T08:56:50+01:00 nova-compute[109453]: 2024-04-23 08:56:50.115 273330 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273330 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.046 109453 INFO os_vif [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bc:99,bridge_name='br-int',has_traffic_filtering=True,id=bd5253ad-2ca4-4430-b0e4-f763fcb61395,network=Network(4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5253ad-2c') 2024-04-23T08:56:51+01:00 -[2329]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:56:51+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:51.136 112632 INFO neutron.agent.ovn.metadata.agent [-] Port bd5253ad-2ca4-4430-b0e4-f763fcb61395 in datapath 4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d bound to our chassis 2024-04-23T08:56:51+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:51.140 112632 INFO neutron.agent.ovn.metadata.agent [-] Provisioning metadata for network 4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d 2024-04-23T08:56:51+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:51.142 112632 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmpwcnc2tt7/privsep.sock'] 2024-04-23T08:56:51+01:00 -[2329]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:56:51+01:00 nova-compute[109453]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.433 109453 ERROR nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Failed to start libvirt guest: libvirt.libvirtError: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.445 109453 INFO os_vif [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bc:99,bridge_name='br-int',has_traffic_filtering=True,id=bd5253ad-2ca4-4430-b0e4-f763fcb61395,network=Network(4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5253ad-2c') 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.446 109453 INFO nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Deleting instance files /var/snap/openstack-hypervisor/common/lib/nova/instances/88c87dee-8964-42a8-9fa1-6985ed4201c3_del 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.447 109453 INFO nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Deletion of /var/snap/openstack-hypervisor/common/lib/nova/instances/88c87dee-8964-42a8-9fa1-6985ed4201c3_del complete 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.596 109453 INFO nova.virt.libvirt.host [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] UEFI support detected 2024-04-23T08:56:51+01:00 nova-compute[109453]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.605 109453 INFO nova.compute.manager [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Terminating instance 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.611 109453 INFO nova.virt.libvirt.driver [-] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Instance destroyed successfully. 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.617 109453 INFO os_vif [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bc:99,bridge_name='br-int',has_traffic_filtering=True,id=bd5253ad-2ca4-4430-b0e4-f763fcb61395,network=Network(4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5253ad-2c') 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.618 109453 INFO nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Deletion of /var/snap/openstack-hypervisor/common/lib/nova/instances/88c87dee-8964-42a8-9fa1-6985ed4201c3_del complete 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.694 109453 INFO nova.compute.manager [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Took 0.09 seconds to destroy the instance on the hypervisor. 2024-04-23T08:56:51+01:00 nova-compute[109453]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.886 109453 INFO os_vif [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bc:99,bridge_name='br-int',has_traffic_filtering=True,id=bd5253ad-2ca4-4430-b0e4-f763fcb61395,network=Network(4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5253ad-2c') 2024-04-23T08:56:52+01:00 nova-compute[109453]: 2024-04-23 08:56:52.601 109453 INFO nova.compute.manager [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Took 0.71 seconds to deallocate network for instance. 2024-04-23T08:56:52+01:00 privsep-helper[273427]: 2024-04-23 08:56:52.789 273427 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:52+01:00 privsep-helper[273427]: 2024-04-23 08:56:52.797 273427 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:52+01:00 privsep-helper[273427]: 2024-04-23 08:56:52.800 273427 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T08:56:52+01:00 privsep-helper[273427]: 2024-04-23 08:56:52.801 273427 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273427 2024-04-23T08:56:52+01:00 nova-compute[109453]: 2024-04-23 08:56:52.838 109453 INFO nova.scheduler.client.report [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Deleted allocations for instance 88c87dee-8964-42a8-9fa1-6985ed4201c3 2024-04-23T08:56:52+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:52.926 112632 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T08:56:52+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:52.789 273427 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:52+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:52.797 273427 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:52+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:52.800 273427 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T08:56:52+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:52.801 273427 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273427 2024-04-23T08:56:57+01:00 privsep-helper[273427]: 2024-04-23 08:56:57.510 273427 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:56:57+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:57.510 273427 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:56:57+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:57.638 112632 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.link_cmd', '--privsep_sock_path', '/tmp/tmpuygsijv9/privsep.sock'] 2024-04-23T08:56:59+01:00 privsep-helper[273565]: 2024-04-23 08:56:59.271 273565 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:59+01:00 privsep-helper[273565]: 2024-04-23 08:56:59.278 273565 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:59+01:00 privsep-helper[273565]: 2024-04-23 08:56:59.282 273565 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T08:56:59+01:00 privsep-helper[273565]: 2024-04-23 08:56:59.282 273565 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273565 2024-04-23T08:56:59+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:59.419 112632 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T08:56:59+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:59.271 273565 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:59+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:59.278 273565 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:59+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:59.282 273565 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T08:56:59+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:59.282 273565 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273565 2024-04-23T08:57:03+01:00 privsep-helper[273565]: 2024-04-23 08:57:03.980 273565 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:57:03+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:57:03.980 273565 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:57:04+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:57:04.560 112632 INFO neutron.agent.ovn.metadata.agent [-] Port bd5253ad-2ca4-4430-b0e4-f763fcb61395 in datapath 4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d unbound from our chassis 2024-04-23T08:57:04+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:57:04.563 112632 INFO neutron.agent.ovn.metadata.agent [-] Cleaning up ovnmeta-4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d namespace which is not needed anymore 2024-04-23T09:07:36+01:00 nova-compute[109453]: 2024-04-23 09:07:36.153 109453 ERROR nova.compute.resource_tracker [None req-1c6ec8dc-f1f3-4642-a992-5c4d8bbc5738 - - - - - -] Skipping removal of allocations for deleted instances: Failed to retrieve allocations for resource provider 1abf047e-3df5-4ce9-9e86-4ad5779eafe4: 503 Service Unavailable

Service Unavailable

The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later.


Apache/2.4.52 (Ubuntu) Server at 10.20.21.13 Port 8778
: nova.exception.ResourceProviderAllocationRetrievalFailed: Failed to retrieve allocations for resource provider 1abf047e-3df5-4ce9-9e86-4ad5779eafe4: 2024-04-23T09:07:36+01:00 nova-compute[109453]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T09:09:31+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-compute... 2024-04-23T09:09:31+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T09:09:31+01:00 systemd[1]: snap.openstack-hypervisor.nova-compute.service: Deactivated successfully. 2024-04-23T09:09:31+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T09:09:31+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.libvirtd... 2024-04-23T09:09:31+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Deactivated successfully. 2024-04-23T09:09:31+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T09:09:31+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.ovs-vswitchd... 2024-04-23T09:09:31+01:00 openstack-hypervisor.ovs-vswitchd[323900]: * Exiting ovs-vswitchd (4414) 2024-04-23T09:09:31+01:00 systemd[1]: snap.openstack-hypervisor.ovs-vswitchd.service: Deactivated successfully. 2024-04-23T09:09:31+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.ovs-vswitchd. 2024-04-23T09:09:31+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent... 2024-04-23T09:09:31+01:00 systemd[1]: snap.openstack-hypervisor.neutron-ovn-metadata-agent.service: Deactivated successfully. 2024-04-23T09:09:31+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T09:09:31+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.ovsdb-server... 2024-04-23T09:09:31+01:00 openstack-hypervisor.ovsdb-server[323971]: * Exiting ovsdb-server (4010) 2024-04-23T09:09:31+01:00 systemd[1]: snap.openstack-hypervisor.ovsdb-server.service: Deactivated successfully. 2024-04-23T09:09:31+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.ovsdb-server. 2024-04-23T09:09:32+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.virtlogd... 2024-04-23T09:09:32+01:00 systemd[1]: snap.openstack-hypervisor.virtlogd.service: Deactivated successfully. 2024-04-23T09:09:32+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.virtlogd. 2024-04-23T09:09:32+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-api-metadata... 2024-04-23T09:09:32+01:00 nova-api-metadata[109216]: 2024-04-23 09:09:32.103 109216 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T09:09:32+01:00 nova-api-metadata[109217]: 2024-04-23 09:09:32.103 109217 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T09:10:02+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: State 'final-sigterm' timed out. Killing. 2024-04-23T09:10:02+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Killing process 109004 (python3) with signal SIGKILL. 2024-04-23T09:10:02+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Failed with result 'timeout'. 2024-04-23T09:10:02+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Unit process 109004 (python3) remains running after unit stopped. 2024-04-23T09:10:02+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T09:10:02+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.ovn-controller... 2024-04-23T09:10:02+01:00 openstack-hypervisor.ovn-controller[324445]: * Exiting ovn-controller (4630) 2024-04-23T09:10:02+01:00 systemd[1]: snap.openstack-hypervisor.ovn-controller.service: Deactivated successfully. 2024-04-23T09:10:02+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.ovn-controller. 2024-04-23T13:53:03+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:03+01:00 systemd[1]: Starting Service for snap application openstack-hypervisor.ovsdb-server... 2024-04-23T13:53:04+01:00 openstack-hypervisor.ovsdb-server[351572]: * /var/snap/openstack-hypervisor/common/etc/openvswitch/conf.db does not exist 2024-04-23T13:53:04+01:00 openstack-hypervisor.ovsdb-server[351572]: * Creating empty database /var/snap/openstack-hypervisor/common/etc/openvswitch/conf.db 2024-04-23T13:53:04+01:00 openstack-hypervisor.ovsdb-server[351572]: * Starting ovsdb-server 2024-04-23T13:53:04+01:00 ovs-vsctl[351611]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- init -- set Open_vSwitch . db-version=8.4.0 2024-04-23T13:53:04+01:00 ovs-vsctl[351655]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait set Open_vSwitch . ovs-version=3.2.0 "external-ids:system-id=\"mz640\"" "external-ids:rundir=\"/var/snap/openstack-hypervisor/common/run/openvswitch\"" "system-type=\"ubuntu-core\"" "system-version=\"22\"" 2024-04-23T13:53:04+01:00 openstack-hypervisor.ovsdb-server[351572]: * Configuring Open vSwitch system IDs 2024-04-23T13:53:04+01:00 openstack-hypervisor.ovsdb-server[351572]: * Enabling remote OVSDB managers 2024-04-23T13:53:04+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ovsdb-server. 2024-04-23T13:53:04+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:04+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T13:53:04+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.virtlogd. 2024-04-23T13:53:04+01:00 systemd[1]: Starting Service for snap application openstack-hypervisor.ovs-vswitchd... 2024-04-23T13:53:04+01:00 openstack-hypervisor.ovs-vswitchd[351706]: * Starting ovs-vswitchd 2024-04-23T13:53:04+01:00 ovs-vsctl[351828]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait add Open_vSwitch . external-ids hostname=mz640 2024-04-23T13:53:04+01:00 openstack-hypervisor.ovs-vswitchd[351706]: * Enabling remote OVSDB managers 2024-04-23T13:53:04+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ovs-vswitchd. 2024-04-23T13:53:05+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ceilometer-compute-agent. 2024-04-23T13:53:05+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T13:53:05+01:00 systemd[1]: Starting Service for snap application openstack-hypervisor.ovn-controller... 2024-04-23T13:53:05+01:00 openstack-hypervisor.ovn-controller[351847]: * Starting ovn-controller 2024-04-23T13:53:05+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ovn-controller. 2024-04-23T13:53:06+01:00 -[351679]: libvirt version: 8.0.0 2024-04-23T13:53:06+01:00 -[351679]: hostname: mz640 2024-04-23T13:53:06+01:00 -[351679]: Cannot read CA certificate '/var/snap/openstack-hypervisor/common/etc/pki/CA/cacert.pem': No such file or directory 2024-04-23T13:53:06+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Main process exited, code=exited, status=6/NOTCONFIGURED 2024-04-23T13:53:06+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Failed with result 'exit-code'. 2024-04-23T13:53:06+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Scheduled restart job, restart counter is at 1. 2024-04-23T13:53:06+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:06+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:07+01:00 -[352089]: libvirt version: 8.0.0 2024-04-23T13:53:07+01:00 -[352089]: hostname: mz640 2024-04-23T13:53:07+01:00 -[352089]: Cannot read CA certificate '/var/snap/openstack-hypervisor/common/etc/pki/CA/cacert.pem': No such file or directory 2024-04-23T13:53:07+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Main process exited, code=exited, status=6/NOTCONFIGURED 2024-04-23T13:53:07+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Failed with result 'exit-code'. 2024-04-23T13:53:07+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Scheduled restart job, restart counter is at 2. 2024-04-23T13:53:07+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:07+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:07+01:00 -[352175]: libvirt version: 8.0.0 2024-04-23T13:53:07+01:00 -[352175]: hostname: mz640 2024-04-23T13:53:07+01:00 -[352175]: Cannot read CA certificate '/var/snap/openstack-hypervisor/common/etc/pki/CA/cacert.pem': No such file or directory 2024-04-23T13:53:07+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Main process exited, code=exited, status=6/NOTCONFIGURED 2024-04-23T13:53:07+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Failed with result 'exit-code'. 2024-04-23T13:53:07+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Scheduled restart job, restart counter is at 3. 2024-04-23T13:53:07+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:07+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:07+01:00 -[352228]: libvirt version: 8.0.0 2024-04-23T13:53:07+01:00 -[352228]: hostname: mz640 2024-04-23T13:53:07+01:00 -[352228]: Cannot read CA certificate '/var/snap/openstack-hypervisor/common/etc/pki/CA/cacert.pem': No such file or directory 2024-04-23T13:53:07+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Main process exited, code=exited, status=6/NOTCONFIGURED 2024-04-23T13:53:07+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Failed with result 'exit-code'. 2024-04-23T13:53:07+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Scheduled restart job, restart counter is at 4. 2024-04-23T13:53:07+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:07+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:08+01:00 -[352282]: libvirt version: 8.0.0 2024-04-23T13:53:08+01:00 -[352282]: hostname: mz640 2024-04-23T13:53:08+01:00 -[352282]: Cannot read CA certificate '/var/snap/openstack-hypervisor/common/etc/pki/CA/cacert.pem': No such file or directory 2024-04-23T13:53:08+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Main process exited, code=exited, status=6/NOTCONFIGURED 2024-04-23T13:53:08+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Failed with result 'exit-code'. 2024-04-23T13:53:08+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Scheduled restart job, restart counter is at 5. 2024-04-23T13:53:08+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:08+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Start request repeated too quickly. 2024-04-23T13:53:08+01:00 systemd[1]: snap.openstack-hypervisor.libvirtd.service: Failed with result 'exit-code'. 2024-04-23T13:53:08+01:00 systemd[1]: Failed to start Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:10.934 352624 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:10.946 352624 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:10.947 352624 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:10+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:10.999 352624 WARNING ceilometer.polling.manager [-] No valid pollsters can be loaded from ['compute'] namespaces 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils yield 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils self.run() 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352624]: 2024-04-23 13:53:11.359 352624 ERROR cotyledon._utils 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[351933]: 2024-04-23 13:53:11.366 351933 INFO cotyledon._service_manager [-] Child 352624 exited with status 2 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.392 352650 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.397 352650 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.397 352650 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.438 352650 WARNING ceilometer.polling.manager [-] No valid pollsters can be loaded from ['compute'] namespaces 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils yield 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils self.run() 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[352650]: 2024-04-23 13:53:11.717 352650 ERROR cotyledon._utils 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[351933]: 2024-04-23 13:53:11.725 351933 INFO cotyledon._service_manager [-] Child 352650 exited with status 2 2024-04-23T13:53:11+01:00 openstack-hypervisor.ceilometer-compute-agent[351933]: 2024-04-23 13:53:11.726 351933 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T13:53:12+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.ceilometer-compute-agent... 2024-04-23T13:53:12+01:00 openstack-hypervisor.ceilometer-compute-agent[351933]: 2024-04-23 13:53:12.156 351933 INFO cotyledon._service_manager [-] Caught SIGTERM signal, graceful exiting of master process 2024-04-23T13:53:13+01:00 nova-api-metadata[351566]: 2024-04-23 13:53:13.497 351566 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T13:53:13+01:00 nova-api-metadata[351566]: 2024-04-23 13:53:13.729 351566 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T13:53:13+01:00 nova-api-metadata[351566]: 2024-04-23 13:53:13.730 351566 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T13:53:13+01:00 nova-api-metadata[351566]: 2024-04-23 13:53:13.771 351566 CRITICAL nova [-] Unhandled error: oslo_config.cfg.ConfigFileValueError: Value for option virt_type from LocationInfo(location=, detail='/var/snap/openstack-hypervisor/common/etc/nova/nova.conf') is not valid: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:13.771 351566 ERROR nova Traceback (most recent call last): 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2716, in _do_get 2024-04-23 13:53:13.771 351566 ERROR nova return (convert(val), alt_loc) 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2685, in convert 2024-04-23 13:53:13.771 351566 ERROR nova return self._convert_value( 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2813, in _convert_value 2024-04-23 13:53:13.771 351566 ERROR nova return opt.type(value) 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/types.py", line 167, in __call__ 2024-04-23 13:53:13.771 351566 ERROR nova raise ValueError( 2024-04-23 13:53:13.771 351566 ERROR nova ValueError: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:13.771 351566 ERROR nova 2024-04-23 13:53:13.771 351566 ERROR nova During handling of the above exception, another exception occurred: 2024-04-23 13:53:13.771 351566 ERROR nova 2024-04-23 13:53:13.771 351566 ERROR nova Traceback (most recent call last): 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/bin/nova-api-metadata", line 10, in 2024-04-23 13:53:13.771 351566 ERROR nova sys.exit(main()) 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/nova/cmd/api_metadata.py", line 52, in main 2024-04-23 13:53:13.771 351566 ERROR nova service.wait() 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/nova/service.py", line 493, in wait 2024-04-23 13:53:13.771 351566 ERROR nova _launcher.wait() 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_service/service.py", line 650, in wait 2024-04-23 13:53:13.771 351566 ERROR nova self.conf.log_opt_values(LOG, logging.DEBUG) 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2611, in log_opt_values 2024-04-23 13:53:13.771 351566 ERROR nova _sanitize(opt, getattr(group_attr, opt_name))) 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 3161, in __getattr__ 2024-04-23 13:53:13.771 351566 ERROR nova return self._conf._get(name, self._group) 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2653, in _get 2024-04-23 13:53:13.771 351566 ERROR nova value, loc = self._do_get(name, group, namespace) 2024-04-23 13:53:13.771 351566 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2732, in _do_get 2024-04-23 13:53:13.771 351566 ERROR nova raise ConfigFileValueError(message) 2024-04-23 13:53:13.771 351566 ERROR nova oslo_config.cfg.ConfigFileValueError: Value for option virt_type from LocationInfo(location=, detail='/var/snap/openstack-hypervisor/common/etc/nova/nova.conf') is not valid: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:13.771 351566 ERROR nova 2024-04-23T13:53:13+01:00 nova-api-metadata[352911]: 2024-04-23 13:53:13.775 352911 ERROR oslo.messaging._drivers.impl_rabbit [None req-8cf733a3-4cab-41b9-8046-0468da4735e7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:13+01:00 nova-api-metadata[352910]: 2024-04-23 13:53:13.775 352910 ERROR oslo.messaging._drivers.impl_rabbit [None req-4c74e370-c197-4531-96ea-e44c1efb6782 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:13+01:00 nova-api-metadata[352912]: 2024-04-23 13:53:13.775 352912 ERROR oslo.messaging._drivers.impl_rabbit [None req-5bcd4270-8807-4c2d-974f-1c51516d020b - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:13+01:00 nova-api-metadata[352913]: 2024-04-23 13:53:13.778 352913 ERROR oslo.messaging._drivers.impl_rabbit [None req-6cc2b8b6-4992-4c4c-b73c-5b55d35f2011 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:13+01:00 nova-api-metadata[352910]: 2024-04-23 13:53:13.887 352910 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:13+01:00 nova-api-metadata[352912]: 2024-04-23 13:53:13.887 352912 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:13+01:00 nova-api-metadata[352910]: 2024-04-23 13:53:13.888 352910 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:13+01:00 nova-api-metadata[352913]: 2024-04-23 13:53:13.887 352913 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:13+01:00 nova-api-metadata[352910]: 2024-04-23 13:53:13.889 352910 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:13+01:00 nova-api-metadata[352913]: 2024-04-23 13:53:13.889 352913 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:13+01:00 nova-api-metadata[352912]: 2024-04-23 13:53:13.888 352912 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:13+01:00 nova-api-metadata[352911]: 2024-04-23 13:53:13.887 352911 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:13+01:00 nova-api-metadata[352913]: 2024-04-23 13:53:13.890 352913 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:13+01:00 nova-api-metadata[352912]: 2024-04-23 13:53:13.890 352912 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:13+01:00 nova-api-metadata[352911]: 2024-04-23 13:53:13.890 352911 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:13+01:00 nova-api-metadata[352911]: 2024-04-23 13:53:13.891 352911 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:13+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Main process exited, code=exited, status=1/FAILURE 2024-04-23T13:53:13+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Failed with result 'exit-code'. 2024-04-23T13:53:14+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Scheduled restart job, restart counter is at 1. 2024-04-23T13:53:14+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:14+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:14+01:00 nova-compute[351934]: 2024-04-23 13:53:14.475 351934 INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs 2024-04-23T13:53:14+01:00 neutron-ovn-metadata-agent[351833]: 2024-04-23 13:53:14.737 351833 INFO neutron.common.config [-] Logging enabled! 2024-04-23T13:53:14+01:00 neutron-ovn-metadata-agent[351833]: 2024-04-23 13:53:14.738 351833 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T13:53:15+01:00 neutron-ovn-metadata-agent[351833]: 2024-04-23 13:53:15.031 351833 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T13:53:15+01:00 neutron-ovn-metadata-agent[351833]: 2024-04-23 13:53:15.032 351833 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T13:53:15+01:00 neutron-ovn-metadata-agent[351833]: 2024-04-23 13:53:15.041 351833 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T13:53:15+01:00 neutron-ovn-metadata-agent[351833]: 2024-04-23 13:53:15.042 351833 ERROR ovsdbapp.backend.ovs_idl.idlutils [-] Unable to open stream to tcp:127.0.0.1:6642 to retrieve schema: Connection refused 2024-04-23T13:53:15+01:00 nova-compute[351934]: 2024-04-23 13:53:15.227 351934 ERROR oslo.messaging._drivers.impl_rabbit [None req-2d76e956-5b96-4587-8ac2-3f0150a2cbef - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:16+01:00 neutron-ovn-metadata-agent[351833]: 2024-04-23 13:53:16.044 351833 ERROR ovsdbapp.backend.ovs_idl.idlutils [-] Unable to open stream to tcp:127.0.0.1:6642 to retrieve schema: Connection refused 2024-04-23T13:53:16+01:00 nova-compute[351934]: 2024-04-23 13:53:16.230 351934 ERROR oslo.messaging._drivers.impl_rabbit [None req-2d76e956-5b96-4587-8ac2-3f0150a2cbef - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: 2024-04-23 13:53:16.740 353348 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: 2024-04-23 13:53:16.743 353348 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: 2024-04-23 13:53:16.744 353348 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: libvirt: XML-RPC error : Failed to connect socket to '/var/snap/openstack-hypervisor/common/run/libvirt/libvirt-sock-ro': Connection refused 2024-04-23T13:53:16+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: 2024-04-23 13:53:16.782 353348 WARNING ceilometer.polling.manager [-] No valid pollsters can be loaded from ['compute'] namespaces 2024-04-23T13:53:17+01:00 openstack-hypervisor.ceilometer-compute-agent[353348]: 2024-04-23 13:53:17.057 353348 INFO cotyledon._service [-] Caught SIGTERM signal, graceful exiting of service AgentManager(0) [353348] 2024-04-23T13:53:18+01:00 neutron-ovn-metadata-agent[351833]: 2024-04-23 13:53:18.047 351833 ERROR ovsdbapp.backend.ovs_idl.idlutils [-] Unable to open stream to tcp:127.0.0.1:6642 to retrieve schema: Connection refused 2024-04-23T13:53:19+01:00 nova-compute[351934]: 2024-04-23 13:53:19.235 351934 ERROR oslo.messaging._drivers.impl_rabbit [None req-2d76e956-5b96-4587-8ac2-3f0150a2cbef - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:20+01:00 nova-api-metadata[352960]: 2024-04-23 13:53:20.864 352960 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T13:53:21+01:00 nova-api-metadata[352960]: 2024-04-23 13:53:21.061 352960 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T13:53:21+01:00 nova-api-metadata[352960]: 2024-04-23 13:53:21.062 352960 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T13:53:21+01:00 nova-api-metadata[352960]: 2024-04-23 13:53:21.100 352960 CRITICAL nova [-] Unhandled error: oslo_config.cfg.ConfigFileValueError: Value for option virt_type from LocationInfo(location=, detail='/var/snap/openstack-hypervisor/common/etc/nova/nova.conf') is not valid: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:21.100 352960 ERROR nova Traceback (most recent call last): 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2716, in _do_get 2024-04-23 13:53:21.100 352960 ERROR nova return (convert(val), alt_loc) 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2685, in convert 2024-04-23 13:53:21.100 352960 ERROR nova return self._convert_value( 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2813, in _convert_value 2024-04-23 13:53:21.100 352960 ERROR nova return opt.type(value) 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/types.py", line 167, in __call__ 2024-04-23 13:53:21.100 352960 ERROR nova raise ValueError( 2024-04-23 13:53:21.100 352960 ERROR nova ValueError: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:21.100 352960 ERROR nova 2024-04-23 13:53:21.100 352960 ERROR nova During handling of the above exception, another exception occurred: 2024-04-23 13:53:21.100 352960 ERROR nova 2024-04-23 13:53:21.100 352960 ERROR nova Traceback (most recent call last): 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/bin/nova-api-metadata", line 10, in 2024-04-23 13:53:21.100 352960 ERROR nova sys.exit(main()) 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/nova/cmd/api_metadata.py", line 52, in main 2024-04-23 13:53:21.100 352960 ERROR nova service.wait() 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/nova/service.py", line 493, in wait 2024-04-23 13:53:21.100 352960 ERROR nova _launcher.wait() 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_service/service.py", line 650, in wait 2024-04-23 13:53:21.100 352960 ERROR nova self.conf.log_opt_values(LOG, logging.DEBUG) 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2611, in log_opt_values 2024-04-23 13:53:21.100 352960 ERROR nova _sanitize(opt, getattr(group_attr, opt_name))) 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 3161, in __getattr__ 2024-04-23 13:53:21.100 352960 ERROR nova return self._conf._get(name, self._group) 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2653, in _get 2024-04-23 13:53:21.100 352960 ERROR nova value, loc = self._do_get(name, group, namespace) 2024-04-23 13:53:21.100 352960 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2732, in _do_get 2024-04-23 13:53:21.100 352960 ERROR nova raise ConfigFileValueError(message) 2024-04-23 13:53:21.100 352960 ERROR nova oslo_config.cfg.ConfigFileValueError: Value for option virt_type from LocationInfo(location=, detail='/var/snap/openstack-hypervisor/common/etc/nova/nova.conf') is not valid: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:21.100 352960 ERROR nova 2024-04-23T13:53:21+01:00 nova-api-metadata[353484]: 2024-04-23 13:53:21.104 353484 ERROR oslo.messaging._drivers.impl_rabbit [None req-163f7237-02ae-447f-a0fd-a2aea1729058 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:21+01:00 nova-api-metadata[353485]: 2024-04-23 13:53:21.103 353485 ERROR oslo.messaging._drivers.impl_rabbit [None req-56f7335e-cb0f-46cb-8a9c-10d2ae327d5f - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:21+01:00 nova-api-metadata[353487]: 2024-04-23 13:53:21.106 353487 ERROR oslo.messaging._drivers.impl_rabbit [None req-8d0c4c07-d756-4f1e-90a5-d0e371999b16 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:21+01:00 nova-api-metadata[353486]: 2024-04-23 13:53:21.106 353486 ERROR oslo.messaging._drivers.impl_rabbit [None req-4b75c4aa-ba5b-42df-8b52-cc56c407e66e - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:21+01:00 nova-api-metadata[353487]: 2024-04-23 13:53:21.218 353487 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:21+01:00 nova-api-metadata[353485]: 2024-04-23 13:53:21.218 353485 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:21+01:00 nova-api-metadata[353487]: 2024-04-23 13:53:21.219 353487 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:21+01:00 nova-api-metadata[353485]: 2024-04-23 13:53:21.219 353485 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:21+01:00 nova-api-metadata[353484]: 2024-04-23 13:53:21.218 353484 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:21+01:00 nova-api-metadata[353486]: 2024-04-23 13:53:21.218 353486 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:21+01:00 nova-api-metadata[353485]: 2024-04-23 13:53:21.220 353485 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:21+01:00 nova-api-metadata[353484]: 2024-04-23 13:53:21.220 353484 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:21+01:00 nova-api-metadata[353487]: 2024-04-23 13:53:21.220 353487 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:21+01:00 nova-api-metadata[353486]: 2024-04-23 13:53:21.220 353486 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:21+01:00 nova-api-metadata[353484]: 2024-04-23 13:53:21.221 353484 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:21+01:00 nova-api-metadata[353486]: 2024-04-23 13:53:21.222 353486 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:21+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Main process exited, code=exited, status=1/FAILURE 2024-04-23T13:53:21+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Killing process 353490 (python3) with signal SIGKILL. 2024-04-23T13:53:21+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Failed with result 'exit-code'. 2024-04-23T13:53:21+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Scheduled restart job, restart counter is at 2. 2024-04-23T13:53:21+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:21+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:22+01:00 neutron-ovn-metadata-agent[351833]: 2024-04-23 13:53:22.053 351833 ERROR ovsdbapp.backend.ovs_idl.idlutils [-] Unable to open stream to tcp:127.0.0.1:6642 to retrieve schema: Connection refused 2024-04-23T13:53:24+01:00 nova-compute[351934]: 2024-04-23 13:53:24.240 351934 ERROR oslo.messaging._drivers.impl_rabbit [None req-2d76e956-5b96-4587-8ac2-3f0150a2cbef - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:28+01:00 nova-api-metadata[353523]: 2024-04-23 13:53:28.062 353523 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T13:53:28+01:00 nova-api-metadata[353523]: 2024-04-23 13:53:28.258 353523 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T13:53:28+01:00 nova-api-metadata[353523]: 2024-04-23 13:53:28.259 353523 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T13:53:28+01:00 nova-api-metadata[353523]: 2024-04-23 13:53:28.297 353523 CRITICAL nova [-] Unhandled error: oslo_config.cfg.ConfigFileValueError: Value for option virt_type from LocationInfo(location=, detail='/var/snap/openstack-hypervisor/common/etc/nova/nova.conf') is not valid: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:28.297 353523 ERROR nova Traceback (most recent call last): 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2716, in _do_get 2024-04-23 13:53:28.297 353523 ERROR nova return (convert(val), alt_loc) 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2685, in convert 2024-04-23 13:53:28.297 353523 ERROR nova return self._convert_value( 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2813, in _convert_value 2024-04-23 13:53:28.297 353523 ERROR nova return opt.type(value) 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/types.py", line 167, in __call__ 2024-04-23 13:53:28.297 353523 ERROR nova raise ValueError( 2024-04-23 13:53:28.297 353523 ERROR nova ValueError: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:28.297 353523 ERROR nova 2024-04-23 13:53:28.297 353523 ERROR nova During handling of the above exception, another exception occurred: 2024-04-23 13:53:28.297 353523 ERROR nova 2024-04-23 13:53:28.297 353523 ERROR nova Traceback (most recent call last): 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/bin/nova-api-metadata", line 10, in 2024-04-23 13:53:28.297 353523 ERROR nova sys.exit(main()) 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/nova/cmd/api_metadata.py", line 52, in main 2024-04-23 13:53:28.297 353523 ERROR nova service.wait() 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/nova/service.py", line 493, in wait 2024-04-23 13:53:28.297 353523 ERROR nova _launcher.wait() 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_service/service.py", line 650, in wait 2024-04-23 13:53:28.297 353523 ERROR nova self.conf.log_opt_values(LOG, logging.DEBUG) 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2611, in log_opt_values 2024-04-23 13:53:28.297 353523 ERROR nova _sanitize(opt, getattr(group_attr, opt_name))) 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 3161, in __getattr__ 2024-04-23 13:53:28.297 353523 ERROR nova return self._conf._get(name, self._group) 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2653, in _get 2024-04-23 13:53:28.297 353523 ERROR nova value, loc = self._do_get(name, group, namespace) 2024-04-23 13:53:28.297 353523 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2732, in _do_get 2024-04-23 13:53:28.297 353523 ERROR nova raise ConfigFileValueError(message) 2024-04-23 13:53:28.297 353523 ERROR nova oslo_config.cfg.ConfigFileValueError: Value for option virt_type from LocationInfo(location=, detail='/var/snap/openstack-hypervisor/common/etc/nova/nova.conf') is not valid: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:28.297 353523 ERROR nova 2024-04-23T13:53:28+01:00 nova-api-metadata[353885]: 2024-04-23 13:53:28.301 353885 ERROR oslo.messaging._drivers.impl_rabbit [None req-e578c589-7887-411a-8cda-eb145765056a - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:28+01:00 nova-api-metadata[353886]: 2024-04-23 13:53:28.303 353886 ERROR oslo.messaging._drivers.impl_rabbit [None req-fc1e74fe-d0c0-4d04-aca8-9d24ba178cb2 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:28+01:00 nova-api-metadata[353887]: 2024-04-23 13:53:28.305 353887 ERROR oslo.messaging._drivers.impl_rabbit [None req-a698d3b3-26d9-4198-89e4-7efbcc488caa - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:28+01:00 nova-api-metadata[353888]: 2024-04-23 13:53:28.302 353888 ERROR oslo.messaging._drivers.impl_rabbit [None req-f2b9209d-f7e8-416b-ac69-1337838b5bb0 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:28+01:00 nova-api-metadata[353887]: 2024-04-23 13:53:28.402 353887 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:28+01:00 nova-api-metadata[353888]: 2024-04-23 13:53:28.402 353888 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:28+01:00 nova-api-metadata[353885]: 2024-04-23 13:53:28.402 353885 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:28+01:00 nova-api-metadata[353886]: 2024-04-23 13:53:28.402 353886 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:28+01:00 nova-api-metadata[353885]: 2024-04-23 13:53:28.404 353885 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:28+01:00 nova-api-metadata[353887]: 2024-04-23 13:53:28.403 353887 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:28+01:00 nova-api-metadata[353886]: 2024-04-23 13:53:28.405 353886 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:28+01:00 nova-api-metadata[353885]: 2024-04-23 13:53:28.405 353885 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:28+01:00 nova-api-metadata[353888]: 2024-04-23 13:53:28.404 353888 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:28+01:00 nova-api-metadata[353887]: 2024-04-23 13:53:28.406 353887 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:28+01:00 nova-api-metadata[353886]: 2024-04-23 13:53:28.406 353886 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:28+01:00 nova-api-metadata[353888]: 2024-04-23 13:53:28.406 353888 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:28+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Main process exited, code=exited, status=1/FAILURE 2024-04-23T13:53:28+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Failed with result 'exit-code'. 2024-04-23T13:53:28+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Scheduled restart job, restart counter is at 3. 2024-04-23T13:53:28+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:28+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:30+01:00 neutron-ovn-metadata-agent[351833]: 2024-04-23 13:53:30.061 351833 ERROR ovsdbapp.backend.ovs_idl.idlutils [-] Unable to open stream to tcp:127.0.0.1:6642 to retrieve schema: Connection refused 2024-04-23T13:53:31+01:00 nova-compute[351934]: 2024-04-23 13:53:31.247 351934 ERROR oslo.messaging._drivers.impl_rabbit [None req-2d76e956-5b96-4587-8ac2-3f0150a2cbef - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:35+01:00 nova-api-metadata[353924]: 2024-04-23 13:53:35.264 353924 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T13:53:35+01:00 nova-api-metadata[353924]: 2024-04-23 13:53:35.456 353924 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T13:53:35+01:00 nova-api-metadata[353924]: 2024-04-23 13:53:35.457 353924 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T13:53:35+01:00 nova-api-metadata[353924]: 2024-04-23 13:53:35.496 353924 CRITICAL nova [-] Unhandled error: oslo_config.cfg.ConfigFileValueError: Value for option virt_type from LocationInfo(location=, detail='/var/snap/openstack-hypervisor/common/etc/nova/nova.conf') is not valid: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:35.496 353924 ERROR nova Traceback (most recent call last): 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2716, in _do_get 2024-04-23 13:53:35.496 353924 ERROR nova return (convert(val), alt_loc) 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2685, in convert 2024-04-23 13:53:35.496 353924 ERROR nova return self._convert_value( 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2813, in _convert_value 2024-04-23 13:53:35.496 353924 ERROR nova return opt.type(value) 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/types.py", line 167, in __call__ 2024-04-23 13:53:35.496 353924 ERROR nova raise ValueError( 2024-04-23 13:53:35.496 353924 ERROR nova ValueError: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:35.496 353924 ERROR nova 2024-04-23 13:53:35.496 353924 ERROR nova During handling of the above exception, another exception occurred: 2024-04-23 13:53:35.496 353924 ERROR nova 2024-04-23 13:53:35.496 353924 ERROR nova Traceback (most recent call last): 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/bin/nova-api-metadata", line 10, in 2024-04-23 13:53:35.496 353924 ERROR nova sys.exit(main()) 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/nova/cmd/api_metadata.py", line 52, in main 2024-04-23 13:53:35.496 353924 ERROR nova service.wait() 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/nova/service.py", line 493, in wait 2024-04-23 13:53:35.496 353924 ERROR nova _launcher.wait() 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_service/service.py", line 650, in wait 2024-04-23 13:53:35.496 353924 ERROR nova self.conf.log_opt_values(LOG, logging.DEBUG) 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2611, in log_opt_values 2024-04-23 13:53:35.496 353924 ERROR nova _sanitize(opt, getattr(group_attr, opt_name))) 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 3161, in __getattr__ 2024-04-23 13:53:35.496 353924 ERROR nova return self._conf._get(name, self._group) 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2653, in _get 2024-04-23 13:53:35.496 353924 ERROR nova value, loc = self._do_get(name, group, namespace) 2024-04-23 13:53:35.496 353924 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2732, in _do_get 2024-04-23 13:53:35.496 353924 ERROR nova raise ConfigFileValueError(message) 2024-04-23 13:53:35.496 353924 ERROR nova oslo_config.cfg.ConfigFileValueError: Value for option virt_type from LocationInfo(location=, detail='/var/snap/openstack-hypervisor/common/etc/nova/nova.conf') is not valid: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:35.496 353924 ERROR nova 2024-04-23T13:53:35+01:00 nova-api-metadata[354199]: 2024-04-23 13:53:35.499 354199 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3dba9f4-a187-498c-9edf-ccbaa8ce1ad3 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:35+01:00 nova-api-metadata[354201]: 2024-04-23 13:53:35.499 354201 ERROR oslo.messaging._drivers.impl_rabbit [None req-e62718b6-4396-4fa7-aa87-ae2b9bc83286 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:35+01:00 nova-api-metadata[354200]: 2024-04-23 13:53:35.501 354200 ERROR oslo.messaging._drivers.impl_rabbit [None req-c4fd734c-34f9-4dab-a147-047955092df3 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:35+01:00 nova-api-metadata[354202]: 2024-04-23 13:53:35.503 354202 ERROR oslo.messaging._drivers.impl_rabbit [None req-0b927371-05cd-42df-84cb-c4aff81ff55f - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:35+01:00 nova-api-metadata[354200]: 2024-04-23 13:53:35.607 354200 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:35+01:00 nova-api-metadata[354201]: 2024-04-23 13:53:35.607 354201 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:35+01:00 nova-api-metadata[354200]: 2024-04-23 13:53:35.608 354200 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:35+01:00 nova-api-metadata[354201]: 2024-04-23 13:53:35.608 354201 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:35+01:00 nova-api-metadata[354202]: 2024-04-23 13:53:35.607 354202 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:35+01:00 nova-api-metadata[354199]: 2024-04-23 13:53:35.607 354199 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:35+01:00 nova-api-metadata[354201]: 2024-04-23 13:53:35.609 354201 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:35+01:00 nova-api-metadata[354200]: 2024-04-23 13:53:35.609 354200 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:35+01:00 nova-api-metadata[354202]: 2024-04-23 13:53:35.609 354202 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:35+01:00 nova-api-metadata[354199]: 2024-04-23 13:53:35.610 354199 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:35+01:00 nova-api-metadata[354202]: 2024-04-23 13:53:35.611 354202 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:35+01:00 nova-api-metadata[354199]: 2024-04-23 13:53:35.611 354199 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:35+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Main process exited, code=exited, status=1/FAILURE 2024-04-23T13:53:35+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Failed with result 'exit-code'. 2024-04-23T13:53:35+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Scheduled restart job, restart counter is at 4. 2024-04-23T13:53:35+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:35+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:40+01:00 nova-compute[351934]: 2024-04-23 13:53:40.259 351934 ERROR oslo.messaging._drivers.impl_rabbit [None req-2d76e956-5b96-4587-8ac2-3f0150a2cbef - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:42+01:00 systemd[1]: snap.openstack-hypervisor.ceilometer-compute-agent.service: State 'final-sigterm' timed out. Killing. 2024-04-23T13:53:42+01:00 systemd[1]: snap.openstack-hypervisor.ceilometer-compute-agent.service: Killing process 351933 (ceilometer-poll) with signal SIGKILL. 2024-04-23T13:53:42+01:00 systemd[1]: snap.openstack-hypervisor.ceilometer-compute-agent.service: Failed with result 'timeout'. 2024-04-23T13:53:42+01:00 systemd[1]: snap.openstack-hypervisor.ceilometer-compute-agent.service: Unit process 351933 (ceilometer-poll) remains running after unit stopped. 2024-04-23T13:53:42+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.ceilometer-compute-agent. 2024-04-23T13:53:42+01:00 nova-api-metadata[354244]: 2024-04-23 13:53:42.553 354244 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T13:53:42+01:00 nova-api-metadata[354244]: 2024-04-23 13:53:42.746 354244 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T13:53:42+01:00 nova-api-metadata[354244]: 2024-04-23 13:53:42.747 354244 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T13:53:42+01:00 nova-api-metadata[354715]: 2024-04-23 13:53:42.783 354715 ERROR oslo.messaging._drivers.impl_rabbit [None req-c3fcbc1e-67de-44db-a323-4b56b53ec71e - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:42+01:00 nova-api-metadata[354244]: 2024-04-23 13:53:42.786 354244 CRITICAL nova [-] Unhandled error: oslo_config.cfg.ConfigFileValueError: Value for option virt_type from LocationInfo(location=, detail='/var/snap/openstack-hypervisor/common/etc/nova/nova.conf') is not valid: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:42.786 354244 ERROR nova Traceback (most recent call last): 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2716, in _do_get 2024-04-23 13:53:42.786 354244 ERROR nova return (convert(val), alt_loc) 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2685, in convert 2024-04-23 13:53:42.786 354244 ERROR nova return self._convert_value( 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2813, in _convert_value 2024-04-23 13:53:42.786 354244 ERROR nova return opt.type(value) 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/types.py", line 167, in __call__ 2024-04-23 13:53:42.786 354244 ERROR nova raise ValueError( 2024-04-23 13:53:42.786 354244 ERROR nova ValueError: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:42.786 354244 ERROR nova 2024-04-23 13:53:42.786 354244 ERROR nova During handling of the above exception, another exception occurred: 2024-04-23 13:53:42.786 354244 ERROR nova 2024-04-23 13:53:42.786 354244 ERROR nova Traceback (most recent call last): 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/bin/nova-api-metadata", line 10, in 2024-04-23 13:53:42.786 354244 ERROR nova sys.exit(main()) 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/nova/cmd/api_metadata.py", line 52, in main 2024-04-23 13:53:42.786 354244 ERROR nova service.wait() 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/nova/service.py", line 493, in wait 2024-04-23 13:53:42.786 354244 ERROR nova _launcher.wait() 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_service/service.py", line 650, in wait 2024-04-23 13:53:42.786 354244 ERROR nova self.conf.log_opt_values(LOG, logging.DEBUG) 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2611, in log_opt_values 2024-04-23 13:53:42.786 354244 ERROR nova _sanitize(opt, getattr(group_attr, opt_name))) 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 3161, in __getattr__ 2024-04-23 13:53:42.786 354244 ERROR nova return self._conf._get(name, self._group) 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2653, in _get 2024-04-23 13:53:42.786 354244 ERROR nova value, loc = self._do_get(name, group, namespace) 2024-04-23 13:53:42.786 354244 ERROR nova File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/oslo_config/cfg.py", line 2732, in _do_get 2024-04-23 13:53:42.786 354244 ERROR nova raise ConfigFileValueError(message) 2024-04-23 13:53:42.786 354244 ERROR nova oslo_config.cfg.ConfigFileValueError: Value for option virt_type from LocationInfo(location=, detail='/var/snap/openstack-hypervisor/common/etc/nova/nova.conf') is not valid: Valid values are [kvm, lxc, qemu, parallels], but found 'auto' 2024-04-23 13:53:42.786 354244 ERROR nova 2024-04-23T13:53:42+01:00 nova-api-metadata[354716]: 2024-04-23 13:53:42.792 354716 ERROR oslo.messaging._drivers.impl_rabbit [None req-1de0830a-da71-49fc-b0e7-593b872408f2 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:42+01:00 nova-api-metadata[354717]: 2024-04-23 13:53:42.794 354717 ERROR oslo.messaging._drivers.impl_rabbit [None req-3ea15564-f3b3-41a1-81ce-8624da2e6296 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:42+01:00 nova-api-metadata[354718]: 2024-04-23 13:53:42.794 354718 ERROR oslo.messaging._drivers.impl_rabbit [None req-aefba55c-3d31-4b01-9d32-527d179a911e - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T13:53:42+01:00 nova-api-metadata[354717]: 2024-04-23 13:53:42.893 354717 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:42+01:00 nova-api-metadata[354715]: 2024-04-23 13:53:42.893 354715 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:42+01:00 nova-api-metadata[354717]: 2024-04-23 13:53:42.894 354717 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:42+01:00 nova-api-metadata[354715]: 2024-04-23 13:53:42.894 354715 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:42+01:00 nova-api-metadata[354718]: 2024-04-23 13:53:42.893 354718 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:42+01:00 nova-api-metadata[354716]: 2024-04-23 13:53:42.893 354716 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting 2024-04-23T13:53:42+01:00 nova-api-metadata[354717]: 2024-04-23 13:53:42.895 354717 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:42+01:00 nova-api-metadata[354715]: 2024-04-23 13:53:42.895 354715 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:42+01:00 nova-api-metadata[354718]: 2024-04-23 13:53:42.895 354718 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:42+01:00 nova-api-metadata[354716]: 2024-04-23 13:53:42.895 354716 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:42+01:00 nova-api-metadata[354718]: 2024-04-23 13:53:42.896 354718 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:42+01:00 nova-api-metadata[354716]: 2024-04-23 13:53:42.897 354716 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T13:53:42+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Main process exited, code=exited, status=1/FAILURE 2024-04-23T13:53:42+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Killing process 354720 (python3) with signal SIGKILL. 2024-04-23T13:53:42+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Failed with result 'exit-code'. 2024-04-23T13:53:43+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent... 2024-04-23T13:53:43+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Scheduled restart job, restart counter is at 5. 2024-04-23T13:53:43+01:00 systemd[1]: snap.openstack-hypervisor.neutron-ovn-metadata-agent.service: Deactivated successfully. 2024-04-23T13:53:43+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T13:53:43+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:43+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:44+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-api-metadata... 2024-04-23T13:53:44+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Deactivated successfully. 2024-04-23T13:53:44+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:53:45+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-compute... 2024-04-23T13:53:45+01:00 systemd[1]: snap.openstack-hypervisor.nova-compute.service: Deactivated successfully. 2024-04-23T13:53:45+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T13:53:49+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T13:53:49+01:00 -[354948]: libvirt version: 8.0.0 2024-04-23T13:53:49+01:00 -[354948]: hostname: mz640 2024-04-23T13:53:49+01:00 -[354948]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.243" (uid=0 pid=354948 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T13:53:50+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.virtlogd... 2024-04-23T13:53:50+01:00 systemd[1]: snap.openstack-hypervisor.virtlogd.service: Deactivated successfully. 2024-04-23T13:53:50+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.virtlogd. 2024-04-23T13:53:52+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.virtlogd. 2024-04-23T13:54:02+01:00 ovn-controller[351952]: ovs|00020|stream_ssl|ERR|Private key must be configured to use SSL 2024-04-23T13:54:02+01:00 ovn-controller[351952]: ovs|00021|stream_ssl|ERR|Certificate must be configured to use SSL 2024-04-23T13:54:02+01:00 ovn-controller[351952]: ovs|00022|stream_ssl|ERR|CA certificate must be configured to use SSL 2024-04-23T13:54:07+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T13:54:11+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T13:54:13+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T13:54:15+01:00 nova-compute[356689]: 2024-04-23 13:54:15.581 356689 INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs 2024-04-23T13:54:17+01:00 nova-compute[356689]: 2024-04-23 13:54:17.006 356689 INFO nova.virt.driver [None req-51641d78-506c-4d90-b0ef-70b89ea0c89a - - - - - -] Loading compute driver 'libvirt.LibvirtDriver' 2024-04-23T13:54:17+01:00 nova-compute[356689]: 2024-04-23 13:54:17.954 356689 INFO nova.compute.provider_config [None req-51641d78-506c-4d90-b0ef-70b89ea0c89a - - - - - -] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. 2024-04-23T13:54:18+01:00 nova-compute[356689]: 2024-04-23 13:54:18.008 356689 INFO nova.service [-] Starting compute node (version 28.0.0) 2024-04-23T13:54:18+01:00 nova-compute[356689]: 2024-04-23 13:54:18.051 356689 INFO nova.virt.libvirt.driver [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] Connection event '1' reason 'None' 2024-04-23T13:54:18+01:00 -[354948]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.243" (uid=0 pid=354948 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T13:54:18+01:00 -[354948]: Failed to get host power management capabilities 2024-04-23T13:54:18+01:00 nova-compute[356689]: 2024-04-23 13:54:18.080 356689 WARNING nova.virt.libvirt.driver [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] Cannot update service status on host "mz640" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host mz640 could not be found. 2024-04-23T13:54:19+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:19.107 356822 INFO neutron.common.config [-] Logging enabled! 2024-04-23T13:54:19+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:19.108 356822 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T13:54:19+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:19.132 356822 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T13:54:19+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:19.132 356822 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T13:54:19+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:19.142 356822 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T13:54:19+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:19.177 356822 INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry 2024-04-23T13:54:19+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:19.182 356822 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.20.21.10:6642: connecting... 2024-04-23T13:54:19+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:19.192 356822 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.20.21.10:6642: connected 2024-04-23T13:54:19+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:19.208 356822 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.namespace_cmd', '--privsep_sock_path', '/tmp/tmpv8j3anfd/privsep.sock'] 2024-04-23T13:54:19+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:19.210 356822 INFO eventlet.wsgi.server [-] (356822) wsgi starting up on http:/var/snap/openstack-hypervisor/common/lib/metadata_proxy 2024-04-23T13:54:20+01:00 nova-compute[356689]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T13:54:20+01:00 -[354948]: invalid argument: KVM is not supported by '/snap/openstack-hypervisor/123/usr/bin/qemu-system-aarch64' on this host 2024-04-23T13:54:20+01:00 nova-compute[356689]: 2024-04-23 13:54:20.676 356689 INFO nova.virt.libvirt.host [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] Secure Boot support detected 2024-04-23T13:54:20+01:00 nova-api-metadata[356912]: 2024-04-23 13:54:20.723 356912 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T13:54:20+01:00 nova-compute[356689]: 2024-04-23 13:54:20.758 356689 INFO nova.virt.node [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] Generated node identity 379c66b6-efcf-4464-a8b4-14f0d425f7b2 2024-04-23T13:54:20+01:00 nova-compute[356689]: 2024-04-23 13:54:20.759 356689 INFO nova.virt.node [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] Wrote node identity 379c66b6-efcf-4464-a8b4-14f0d425f7b2 to /var/snap/openstack-hypervisor/common/lib/nova/compute_id 2024-04-23T13:54:20+01:00 nova-compute[356689]: 2024-04-23 13:54:20.796 356689 WARNING nova.compute.manager [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] Compute nodes ['379c66b6-efcf-4464-a8b4-14f0d425f7b2'] for host mz640 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. 2024-04-23T13:54:20+01:00 nova-compute[356689]: 2024-04-23 13:54:20.863 356689 INFO nova.compute.manager [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host 2024-04-23T13:54:20+01:00 nova-compute[356689]: 2024-04-23 13:54:20.906 356689 WARNING nova.compute.manager [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] No compute node record found for host mz640. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host mz640 could not be found. 2024-04-23T13:54:20+01:00 nova-api-metadata[356912]: 2024-04-23 13:54:20.928 356912 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T13:54:20+01:00 nova-api-metadata[356912]: 2024-04-23 13:54:20.930 356912 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T13:54:20+01:00 privsep-helper[357652]: 2024-04-23 13:54:20.930 357652 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T13:54:20+01:00 privsep-helper[357652]: 2024-04-23 13:54:20.938 357652 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T13:54:20+01:00 privsep-helper[357652]: 2024-04-23 13:54:20.942 357652 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T13:54:20+01:00 privsep-helper[357652]: 2024-04-23 13:54:20.942 357652 INFO oslo.privsep.daemon [-] privsep daemon running as pid 357652 2024-04-23T13:54:21+01:00 nova-api-metadata[357653]: 2024-04-23 13:54:21.041 357653 INFO nova.metadata.wsgi.server [None req-61a80b56-343a-44ae-8cb4-6dcfd5c8fa51 - - - - - -] (357653) wsgi starting up on http://0.0.0.0:8775 2024-04-23T13:54:21+01:00 nova-api-metadata[357655]: 2024-04-23 13:54:21.063 357655 INFO nova.metadata.wsgi.server [None req-c0eeeab1-b787-4e30-8b77-12d9ed02621d - - - - - -] (357655) wsgi starting up on http://0.0.0.0:8775 2024-04-23T13:54:21+01:00 nova-api-metadata[357656]: 2024-04-23 13:54:21.063 357656 INFO nova.metadata.wsgi.server [None req-5773e06e-7143-4c2c-9dd3-121abca62af4 - - - - - -] (357656) wsgi starting up on http://0.0.0.0:8775 2024-04-23T13:54:21+01:00 nova-api-metadata[357654]: 2024-04-23 13:54:21.065 357654 INFO nova.metadata.wsgi.server [None req-8d78ca8b-0714-487f-8f01-b1a107775c27 - - - - - -] (357654) wsgi starting up on http://0.0.0.0:8775 2024-04-23T13:54:21+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:21.087 356822 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T13:54:21+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:20.930 357652 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T13:54:21+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:20.938 357652 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T13:54:21+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:20.942 357652 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T13:54:21+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:20.942 357652 INFO oslo.privsep.daemon [-] privsep daemon running as pid 357652 2024-04-23T13:54:21+01:00 nova-compute[356689]: 2024-04-23 13:54:21.657 356689 WARNING nova.compute.resource_tracker [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] No compute node record for mz640:379c66b6-efcf-4464-a8b4-14f0d425f7b2: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 379c66b6-efcf-4464-a8b4-14f0d425f7b2 could not be found. 2024-04-23T13:54:21+01:00 nova-compute[356689]: 2024-04-23 13:54:21.685 356689 INFO nova.compute.resource_tracker [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] Compute node record created for mz640:mz640 with uuid: 379c66b6-efcf-4464-a8b4-14f0d425f7b2 2024-04-23T13:54:24+01:00 nova-compute[356689]: 2024-04-23 13:54:24.060 356689 INFO nova.scheduler.client.report [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] [req-4c4fb37c-1281-4516-90b2-7b88dd061549] Created resource provider record via placement API for resource provider with UUID 379c66b6-efcf-4464-a8b4-14f0d425f7b2 and name mz640. 2024-04-23T13:54:25+01:00 nova-compute[356689]: 2024-04-23 13:54:25.111 356689 INFO nova.virt.libvirt.host [None req-7c1e8b4e-c600-493c-8658-094fb30d66d8 - - - - - -] kernel doesn't support AMD SEV 2024-04-23T13:54:25+01:00 privsep-helper[357652]: 2024-04-23 13:54:25.682 357652 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T13:54:25+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 13:54:25.682 357652 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T14:04:11+01:00 nova-compute[356689]: 2024-04-23 14:04:11.845 356689 INFO nova.compute.claims [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] [instance: 7b6e3b99-228c-40a7-aea8-19eb292612d9] Claim successful on node mz640 2024-04-23T14:04:12+01:00 nova-compute[356689]: 2024-04-23 14:04:12.308 356689 INFO nova.virt.libvirt.driver [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] [instance: 7b6e3b99-228c-40a7-aea8-19eb292612d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names 2024-04-23T14:04:12+01:00 nova-compute[356689]: 2024-04-23 14:04:12.468 356689 INFO nova.virt.libvirt.driver [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] [instance: 7b6e3b99-228c-40a7-aea8-19eb292612d9] Creating image(s) 2024-04-23T14:04:52+01:00 nova-compute[356689]: 2024-04-23 14:04:52.663 356689 INFO oslo.privsep.daemon [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf.d', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprz07st26/privsep.sock'] 2024-04-23T14:04:54+01:00 nova-compute[356689]: 2024-04-23 14:04:54.425 356689 INFO oslo.privsep.daemon [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] Spawned new privsep daemon via rootwrap 2024-04-23T14:04:54+01:00 nova-compute[356689]: 2024-04-23 14:04:54.296 401786 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T14:04:54+01:00 nova-compute[356689]: 2024-04-23 14:04:54.304 401786 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T14:04:54+01:00 nova-compute[356689]: 2024-04-23 14:04:54.308 401786 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T14:04:54+01:00 nova-compute[356689]: 2024-04-23 14:04:54.308 401786 INFO oslo.privsep.daemon [-] privsep daemon running as pid 401786 2024-04-23T14:04:55+01:00 nova-compute[356689]: 2024-04-23 14:04:55.540 356689 INFO oslo.privsep.daemon [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf.d', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpu2y8_ovi/privsep.sock'] 2024-04-23T14:04:57+01:00 nova-compute[356689]: 2024-04-23 14:04:57.297 356689 INFO oslo.privsep.daemon [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] Spawned new privsep daemon via rootwrap 2024-04-23T14:04:57+01:00 nova-compute[356689]: 2024-04-23 14:04:57.165 401921 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T14:04:57+01:00 nova-compute[356689]: 2024-04-23 14:04:57.173 401921 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T14:04:57+01:00 nova-compute[356689]: 2024-04-23 14:04:57.177 401921 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none 2024-04-23T14:04:57+01:00 nova-compute[356689]: 2024-04-23 14:04:57.177 401921 INFO oslo.privsep.daemon [-] privsep daemon running as pid 401921 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.069 356689 INFO os_vif [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:7b:5d,bridge_name='br-int',has_traffic_filtering=True,id=41d216e4-897f-414a-b4d8-55975bdadad2,network=Network(1bece067-e40c-4364-83b4-dd5454b96267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d216e4-89') 2024-04-23T14:04:58+01:00 -[354948]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.243" (uid=0 pid=354948 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T14:04:58+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:04:58.173 356822 INFO neutron.agent.ovn.metadata.agent [-] Port 41d216e4-897f-414a-b4d8-55975bdadad2 in datapath 1bece067-e40c-4364-83b4-dd5454b96267 bound to our chassis 2024-04-23T14:04:58+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:04:58.177 356822 INFO neutron.agent.ovn.metadata.agent [-] Provisioning metadata for network 1bece067-e40c-4364-83b4-dd5454b96267 2024-04-23T14:04:58+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:04:58.180 356822 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmp2lycpc7u/privsep.sock'] 2024-04-23T14:04:58+01:00 -[354948]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.243" (uid=0 pid=354948 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T14:04:58+01:00 nova-compute[356689]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.464 356689 ERROR nova.virt.libvirt.driver [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] [instance: 7b6e3b99-228c-40a7-aea8-19eb292612d9] Failed to start libvirt guest: libvirt.libvirtError: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.243" (uid=0 pid=354948 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.478 356689 INFO os_vif [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:7b:5d,bridge_name='br-int',has_traffic_filtering=True,id=41d216e4-897f-414a-b4d8-55975bdadad2,network=Network(1bece067-e40c-4364-83b4-dd5454b96267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d216e4-89') 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.479 356689 INFO nova.virt.libvirt.driver [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] [instance: 7b6e3b99-228c-40a7-aea8-19eb292612d9] Deleting instance files /var/snap/openstack-hypervisor/common/lib/nova/instances/7b6e3b99-228c-40a7-aea8-19eb292612d9_del 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.480 356689 INFO nova.virt.libvirt.driver [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] [instance: 7b6e3b99-228c-40a7-aea8-19eb292612d9] Deletion of /var/snap/openstack-hypervisor/common/lib/nova/instances/7b6e3b99-228c-40a7-aea8-19eb292612d9_del complete 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.561 356689 INFO nova.virt.libvirt.host [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] UEFI support detected 2024-04-23T14:04:58+01:00 nova-compute[356689]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.570 356689 INFO nova.compute.manager [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] [instance: 7b6e3b99-228c-40a7-aea8-19eb292612d9] Terminating instance 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.578 356689 INFO nova.virt.libvirt.driver [-] [instance: 7b6e3b99-228c-40a7-aea8-19eb292612d9] Instance destroyed successfully. 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.583 356689 INFO os_vif [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:7b:5d,bridge_name='br-int',has_traffic_filtering=True,id=41d216e4-897f-414a-b4d8-55975bdadad2,network=Network(1bece067-e40c-4364-83b4-dd5454b96267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d216e4-89') 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.584 356689 INFO nova.virt.libvirt.driver [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] [instance: 7b6e3b99-228c-40a7-aea8-19eb292612d9] Deletion of /var/snap/openstack-hypervisor/common/lib/nova/instances/7b6e3b99-228c-40a7-aea8-19eb292612d9_del complete 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.660 356689 INFO nova.compute.manager [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] [instance: 7b6e3b99-228c-40a7-aea8-19eb292612d9] Took 0.09 seconds to destroy the instance on the hypervisor. 2024-04-23T14:04:58+01:00 nova-compute[356689]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T14:04:58+01:00 nova-compute[356689]: 2024-04-23 14:04:58.861 356689 INFO os_vif [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:7b:5d,bridge_name='br-int',has_traffic_filtering=True,id=41d216e4-897f-414a-b4d8-55975bdadad2,network=Network(1bece067-e40c-4364-83b4-dd5454b96267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d216e4-89') 2024-04-23T14:04:59+01:00 nova-compute[356689]: 2024-04-23 14:04:59.455 356689 INFO nova.compute.manager [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] [instance: 7b6e3b99-228c-40a7-aea8-19eb292612d9] Took 0.59 seconds to deallocate network for instance. 2024-04-23T14:04:59+01:00 nova-compute[356689]: 2024-04-23 14:04:59.649 356689 INFO nova.scheduler.client.report [None req-90fb97d5-5d94-401b-80a7-7730dbc3e9b1 bb347a5e5a4b478a8923fc6f7e7121a4 c922b3914c224687ba489c4c023fb5fb - - 1473357ec77d438bb4d5b506cbae2f89 1473357ec77d438bb4d5b506cbae2f89] Deleted allocations for instance 7b6e3b99-228c-40a7-aea8-19eb292612d9 2024-04-23T14:04:59+01:00 privsep-helper[401983]: 2024-04-23 14:04:59.854 401983 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T14:04:59+01:00 privsep-helper[401983]: 2024-04-23 14:04:59.861 401983 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T14:04:59+01:00 privsep-helper[401983]: 2024-04-23 14:04:59.864 401983 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T14:04:59+01:00 privsep-helper[401983]: 2024-04-23 14:04:59.865 401983 INFO oslo.privsep.daemon [-] privsep daemon running as pid 401983 2024-04-23T14:04:59+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:04:59.991 356822 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T14:04:59+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:04:59.854 401983 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T14:04:59+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:04:59.861 401983 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T14:04:59+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:04:59.864 401983 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T14:04:59+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:04:59.865 401983 INFO oslo.privsep.daemon [-] privsep daemon running as pid 401983 2024-04-23T14:05:04+01:00 privsep-helper[401983]: 2024-04-23 14:05:04.582 401983 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T14:05:04+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:05:04.582 401983 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T14:05:04+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:05:04.701 356822 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.link_cmd', '--privsep_sock_path', '/tmp/tmp95rsag2x/privsep.sock'] 2024-04-23T14:05:06+01:00 privsep-helper[402560]: 2024-04-23 14:05:06.331 402560 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T14:05:06+01:00 privsep-helper[402560]: 2024-04-23 14:05:06.338 402560 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T14:05:06+01:00 privsep-helper[402560]: 2024-04-23 14:05:06.342 402560 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T14:05:06+01:00 privsep-helper[402560]: 2024-04-23 14:05:06.342 402560 INFO oslo.privsep.daemon [-] privsep daemon running as pid 402560 2024-04-23T14:05:06+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:05:06.477 356822 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T14:05:06+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:05:06.331 402560 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T14:05:06+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:05:06.338 402560 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T14:05:06+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:05:06.342 402560 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T14:05:06+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:05:06.342 402560 INFO oslo.privsep.daemon [-] privsep daemon running as pid 402560 2024-04-23T14:05:10+01:00 privsep-helper[402560]: 2024-04-23 14:05:10.977 402560 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T14:05:10+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:05:10.977 402560 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T14:05:11+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:05:11.560 356822 INFO neutron.agent.ovn.metadata.agent [-] Port 41d216e4-897f-414a-b4d8-55975bdadad2 in datapath 1bece067-e40c-4364-83b4-dd5454b96267 unbound from our chassis 2024-04-23T14:05:11+01:00 neutron-ovn-metadata-agent[356822]: 2024-04-23 14:05:11.563 356822 INFO neutron.agent.ovn.metadata.agent [-] Cleaning up ovnmeta-1bece067-e40c-4364-83b4-dd5454b96267 namespace which is not needed anymore