2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.libvirtd. 2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ceilometer-compute-agent. 2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T08:03:31+01:00 systemd[1]: Starting Service for snap application openstack-hypervisor.ovsdb-server... 2024-04-23T08:03:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.virtlogd. 2024-04-23T08:03:35+01:00 openstack-hypervisor.virtlogd[2923]: update.go:85: cannot change mount namespace according to change mount (/var/lib/snapd/hostfs/boot /boot none bind,ro 0 0): permission denied 2024-04-23T08:03:39+01:00 -[2329]: libvirt version: 8.0.0 2024-04-23T08:03:39+01:00 -[2329]: hostname: mz640 2024-04-23T08:03:39+01:00 -[2329]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:03:39+01:00 openstack-hypervisor.ovsdb-server[3707]: * Starting ovsdb-server 2024-04-23T08:03:39+01:00 ovs-vsctl[4022]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- init -- set Open_vSwitch . db-version=8.4.0 2024-04-23T08:03:39+01:00 ovs-vsctl[4249]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait set Open_vSwitch . ovs-version=3.2.0 "external-ids:system-id=\"mz640\"" "external-ids:rundir=\"/var/snap/openstack-hypervisor/common/run/openvswitch\"" "system-type=\"ubuntu-core\"" "system-version=\"22\"" 2024-04-23T08:03:39+01:00 openstack-hypervisor.ovsdb-server[3707]: * Configuring Open vSwitch system IDs 2024-04-23T08:03:39+01:00 ovs-vsctl[4259]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait add Open_vSwitch . external-ids hostname=mz640 2024-04-23T08:03:39+01:00 openstack-hypervisor.ovsdb-server[3707]: * Enabling remote OVSDB managers 2024-04-23T08:03:40+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ovsdb-server. 2024-04-23T08:03:40+01:00 systemd[1]: Starting Service for snap application openstack-hypervisor.ovs-vswitchd... 2024-04-23T08:03:40+01:00 openstack-hypervisor.ovs-vswitchd[4275]: * Starting ovs-vswitchd 2024-04-23T08:03:40+01:00 ovs-vsctl[4511]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait add Open_vSwitch . external-ids hostname=mz640 2024-04-23T08:03:40+01:00 openstack-hypervisor.ovs-vswitchd[4275]: * Enabling remote OVSDB managers 2024-04-23T08:03:40+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ovs-vswitchd. 2024-04-23T08:03:40+01:00 systemd[1]: Starting Service for snap application openstack-hypervisor.ovn-controller... 2024-04-23T08:03:40+01:00 openstack-hypervisor.ovn-controller[4515]: * Starting ovn-controller 2024-04-23T08:03:40+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.ovn-controller. 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.533 5199 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.544 5199 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.544 5199 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils yield 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils self.run() 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:44+01:00 openstack-hypervisor.ceilometer-compute-agent[5199]: 2024-04-23 08:03:44.995 5199 ERROR cotyledon._utils 2024-04-23T08:03:45+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:45.002 3691 INFO cotyledon._service_manager [-] Child 5199 exited with status 2 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.027 5203 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.030 5203 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.031 5203 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils yield 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils self.run() 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[5203]: 2024-04-23 08:03:45.344 5203 ERROR cotyledon._utils 2024-04-23T08:03:45+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:45.351 3691 INFO cotyledon._service_manager [-] Child 5203 exited with status 2 2024-04-23T08:03:45+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:45.352 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:03:47+01:00 nova-api-metadata[3690]: 2024-04-23 08:03:47.491 3690 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T08:03:47+01:00 nova-api-metadata[3690]: 2024-04-23 08:03:47.729 3690 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T08:03:47+01:00 nova-api-metadata[3690]: 2024-04-23 08:03:47.730 3690 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T08:03:48+01:00 nova-compute[3689]: 2024-04-23 08:03:48.452 3689 INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs 2024-04-23T08:03:48+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:03:48.779 3688 INFO neutron.common.config [-] Logging enabled! 2024-04-23T08:03:48+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:03:48.780 3688 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T08:03:49+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:03:49.000 3688 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T08:03:49+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:03:49.000 3688 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T08:03:49+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:03:49.011 3688 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.365 5701 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.369 5701 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.370 5701 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils yield 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils self.run() 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5701]: 2024-04-23 08:03:50.704 5701 ERROR cotyledon._utils 2024-04-23T08:03:50+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:50.711 3691 INFO cotyledon._service_manager [-] Child 5701 exited with status 2 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:50.721 5833 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:50.725 5833 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:50+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:50.726 5833 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils yield 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils self.run() 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[5833]: 2024-04-23 08:03:51.049 5833 ERROR cotyledon._utils 2024-04-23T08:03:51+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:51.056 3691 INFO cotyledon._service_manager [-] Child 5833 exited with status 2 2024-04-23T08:03:51+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:51.057 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:03:52+01:00 nova-api-metadata[5265]: 2024-04-23 08:03:52.774 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 1.0 seconds): TimeoutError: timed out 2024-04-23T08:03:52+01:00 nova-api-metadata[5262]: 2024-04-23 08:03:52.774 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 1.0 seconds): TimeoutError: timed out 2024-04-23T08:03:52+01:00 nova-api-metadata[5264]: 2024-04-23 08:03:52.774 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 1.0 seconds): TimeoutError: timed out 2024-04-23T08:03:52+01:00 nova-api-metadata[5263]: 2024-04-23 08:03:52.774 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 1.0 seconds): TimeoutError: timed out 2024-04-23T08:03:54+01:00 nova-compute[3689]: 2024-04-23 08:03:54.226 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 1.0 seconds): TimeoutError: timed out 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.069 7929 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.072 7929 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.073 7929 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils yield 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils self.run() 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7929]: 2024-04-23 08:03:56.376 7929 ERROR cotyledon._utils 2024-04-23T08:03:56+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:56.382 3691 INFO cotyledon._service_manager [-] Child 7929 exited with status 2 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.392 7988 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.396 7988 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.396 7988 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils yield 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils self.run() 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[7988]: 2024-04-23 08:03:56.705 7988 ERROR cotyledon._utils 2024-04-23T08:03:56+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:56.712 3691 INFO cotyledon._service_manager [-] Child 7988 exited with status 2 2024-04-23T08:03:56+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:03:56.713 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:03:58+01:00 nova-api-metadata[5265]: 2024-04-23 08:03:58.786 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 3.0 seconds): TimeoutError: timed out 2024-04-23T08:03:58+01:00 nova-api-metadata[5262]: 2024-04-23 08:03:58.789 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 3.0 seconds): TimeoutError: timed out 2024-04-23T08:03:58+01:00 nova-api-metadata[5264]: 2024-04-23 08:03:58.791 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 3.0 seconds): TimeoutError: timed out 2024-04-23T08:03:58+01:00 nova-api-metadata[5263]: 2024-04-23 08:03:58.795 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 3.0 seconds): TimeoutError: timed out 2024-04-23T08:04:00+01:00 nova-compute[3689]: 2024-04-23 08:04:00.234 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 3.0 seconds): TimeoutError: timed out 2024-04-23T08:04:01+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:01.725 10057 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:01+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:01.729 10057 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:01+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:01.730 10057 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils yield 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils self.run() 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10057]: 2024-04-23 08:04:02.039 10057 ERROR cotyledon._utils 2024-04-23T08:04:02+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:02.046 3691 INFO cotyledon._service_manager [-] Child 10057 exited with status 2 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.054 10307 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.057 10307 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.058 10307 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils yield 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils self.run() 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[10307]: 2024-04-23 08:04:02.356 10307 ERROR cotyledon._utils 2024-04-23T08:04:02+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:02.362 3691 INFO cotyledon._service_manager [-] Child 10307 exited with status 2 2024-04-23T08:04:02+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:02.363 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:04:06+01:00 nova-api-metadata[5265]: 2024-04-23 08:04:06.793 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 5.0 seconds): TimeoutError: timed out 2024-04-23T08:04:06+01:00 nova-api-metadata[5262]: 2024-04-23 08:04:06.797 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 5.0 seconds): TimeoutError: timed out 2024-04-23T08:04:06+01:00 nova-api-metadata[5264]: 2024-04-23 08:04:06.797 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 5.0 seconds): TimeoutError: timed out 2024-04-23T08:04:06+01:00 nova-api-metadata[5263]: 2024-04-23 08:04:06.805 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 5.0 seconds): TimeoutError: timed out 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.373 11317 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.377 11317 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.378 11317 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils yield 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils self.run() 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11317]: 2024-04-23 08:04:07.682 11317 ERROR cotyledon._utils 2024-04-23T08:04:07+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:07.690 3691 INFO cotyledon._service_manager [-] Child 11317 exited with status 2 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:07.699 11362 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:07.703 11362 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:07+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:07.703 11362 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils yield 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils self.run() 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[11362]: 2024-04-23 08:04:08.013 11362 ERROR cotyledon._utils 2024-04-23T08:04:08+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:08.019 3691 INFO cotyledon._service_manager [-] Child 11362 exited with status 2 2024-04-23T08:04:08+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:08.020 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:04:08+01:00 nova-compute[3689]: 2024-04-23 08:04:08.241 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 5.0 seconds): TimeoutError: timed out 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.034 13424 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.038 13424 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.039 13424 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils yield 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils self.run() 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13424]: 2024-04-23 08:04:13.352 13424 ERROR cotyledon._utils 2024-04-23T08:04:13+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:13.360 3691 INFO cotyledon._service_manager [-] Child 13424 exited with status 2 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.373 13566 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.378 13566 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.378 13566 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils yield 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils self.run() 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[13566]: 2024-04-23 08:04:13.710 13566 ERROR cotyledon._utils 2024-04-23T08:04:13+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:13.718 3691 INFO cotyledon._service_manager [-] Child 13566 exited with status 2 2024-04-23T08:04:13+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:13.719 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:04:16+01:00 nova-api-metadata[5265]: 2024-04-23 08:04:16.801 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 7.0 seconds): TimeoutError: timed out 2024-04-23T08:04:16+01:00 nova-api-metadata[5262]: 2024-04-23 08:04:16.805 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 7.0 seconds): TimeoutError: timed out 2024-04-23T08:04:16+01:00 nova-api-metadata[5264]: 2024-04-23 08:04:16.805 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 7.0 seconds): TimeoutError: timed out 2024-04-23T08:04:16+01:00 nova-api-metadata[5263]: 2024-04-23 08:04:16.821 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 7.0 seconds): TimeoutError: timed out 2024-04-23T08:04:18+01:00 nova-compute[3689]: 2024-04-23 08:04:18.250 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 7.0 seconds): TimeoutError: timed out 2024-04-23T08:04:18+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:18.731 16436 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:18+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:18.734 16436 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:18+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:18.735 16436 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils yield 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils self.run() 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16436]: 2024-04-23 08:04:19.044 16436 ERROR cotyledon._utils 2024-04-23T08:04:19+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:19.050 3691 INFO cotyledon._service_manager [-] Child 16436 exited with status 2 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.059 16484 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.064 16484 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.065 16484 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils [-] Unhandled exception: TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils Traceback (most recent call last): 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_utils.py", line 95, in exit_on_exception 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils yield 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/cotyledon/_service.py", line 139, in _run 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils self.run() 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 519, in run 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils self.polling_manager = PollingManager(self.conf) 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils File "/snap/openstack-hypervisor/123/usr/lib/python3/dist-packages/ceilometer/polling/manager.py", line 673, in __init__ 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils if 'sources' not in cfg: 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils TypeError: argument of type 'NoneType' is not iterable 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[16484]: 2024-04-23 08:04:19.377 16484 ERROR cotyledon._utils 2024-04-23T08:04:19+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:19.384 3691 INFO cotyledon._service_manager [-] Child 16484 exited with status 2 2024-04-23T08:04:19+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:19.385 3691 INFO cotyledon._service_manager [-] Forking too fast, sleeping 2024-04-23T08:04:20+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.ceilometer-compute-agent... 2024-04-23T08:04:20+01:00 openstack-hypervisor.ceilometer-compute-agent[3691]: 2024-04-23 08:04:20.831 3691 INFO cotyledon._service_manager [-] Caught SIGTERM signal, graceful exiting of master process 2024-04-23T08:04:24+01:00 openstack-hypervisor.ceilometer-compute-agent[17631]: 2024-04-23 08:04:24.398 17631 INFO ceilometer.polling.manager [-] Looking for dynamic pollsters configurations at [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:24+01:00 openstack-hypervisor.ceilometer-compute-agent[17631]: 2024-04-23 08:04:24.402 17631 INFO ceilometer.polling.manager [-] No dynamic pollsters found in folder [/etc/ceilometer/pollsters.d]. 2024-04-23T08:04:24+01:00 openstack-hypervisor.ceilometer-compute-agent[17631]: 2024-04-23 08:04:24.403 17631 INFO ceilometer.polling.manager [-] No dynamic pollsters file found in dirs [['/etc/ceilometer/pollsters.d']]. 2024-04-23T08:04:24+01:00 openstack-hypervisor.ceilometer-compute-agent[17631]: 2024-04-23 08:04:24.715 17631 INFO cotyledon._service [-] Caught SIGTERM signal, graceful exiting of service AgentManager(0) [17631] 2024-04-23T08:04:24+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:04:25+01:00 systemd[1]: snap.openstack-hypervisor.ceilometer-compute-agent.service: Deactivated successfully. 2024-04-23T08:04:25+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.ceilometer-compute-agent. 2024-04-23T08:04:28+01:00 nova-api-metadata[5265]: 2024-04-23 08:04:28.814 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 9.0 seconds): TimeoutError: timed out 2024-04-23T08:04:28+01:00 nova-api-metadata[5264]: 2024-04-23 08:04:28.817 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 9.0 seconds): TimeoutError: timed out 2024-04-23T08:04:28+01:00 nova-api-metadata[5262]: 2024-04-23 08:04:28.817 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 9.0 seconds): TimeoutError: timed out 2024-04-23T08:04:28+01:00 nova-api-metadata[5263]: 2024-04-23 08:04:28.835 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 9.0 seconds): TimeoutError: timed out 2024-04-23T08:04:30+01:00 nova-compute[3689]: 2024-04-23 08:04:30.266 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 9.0 seconds): TimeoutError: timed out 2024-04-23T08:04:42+01:00 nova-api-metadata[5265]: 2024-04-23 08:04:42.829 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 11.0 seconds): TimeoutError: timed out 2024-04-23T08:04:42+01:00 nova-api-metadata[5264]: 2024-04-23 08:04:42.833 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 11.0 seconds): TimeoutError: timed out 2024-04-23T08:04:42+01:00 nova-api-metadata[5262]: 2024-04-23 08:04:42.834 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 11.0 seconds): TimeoutError: timed out 2024-04-23T08:04:42+01:00 nova-api-metadata[5263]: 2024-04-23 08:04:42.849 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 11.0 seconds): TimeoutError: timed out 2024-04-23T08:04:44+01:00 nova-compute[3689]: 2024-04-23 08:04:44.281 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 11.0 seconds): TimeoutError: timed out 2024-04-23T08:04:58+01:00 nova-api-metadata[5265]: 2024-04-23 08:04:58.846 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 13.0 seconds): TimeoutError: timed out 2024-04-23T08:04:58+01:00 nova-api-metadata[5262]: 2024-04-23 08:04:58.849 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 13.0 seconds): TimeoutError: timed out 2024-04-23T08:04:58+01:00 nova-api-metadata[5264]: 2024-04-23 08:04:58.850 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 13.0 seconds): TimeoutError: timed out 2024-04-23T08:04:58+01:00 nova-api-metadata[5263]: 2024-04-23 08:04:58.865 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 13.0 seconds): TimeoutError: timed out 2024-04-23T08:05:00+01:00 nova-compute[3689]: 2024-04-23 08:05:00.297 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 13.0 seconds): TimeoutError: timed out 2024-04-23T08:05:16+01:00 nova-api-metadata[5264]: 2024-04-23 08:05:16.866 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 15.0 seconds): TimeoutError: timed out 2024-04-23T08:05:16+01:00 nova-api-metadata[5265]: 2024-04-23 08:05:16.866 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 15.0 seconds): TimeoutError: timed out 2024-04-23T08:05:16+01:00 nova-api-metadata[5262]: 2024-04-23 08:05:16.869 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 15.0 seconds): TimeoutError: timed out 2024-04-23T08:05:16+01:00 nova-api-metadata[5263]: 2024-04-23 08:05:16.885 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 15.0 seconds): TimeoutError: timed out 2024-04-23T08:05:18+01:00 nova-compute[3689]: 2024-04-23 08:05:18.313 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 15.0 seconds): TimeoutError: timed out 2024-04-23T08:05:36+01:00 nova-api-metadata[5264]: 2024-04-23 08:05:36.885 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 17.0 seconds): TimeoutError: timed out 2024-04-23T08:05:36+01:00 nova-api-metadata[5265]: 2024-04-23 08:05:36.885 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 17.0 seconds): TimeoutError: timed out 2024-04-23T08:05:36+01:00 nova-api-metadata[5262]: 2024-04-23 08:05:36.889 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 17.0 seconds): TimeoutError: timed out 2024-04-23T08:05:36+01:00 nova-api-metadata[5263]: 2024-04-23 08:05:36.912 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 17.0 seconds): TimeoutError: timed out 2024-04-23T08:05:38+01:00 nova-compute[3689]: 2024-04-23 08:05:38.335 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 17.0 seconds): TimeoutError: timed out 2024-04-23T08:05:58+01:00 nova-api-metadata[5264]: 2024-04-23 08:05:58.908 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 19.0 seconds): TimeoutError: timed out 2024-04-23T08:05:58+01:00 nova-api-metadata[5262]: 2024-04-23 08:05:58.909 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 19.0 seconds): TimeoutError: timed out 2024-04-23T08:05:58+01:00 nova-api-metadata[5265]: 2024-04-23 08:05:58.909 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 19.0 seconds): TimeoutError: timed out 2024-04-23T08:05:58+01:00 nova-api-metadata[5263]: 2024-04-23 08:05:58.936 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 19.0 seconds): TimeoutError: timed out 2024-04-23T08:06:00+01:00 nova-compute[3689]: 2024-04-23 08:06:00.354 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 19.0 seconds): TimeoutError: timed out 2024-04-23T08:06:03+01:00 neutron-ovn-metadata-agent[3688]: 2024-04-23 08:06:03.740 3688 ERROR ovsdbapp.backend.ovs_idl.idlutils [-] Unable to open stream to ssl:10.20.21.10:6642 to retrieve schema: Exec format error 2024-04-23T08:06:22+01:00 nova-api-metadata[5264]: 2024-04-23 08:06:22.930 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 21.0 seconds): TimeoutError: timed out 2024-04-23T08:06:22+01:00 nova-api-metadata[5262]: 2024-04-23 08:06:22.931 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 21.0 seconds): TimeoutError: timed out 2024-04-23T08:06:22+01:00 nova-api-metadata[5265]: 2024-04-23 08:06:22.933 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 21.0 seconds): TimeoutError: timed out 2024-04-23T08:06:22+01:00 nova-api-metadata[5263]: 2024-04-23 08:06:22.958 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 21.0 seconds): TimeoutError: timed out 2024-04-23T08:06:24+01:00 nova-compute[3689]: 2024-04-23 08:06:24.375 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 21.0 seconds): TimeoutError: timed out 2024-04-23T08:06:48+01:00 nova-api-metadata[5264]: 2024-04-23 08:06:48.953 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 23.0 seconds): TimeoutError: timed out 2024-04-23T08:06:48+01:00 nova-api-metadata[5262]: 2024-04-23 08:06:48.961 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 23.0 seconds): TimeoutError: timed out 2024-04-23T08:06:48+01:00 nova-api-metadata[5265]: 2024-04-23 08:06:48.961 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 23.0 seconds): TimeoutError: timed out 2024-04-23T08:06:48+01:00 nova-api-metadata[5263]: 2024-04-23 08:06:48.984 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 23.0 seconds): TimeoutError: timed out 2024-04-23T08:06:50+01:00 nova-compute[3689]: 2024-04-23 08:06:50.401 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 23.0 seconds): TimeoutError: timed out 2024-04-23T08:07:17+01:00 nova-api-metadata[5265]: 2024-04-23 08:07:17.009 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 25.0 seconds): TimeoutError: timed out 2024-04-23T08:07:17+01:00 nova-api-metadata[5264]: 2024-04-23 08:07:17.012 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 25.0 seconds): TimeoutError: timed out 2024-04-23T08:07:17+01:00 nova-api-metadata[5262]: 2024-04-23 08:07:17.022 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 25.0 seconds): TimeoutError: timed out 2024-04-23T08:07:17+01:00 nova-api-metadata[5263]: 2024-04-23 08:07:17.050 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 25.0 seconds): TimeoutError: timed out 2024-04-23T08:07:18+01:00 nova-compute[3689]: 2024-04-23 08:07:18.513 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 25.0 seconds): TimeoutError: timed out 2024-04-23T08:07:47+01:00 nova-api-metadata[5264]: 2024-04-23 08:07:47.045 5264 ERROR oslo.messaging._drivers.impl_rabbit [None req-645bd33a-d269-45f1-8e59-8eb96912bf4d - - - - - -] Connection failed: timed out (retrying in 27.0 seconds): TimeoutError: timed out 2024-04-23T08:07:47+01:00 nova-api-metadata[5265]: 2024-04-23 08:07:47.047 5265 ERROR oslo.messaging._drivers.impl_rabbit [None req-ab7c43be-209e-44f9-89b2-ed438a3a41e0 - - - - - -] Connection failed: timed out (retrying in 27.0 seconds): TimeoutError: timed out 2024-04-23T08:07:47+01:00 nova-api-metadata[5262]: 2024-04-23 08:07:47.065 5262 ERROR oslo.messaging._drivers.impl_rabbit [None req-eb02d96b-a744-46dd-b9be-50a1ffa79961 - - - - - -] Connection failed: timed out (retrying in 27.0 seconds): TimeoutError: timed out 2024-04-23T08:07:47+01:00 nova-api-metadata[5263]: 2024-04-23 08:07:47.088 5263 ERROR oslo.messaging._drivers.impl_rabbit [None req-39fa57cc-720b-41d9-886c-b6ef5424bcfb - - - - - -] Connection failed: timed out (retrying in 27.0 seconds): TimeoutError: timed out 2024-04-23T08:07:48+01:00 nova-compute[3689]: 2024-04-23 08:07:48.548 3689 ERROR oslo.messaging._drivers.impl_rabbit [None req-62d60175-e745-48a6-9673-e425639e166b - - - - - -] Connection failed: timed out (retrying in 27.0 seconds): TimeoutError: timed out 2024-04-23T08:07:53+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent... 2024-04-23T08:07:53+01:00 systemd[1]: snap.openstack-hypervisor.neutron-ovn-metadata-agent.service: Deactivated successfully. 2024-04-23T08:07:53+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:07:55+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:07:55+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-compute... 2024-04-23T08:07:55+01:00 systemd[1]: snap.openstack-hypervisor.nova-compute.service: Deactivated successfully. 2024-04-23T08:07:55+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T08:07:57+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T08:07:58+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-api-metadata... 2024-04-23T08:07:58+01:00 nova-api-metadata[5262]: 2024-04-23 08:07:58.098 5262 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T08:07:58+01:00 nova-api-metadata[5265]: 2024-04-23 08:07:58.099 5265 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T08:07:58+01:00 nova-api-metadata[5263]: 2024-04-23 08:07:58.099 5263 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.103 3690 INFO oslo_service.service [-] Caught SIGTERM, stopping children 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.105 3690 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.105 3690 INFO oslo_service.service [-] Waiting on 4 children to exit 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.106 3690 INFO oslo_service.service [-] Child 5262 exited with status 0 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.106 3690 INFO oslo_service.service [-] Child 5264 killed by signal 15 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.106 3690 INFO oslo_service.service [-] Child 5265 killed by signal 15 2024-04-23T08:07:58+01:00 nova-api-metadata[3690]: 2024-04-23 08:07:58.108 3690 INFO oslo_service.service [-] Child 5263 killed by signal 15 2024-04-23T08:07:58+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Deactivated successfully. 2024-04-23T08:07:58+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T08:07:59+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T08:08:03+01:00 neutron-ovn-metadata-agent[73186]: 2024-04-23 08:08:03.242 73186 INFO neutron.common.config [-] Logging enabled! 2024-04-23T08:08:03+01:00 neutron-ovn-metadata-agent[73186]: 2024-04-23 08:08:03.243 73186 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T08:08:03+01:00 neutron-ovn-metadata-agent[73186]: 2024-04-23 08:08:03.266 73186 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T08:08:03+01:00 neutron-ovn-metadata-agent[73186]: 2024-04-23 08:08:03.267 73186 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T08:08:03+01:00 neutron-ovn-metadata-agent[73186]: 2024-04-23 08:08:03.277 73186 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T08:08:05+01:00 nova-compute[73270]: 2024-04-23 08:08:05.619 73270 INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs 2024-04-23T08:08:06+01:00 nova-compute[73270]: 2024-04-23 08:08:06.262 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:07+01:00 nova-api-metadata[73458]: 2024-04-23 08:08:07.000 73458 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T08:08:07+01:00 nova-api-metadata[73458]: 2024-04-23 08:08:07.202 73458 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T08:08:07+01:00 nova-api-metadata[73458]: 2024-04-23 08:08:07.203 73458 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T08:08:07+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:07.242 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:07+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:07.242 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:07+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:07.246 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:07+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:07.246 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:07+01:00 nova-compute[73270]: 2024-04-23 08:08:07.266 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:08+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:08.248 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:08+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:08.250 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:08+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:08.252 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:08+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:08.254 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:10+01:00 nova-compute[73270]: 2024-04-23 08:08:10.270 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:11+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:11.252 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:11+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:11.255 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:11+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:11.257 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:11+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:11.258 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:15+01:00 nova-compute[73270]: 2024-04-23 08:08:15.274 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:16+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:16.258 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:16+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:16.260 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:16+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:16.262 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:16+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:16.263 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:22+01:00 nova-compute[73270]: 2024-04-23 08:08:22.280 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:23+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:23.266 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:23+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:23.267 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:23+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:23.270 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:23+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:23.271 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:31+01:00 nova-compute[73270]: 2024-04-23 08:08:31.290 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:32+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:32.276 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:32+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:32.277 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:32+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:32.279 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:32+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:32.281 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:42+01:00 nova-compute[73270]: 2024-04-23 08:08:42.300 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:43+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:43.289 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:43+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:43.289 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:43+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:43.290 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:43+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:43.292 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:55+01:00 nova-compute[73270]: 2024-04-23 08:08:55.310 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:56+01:00 nova-api-metadata[73985]: 2024-04-23 08:08:56.302 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:56+01:00 nova-api-metadata[73986]: 2024-04-23 08:08:56.303 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:56+01:00 nova-api-metadata[73987]: 2024-04-23 08:08:56.304 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:56+01:00 nova-api-metadata[73984]: 2024-04-23 08:08:56.304 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:08:56+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent... 2024-04-23T08:08:56+01:00 systemd[1]: snap.openstack-hypervisor.neutron-ovn-metadata-agent.service: Deactivated successfully. 2024-04-23T08:08:56+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:08:58+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.372 77543 INFO neutron.common.config [-] Logging enabled! 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.373 77543 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.396 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.396 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.407 77543 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.438 77543 INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.443 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connecting... 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.452 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connected 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.470 77543 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.namespace_cmd', '--privsep_sock_path', '/tmp/tmpe7nt6kl5/privsep.sock'] 2024-04-23T08:09:06+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:06.471 77543 INFO eventlet.wsgi.server [-] (77543) wsgi starting up on http:/var/snap/openstack-hypervisor/common/lib/metadata_proxy 2024-04-23T08:09:08+01:00 privsep-helper[78185]: 2024-04-23 08:09:08.132 78185 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:09:08+01:00 privsep-helper[78185]: 2024-04-23 08:09:08.139 78185 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:09:08+01:00 privsep-helper[78185]: 2024-04-23 08:09:08.142 78185 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:09:08+01:00 privsep-helper[78185]: 2024-04-23 08:09:08.143 78185 INFO oslo.privsep.daemon [-] privsep daemon running as pid 78185 2024-04-23T08:09:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:08.271 77543 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T08:09:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:08.132 78185 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:09:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:08.139 78185 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:09:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:08.142 78185 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:09:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:08.143 78185 INFO oslo.privsep.daemon [-] privsep daemon running as pid 78185 2024-04-23T08:09:10+01:00 nova-compute[73270]: 2024-04-23 08:09:10.324 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:11+01:00 nova-api-metadata[73985]: 2024-04-23 08:09:11.317 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:11+01:00 nova-api-metadata[73986]: 2024-04-23 08:09:11.318 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:11+01:00 nova-api-metadata[73987]: 2024-04-23 08:09:11.319 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:11+01:00 nova-api-metadata[73984]: 2024-04-23 08:09:11.324 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:12+01:00 privsep-helper[78185]: 2024-04-23 08:09:12.896 78185 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:09:12+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:09:12.896 78185 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:09:27+01:00 nova-compute[73270]: 2024-04-23 08:09:27.338 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:28+01:00 nova-api-metadata[73985]: 2024-04-23 08:09:28.334 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:28+01:00 nova-api-metadata[73986]: 2024-04-23 08:09:28.336 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:28+01:00 nova-api-metadata[73987]: 2024-04-23 08:09:28.337 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:28+01:00 nova-api-metadata[73984]: 2024-04-23 08:09:28.338 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:46+01:00 nova-compute[73270]: 2024-04-23 08:09:46.356 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:47+01:00 nova-api-metadata[73985]: 2024-04-23 08:09:47.354 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:47+01:00 nova-api-metadata[73986]: 2024-04-23 08:09:47.354 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:47+01:00 nova-api-metadata[73987]: 2024-04-23 08:09:47.355 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:09:47+01:00 nova-api-metadata[73984]: 2024-04-23 08:09:47.356 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:07+01:00 nova-compute[73270]: 2024-04-23 08:10:07.373 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:08+01:00 nova-api-metadata[73984]: 2024-04-23 08:10:08.375 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:08+01:00 nova-api-metadata[73986]: 2024-04-23 08:10:08.375 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:08+01:00 nova-api-metadata[73987]: 2024-04-23 08:10:08.377 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:08+01:00 nova-api-metadata[73985]: 2024-04-23 08:10:08.377 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:30+01:00 nova-compute[73270]: 2024-04-23 08:10:30.394 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:31+01:00 nova-api-metadata[73984]: 2024-04-23 08:10:31.394 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:31+01:00 nova-api-metadata[73986]: 2024-04-23 08:10:31.398 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:31+01:00 nova-api-metadata[73985]: 2024-04-23 08:10:31.400 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:31+01:00 nova-api-metadata[73987]: 2024-04-23 08:10:31.400 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:55+01:00 nova-compute[73270]: 2024-04-23 08:10:55.416 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:56+01:00 nova-api-metadata[73984]: 2024-04-23 08:10:56.417 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:56+01:00 nova-api-metadata[73987]: 2024-04-23 08:10:56.423 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:56+01:00 nova-api-metadata[73986]: 2024-04-23 08:10:56.423 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:10:56+01:00 nova-api-metadata[73985]: 2024-04-23 08:10:56.425 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:22+01:00 nova-compute[73270]: 2024-04-23 08:11:22.440 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:23+01:00 nova-api-metadata[73984]: 2024-04-23 08:11:23.445 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:23+01:00 nova-api-metadata[73987]: 2024-04-23 08:11:23.447 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:23+01:00 nova-api-metadata[73985]: 2024-04-23 08:11:23.448 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:23+01:00 nova-api-metadata[73986]: 2024-04-23 08:11:23.448 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:51+01:00 nova-compute[73270]: 2024-04-23 08:11:51.469 73270 ERROR oslo.messaging._drivers.impl_rabbit [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:52+01:00 nova-api-metadata[73984]: 2024-04-23 08:11:52.473 73984 ERROR oslo.messaging._drivers.impl_rabbit [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:52+01:00 nova-api-metadata[73987]: 2024-04-23 08:11:52.476 73987 ERROR oslo.messaging._drivers.impl_rabbit [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:52+01:00 nova-api-metadata[73986]: 2024-04-23 08:11:52.477 73986 ERROR oslo.messaging._drivers.impl_rabbit [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:11:52+01:00 nova-api-metadata[73985]: 2024-04-23 08:11:52.478 73985 ERROR oslo.messaging._drivers.impl_rabbit [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED 2024-04-23T08:12:07+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:12:07.662 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connection closed by peer 2024-04-23T08:12:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:12:08.670 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connecting... 2024-04-23T08:12:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:12:08.687 77543 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connected 2024-04-23T08:12:08+01:00 neutron-ovn-metadata-agent[77543]: 2024-04-23 08:12:08.703 77543 INFO neutron.agent.ovn.metadata.agent [-] Connection to OVSDB established, doing a full sync 2024-04-23T08:12:23+01:00 nova-api-metadata[73984]: 2024-04-23 08:12:23.582 73984 INFO nova.metadata.wsgi.server [None req-84425494-3687-4191-9258-cd93047bb2a7 - - - - - -] (73984) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:12:23+01:00 nova-api-metadata[73985]: 2024-04-23 08:12:23.615 73985 INFO nova.metadata.wsgi.server [None req-9db45459-2cac-492e-b062-5684bbe9e470 - - - - - -] (73985) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:12:23+01:00 nova-api-metadata[73987]: 2024-04-23 08:12:23.628 73987 INFO nova.metadata.wsgi.server [None req-a3906eb4-e122-45aa-91ce-5682f4b41ce6 - - - - - -] (73987) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:12:23+01:00 nova-api-metadata[73986]: 2024-04-23 08:12:23.645 73986 INFO nova.metadata.wsgi.server [None req-ba9246e2-090f-4446-bce2-cf84bae79022 - - - - - -] (73986) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:12:23+01:00 nova-compute[73270]: 2024-04-23 08:12:23.736 73270 INFO nova.virt.driver [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] Loading compute driver 'libvirt.LibvirtDriver' 2024-04-23T08:12:24+01:00 nova-compute[73270]: 2024-04-23 08:12:24.598 73270 INFO nova.compute.provider_config [None req-664fee25-226d-4f11-bc63-283e307295cc - - - - - -] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. 2024-04-23T08:12:24+01:00 nova-compute[73270]: 2024-04-23 08:12:24.648 73270 INFO nova.service [-] Starting compute node (version 28.0.0) 2024-04-23T08:12:24+01:00 nova-compute[73270]: 2024-04-23 08:12:24.665 73270 INFO nova.virt.node [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] Determined node identity 1abf047e-3df5-4ce9-9e86-4ad5779eafe4 from /var/snap/openstack-hypervisor/common/lib/nova/compute_id 2024-04-23T08:12:24+01:00 nova-compute[73270]: 2024-04-23 08:12:24.685 73270 INFO nova.virt.libvirt.driver [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] Connection event '1' reason 'None' 2024-04-23T08:12:24+01:00 -[2329]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:12:24+01:00 -[2329]: Failed to get host power management capabilities 2024-04-23T08:12:26+01:00 nova-compute[73270]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T08:12:26+01:00 -[2329]: invalid argument: KVM is not supported by '/snap/openstack-hypervisor/123/usr/bin/qemu-system-aarch64' on this host 2024-04-23T08:12:26+01:00 nova-compute[73270]: 2024-04-23 08:12:26.567 73270 INFO nova.virt.libvirt.host [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] Secure Boot support detected 2024-04-23T08:12:26+01:00 nova-compute[73270]: 2024-04-23 08:12:26.652 73270 INFO nova.virt.node [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] Determined node identity 1abf047e-3df5-4ce9-9e86-4ad5779eafe4 from /var/snap/openstack-hypervisor/common/lib/nova/compute_id 2024-04-23T08:12:26+01:00 nova-compute[73270]: 2024-04-23 08:12:26.748 73270 INFO nova.compute.manager [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host 2024-04-23T08:12:32+01:00 nova-compute[73270]: 2024-04-23 08:12:32.658 73270 INFO nova.virt.libvirt.host [None req-a0622887-584e-48d6-886d-1e98d0394039 - - - - - -] kernel doesn't support AMD SEV 2024-04-23T08:12:54+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-api-metadata... 2024-04-23T08:12:54+01:00 nova-api-metadata[73987]: 2024-04-23 08:12:54.976 73987 INFO nova.wsgi [-] Stopping WSGI server. 2024-04-23T08:13:24+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: State 'final-sigterm' timed out. Killing. 2024-04-23T08:13:24+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Killing process 73458 (python3) with signal SIGKILL. 2024-04-23T08:13:24+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Failed with result 'timeout'. 2024-04-23T08:13:24+01:00 systemd[1]: snap.openstack-hypervisor.nova-api-metadata.service: Unit process 73458 (python3) remains running after unit stopped. 2024-04-23T08:13:24+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T08:13:26+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-api-metadata. 2024-04-23T08:13:27+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent... 2024-04-23T08:13:27+01:00 systemd[1]: snap.openstack-hypervisor.neutron-ovn-metadata-agent.service: Deactivated successfully. 2024-04-23T08:13:27+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:13:31+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:13:33+01:00 nova-api-metadata[109004]: 2024-04-23 08:13:33.653 109004 WARNING nova.service [-] Running nova-metadata using eventlet is deprecated. Deploy with a WSGI server such as uwsgi or mod_wsgi. 2024-04-23T08:13:33+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.nova-compute... 2024-04-23T08:13:33+01:00 -[2329]: End of file while reading data: Input/output error 2024-04-23T08:13:33+01:00 systemd[1]: snap.openstack-hypervisor.nova-compute.service: Deactivated successfully. 2024-04-23T08:13:33+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T08:13:33+01:00 nova-api-metadata[109004]: 2024-04-23 08:13:33.862 109004 INFO nova.wsgi [-] metadata listening on 0.0.0.0:8775 2024-04-23T08:13:33+01:00 nova-api-metadata[109004]: 2024-04-23 08:13:33.863 109004 INFO oslo_service.service [-] Starting 4 workers 2024-04-23T08:13:33+01:00 nova-api-metadata[109216]: 2024-04-23 08:13:33.941 109216 INFO nova.metadata.wsgi.server [None req-c3fe50da-e02f-4e9a-acb2-2673c3d322a3 - - - - - -] (109216) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:13:33+01:00 nova-api-metadata[109215]: 2024-04-23 08:13:33.952 109215 INFO nova.metadata.wsgi.server [None req-90a78731-a84e-45f5-86f3-c0916e9824f9 - - - - - -] (109215) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:13:33+01:00 nova-api-metadata[109217]: 2024-04-23 08:13:33.952 109217 INFO nova.metadata.wsgi.server [None req-09326c72-370f-493d-bc59-02e907ef4ff7 - - - - - -] (109217) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:13:33+01:00 nova-api-metadata[109218]: 2024-04-23 08:13:33.952 109218 INFO nova.metadata.wsgi.server [None req-f448e1bf-58f8-4512-937f-018da708ae26 - - - - - -] (109218) wsgi starting up on http://0.0.0.0:8775 2024-04-23T08:13:35+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.nova-compute. 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.795 109200 INFO neutron.common.config [-] Logging enabled! 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.796 109200 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.819 109200 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.820 109200 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.830 109200 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.863 109200 INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.870 109200 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connecting... 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.879 109200 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.152.183.120:6642: connected 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.899 109200 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.namespace_cmd', '--privsep_sock_path', '/tmp/tmp3k7glpx8/privsep.sock'] 2024-04-23T08:13:39+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:39.900 109200 INFO eventlet.wsgi.server [-] (109200) wsgi starting up on http:/var/snap/openstack-hypervisor/common/lib/metadata_proxy 2024-04-23T08:13:41+01:00 privsep-helper[109688]: 2024-04-23 08:13:41.560 109688 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:13:41+01:00 privsep-helper[109688]: 2024-04-23 08:13:41.568 109688 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:13:41+01:00 privsep-helper[109688]: 2024-04-23 08:13:41.572 109688 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:13:41+01:00 privsep-helper[109688]: 2024-04-23 08:13:41.572 109688 INFO oslo.privsep.daemon [-] privsep daemon running as pid 109688 2024-04-23T08:13:41+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:41.703 109200 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T08:13:41+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:41.560 109688 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:13:41+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:41.568 109688 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:13:41+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:41.572 109688 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:13:41+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:41.572 109688 INFO oslo.privsep.daemon [-] privsep daemon running as pid 109688 2024-04-23T08:13:43+01:00 nova-compute[109453]: 2024-04-23 08:13:43.640 109453 INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.071 109453 INFO nova.virt.driver [None req-69469530-2fb2-4748-90a5-95976ac3c036 - - - - - -] Loading compute driver 'libvirt.LibvirtDriver' 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.737 109453 INFO nova.compute.provider_config [None req-69469530-2fb2-4748-90a5-95976ac3c036 - - - - - -] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.778 109453 INFO nova.service [-] Starting compute node (version 28.0.0) 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.797 109453 INFO nova.virt.node [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] Determined node identity 1abf047e-3df5-4ce9-9e86-4ad5779eafe4 from /var/snap/openstack-hypervisor/common/lib/nova/compute_id 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.809 109453 INFO nova.virt.libvirt.driver [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] Connection event '1' reason 'None' 2024-04-23T08:13:45+01:00 -[2329]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:13:45+01:00 -[2329]: Failed to get host power management capabilities 2024-04-23T08:13:45+01:00 nova-compute[109453]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T08:13:45+01:00 -[2329]: invalid argument: KVM is not supported by '/snap/openstack-hypervisor/123/usr/bin/qemu-system-aarch64' on this host 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.872 109453 INFO nova.virt.libvirt.host [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] Secure Boot support detected 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.927 109453 INFO nova.virt.node [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] Determined node identity 1abf047e-3df5-4ce9-9e86-4ad5779eafe4 from /var/snap/openstack-hypervisor/common/lib/nova/compute_id 2024-04-23T08:13:45+01:00 nova-compute[109453]: 2024-04-23 08:13:45.987 109453 INFO nova.compute.manager [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host 2024-04-23T08:13:46+01:00 privsep-helper[109688]: 2024-04-23 08:13:46.247 109688 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:13:46+01:00 neutron-ovn-metadata-agent[109200]: 2024-04-23 08:13:46.247 109688 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:13:48+01:00 nova-compute[109453]: 2024-04-23 08:13:48.603 109453 INFO nova.virt.libvirt.host [None req-67aea852-e9f8-446e-b861-e96ae3d8929e - - - - - -] kernel doesn't support AMD SEV 2024-04-23T08:14:31+01:00 systemd[1]: Stopping Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent... 2024-04-23T08:14:31+01:00 systemd[1]: snap.openstack-hypervisor.neutron-ovn-metadata-agent.service: Deactivated successfully. 2024-04-23T08:14:31+01:00 systemd[1]: Stopped Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:14:33+01:00 systemd[1]: Started Service for snap application openstack-hypervisor.neutron-ovn-metadata-agent. 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.586 112632 INFO neutron.common.config [-] Logging enabled! 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.587 112632 INFO neutron.common.config [-] /snap/openstack-hypervisor/123/usr/bin/neutron-ovn-metadata-agent version 23.0.0 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.610 112632 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connecting... 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.611 112632 INFO ovsdbapp.backend.ovs_idl.vlog [-] unix:/var/snap/openstack-hypervisor/common/run/openvswitch/db.sock: connected 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.622 112632 WARNING neutron.agent.ovn.metadata.agent [-] Can't read ovn-bridge external-id from OVSDB. Using br-int instead. 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.653 112632 INFO neutron.agent.ovn.metadata.ovsdb [-] Getting OvsdbSbOvnIdl for MetadataAgent with retry 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.660 112632 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.20.21.10:6642: connecting... 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.668 112632 INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:10.20.21.10:6642: connected 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.688 112632 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.namespace_cmd', '--privsep_sock_path', '/tmp/tmpxn_zcfg3/privsep.sock'] 2024-04-23T08:14:41+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:41.690 112632 INFO eventlet.wsgi.server [-] (112632) wsgi starting up on http:/var/snap/openstack-hypervisor/common/lib/metadata_proxy 2024-04-23T08:14:43+01:00 privsep-helper[113041]: 2024-04-23 08:14:43.366 113041 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:14:43+01:00 privsep-helper[113041]: 2024-04-23 08:14:43.373 113041 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:14:43+01:00 privsep-helper[113041]: 2024-04-23 08:14:43.377 113041 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:14:43+01:00 privsep-helper[113041]: 2024-04-23 08:14:43.378 113041 INFO oslo.privsep.daemon [-] privsep daemon running as pid 113041 2024-04-23T08:14:43+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:43.511 112632 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T08:14:43+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:43.366 113041 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:14:43+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:43.373 113041 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:14:43+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:43.377 113041 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none 2024-04-23T08:14:43+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:43.378 113041 INFO oslo.privsep.daemon [-] privsep daemon running as pid 113041 2024-04-23T08:14:48+01:00 privsep-helper[113041]: 2024-04-23 08:14:48.060 113041 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:14:48+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:14:48.060 113041 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:53:44+01:00 nova-compute[109453]: 2024-04-23 08:53:44.320 109453 WARNING nova.virt.libvirt.imagecache [None req-1c6ec8dc-f1f3-4642-a992-5c4d8bbc5738 - - - - - -] Unknown base file: /var/snap/openstack-hypervisor/common/lib/nova/instances/_base/10196b30b7d57e26216b8dbf13f03153701aeecc 2024-04-23T08:53:44+01:00 nova-compute[109453]: 2024-04-23 08:53:44.322 109453 INFO nova.virt.libvirt.imagecache [None req-1c6ec8dc-f1f3-4642-a992-5c4d8bbc5738 - - - - - -] Removable base files: /var/snap/openstack-hypervisor/common/lib/nova/instances/_base/10196b30b7d57e26216b8dbf13f03153701aeecc 2024-04-23T08:53:44+01:00 nova-compute[109453]: 2024-04-23 08:53:44.323 109453 INFO nova.virt.libvirt.imagecache [None req-1c6ec8dc-f1f3-4642-a992-5c4d8bbc5738 - - - - - -] Base, swap or ephemeral file too young to remove: /var/snap/openstack-hypervisor/common/lib/nova/instances/_base/10196b30b7d57e26216b8dbf13f03153701aeecc 2024-04-23T08:56:43+01:00 nova-compute[109453]: 2024-04-23 08:56:43.516 109453 INFO nova.compute.claims [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Claim successful on node mz640 2024-04-23T08:56:43+01:00 nova-compute[109453]: 2024-04-23 08:56:43.836 109453 INFO nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names 2024-04-23T08:56:43+01:00 nova-compute[109453]: 2024-04-23 08:56:43.992 109453 INFO nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Creating image(s) 2024-04-23T08:56:43+01:00 nova-compute[109453]: 2024-04-23 08:56:43.995 109453 INFO oslo.privsep.daemon [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf.d', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpt10y7hcd/privsep.sock'] 2024-04-23T08:56:45+01:00 nova-compute[109453]: 2024-04-23 08:56:45.826 109453 INFO oslo.privsep.daemon [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Spawned new privsep daemon via rootwrap 2024-04-23T08:56:45+01:00 nova-compute[109453]: 2024-04-23 08:56:45.672 273260 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:45+01:00 nova-compute[109453]: 2024-04-23 08:56:45.680 273260 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:45+01:00 nova-compute[109453]: 2024-04-23 08:56:45.684 273260 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T08:56:45+01:00 nova-compute[109453]: 2024-04-23 08:56:45.684 273260 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273260 2024-04-23T08:56:48+01:00 nova-compute[109453]: 2024-04-23 08:56:48.398 109453 INFO oslo.privsep.daemon [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/nova/nova.conf.d', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpx768lfm_/privsep.sock'] 2024-04-23T08:56:50+01:00 nova-compute[109453]: 2024-04-23 08:56:50.277 109453 INFO oslo.privsep.daemon [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Spawned new privsep daemon via rootwrap 2024-04-23T08:56:50+01:00 nova-compute[109453]: 2024-04-23 08:56:50.104 273330 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:50+01:00 nova-compute[109453]: 2024-04-23 08:56:50.111 273330 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:50+01:00 nova-compute[109453]: 2024-04-23 08:56:50.115 273330 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none 2024-04-23T08:56:50+01:00 nova-compute[109453]: 2024-04-23 08:56:50.115 273330 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273330 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.046 109453 INFO os_vif [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bc:99,bridge_name='br-int',has_traffic_filtering=True,id=bd5253ad-2ca4-4430-b0e4-f763fcb61395,network=Network(4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5253ad-2c') 2024-04-23T08:56:51+01:00 -[2329]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:56:51+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:51.136 112632 INFO neutron.agent.ovn.metadata.agent [-] Port bd5253ad-2ca4-4430-b0e4-f763fcb61395 in datapath 4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d bound to our chassis 2024-04-23T08:56:51+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:51.140 112632 INFO neutron.agent.ovn.metadata.agent [-] Provisioning metadata for network 4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d 2024-04-23T08:56:51+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:51.142 112632 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmpwcnc2tt7/privsep.sock'] 2024-04-23T08:56:51+01:00 -[2329]: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:56:51+01:00 nova-compute[109453]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.433 109453 ERROR nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Failed to start libvirt guest: libvirt.libvirtError: error from service: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.62" (uid=0 pid=2329 comm="/snap/openstack-hypervisor/123/usr/sbin/libvirtd -" label="snap.openstack-hypervisor.libvirtd (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus) 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.445 109453 INFO os_vif [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bc:99,bridge_name='br-int',has_traffic_filtering=True,id=bd5253ad-2ca4-4430-b0e4-f763fcb61395,network=Network(4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5253ad-2c') 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.446 109453 INFO nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Deleting instance files /var/snap/openstack-hypervisor/common/lib/nova/instances/88c87dee-8964-42a8-9fa1-6985ed4201c3_del 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.447 109453 INFO nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Deletion of /var/snap/openstack-hypervisor/common/lib/nova/instances/88c87dee-8964-42a8-9fa1-6985ed4201c3_del complete 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.596 109453 INFO nova.virt.libvirt.host [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] UEFI support detected 2024-04-23T08:56:51+01:00 nova-compute[109453]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.605 109453 INFO nova.compute.manager [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Terminating instance 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.611 109453 INFO nova.virt.libvirt.driver [-] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Instance destroyed successfully. 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.617 109453 INFO os_vif [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bc:99,bridge_name='br-int',has_traffic_filtering=True,id=bd5253ad-2ca4-4430-b0e4-f763fcb61395,network=Network(4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5253ad-2c') 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.618 109453 INFO nova.virt.libvirt.driver [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Deletion of /var/snap/openstack-hypervisor/common/lib/nova/instances/88c87dee-8964-42a8-9fa1-6985ed4201c3_del complete 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.694 109453 INFO nova.compute.manager [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Took 0.09 seconds to destroy the instance on the hypervisor. 2024-04-23T08:56:51+01:00 nova-compute[109453]: - (error decoding original message: message key "MESSAGE" truncated) 2024-04-23T08:56:51+01:00 nova-compute[109453]: 2024-04-23 08:56:51.886 109453 INFO os_vif [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bc:99,bridge_name='br-int',has_traffic_filtering=True,id=bd5253ad-2ca4-4430-b0e4-f763fcb61395,network=Network(4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5253ad-2c') 2024-04-23T08:56:52+01:00 nova-compute[109453]: 2024-04-23 08:56:52.601 109453 INFO nova.compute.manager [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] [instance: 88c87dee-8964-42a8-9fa1-6985ed4201c3] Took 0.71 seconds to deallocate network for instance. 2024-04-23T08:56:52+01:00 privsep-helper[273427]: 2024-04-23 08:56:52.789 273427 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:52+01:00 privsep-helper[273427]: 2024-04-23 08:56:52.797 273427 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:52+01:00 privsep-helper[273427]: 2024-04-23 08:56:52.800 273427 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T08:56:52+01:00 privsep-helper[273427]: 2024-04-23 08:56:52.801 273427 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273427 2024-04-23T08:56:52+01:00 nova-compute[109453]: 2024-04-23 08:56:52.838 109453 INFO nova.scheduler.client.report [None req-cb201c16-59e9-4163-a409-542568fc657d d583325cb2d640b4843d2b32149a2a3e 5c1b7e906a7640bb88d49684f9aab388 - - 59bd5dbb491d43f8ae2a96a30a58a179 59bd5dbb491d43f8ae2a96a30a58a179] Deleted allocations for instance 88c87dee-8964-42a8-9fa1-6985ed4201c3 2024-04-23T08:56:52+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:52.926 112632 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T08:56:52+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:52.789 273427 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:52+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:52.797 273427 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:52+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:52.800 273427 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T08:56:52+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:52.801 273427 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273427 2024-04-23T08:56:57+01:00 privsep-helper[273427]: 2024-04-23 08:56:57.510 273427 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:56:57+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:57.510 273427 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:56:57+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:57.638 112632 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf', '--config-file', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron_ovn_metadata_agent.ini', '--config-dir', '/var/snap/openstack-hypervisor/common/etc/neutron/neutron.conf.d', '--privsep_context', 'neutron.privileged.link_cmd', '--privsep_sock_path', '/tmp/tmpuygsijv9/privsep.sock'] 2024-04-23T08:56:59+01:00 privsep-helper[273565]: 2024-04-23 08:56:59.271 273565 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:59+01:00 privsep-helper[273565]: 2024-04-23 08:56:59.278 273565 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:59+01:00 privsep-helper[273565]: 2024-04-23 08:56:59.282 273565 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T08:56:59+01:00 privsep-helper[273565]: 2024-04-23 08:56:59.282 273565 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273565 2024-04-23T08:56:59+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:59.419 112632 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2024-04-23T08:56:59+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:59.271 273565 INFO oslo.privsep.daemon [-] privsep daemon starting 2024-04-23T08:56:59+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:59.278 273565 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2024-04-23T08:56:59+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:59.282 273565 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2024-04-23T08:56:59+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:56:59.282 273565 INFO oslo.privsep.daemon [-] privsep daemon running as pid 273565 2024-04-23T08:57:03+01:00 privsep-helper[273565]: 2024-04-23 08:57:03.980 273565 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:57:03+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:57:03.980 273565 INFO oslo_utils.netutils [-] Could not determine default network interface, using ::1 for IPv6 address 2024-04-23T08:57:04+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:57:04.560 112632 INFO neutron.agent.ovn.metadata.agent [-] Port bd5253ad-2ca4-4430-b0e4-f763fcb61395 in datapath 4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d unbound from our chassis 2024-04-23T08:57:04+01:00 neutron-ovn-metadata-agent[112632]: 2024-04-23 08:57:04.563 112632 INFO neutron.agent.ovn.metadata.agent [-] Cleaning up ovnmeta-4c1aa57d-69a3-4e95-a13e-1bb5a2815d0d namespace which is not needed anymore 2024-04-23T09:07:36+01:00 nova-compute[109453]: 2024-04-23 09:07:36.153 109453 ERROR nova.compute.resource_tracker [None req-1c6ec8dc-f1f3-4642-a992-5c4d8bbc5738 - - - - - -] Skipping removal of allocations for deleted instances: Failed to retrieve allocations for resource provider 1abf047e-3df5-4ce9-9e86-4ad5779eafe4:
The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later.