---------------------------- /var/log/nova/nova-compute.log ----------------------------------
2021-04-18 21:04:07.575 3669 INFO nova.virt.libvirt.driver [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Deleting instance files /var/lib/nova/instances/7389252e-ce13-4a0f-a75d-6ff18e088bb3_del
2021-04-18 21:04:07.576 3669 INFO nova.virt.libvirt.driver [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Deletion of /var/lib/nova/instances/7389252e-ce13-4a0f-a75d-6ff18e088bb3_del complete
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Instance failed to spawn: nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Traceback (most recent call last):
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 6551, in _create_domain_and_network
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] post_xml_callback=post_xml_callback)
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] next(self.gen)
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 513, in wait_for_instance_event
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] actual_event = event.wait()
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/eventlet/event.py", line 125, in wait
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] result = hub.switch()
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 298, in switch
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] return self.greenlet.switch()
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] eventlet.timeout.Timeout: 300 seconds
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] During handling of the above exception, another exception occurred:
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Traceback (most recent call last):
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2614, in _build_resources
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] yield resources
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2378, in _build_and_run_instance
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] accel_info=accel_info)
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 3683, in spawn
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] cleanup_instance_disks=created_disks)
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 6574, in _create_domain_and_network
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] raise exception.VirtualInterfaceCreateException()
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:07.748 3669 INFO nova.compute.manager [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Terminating instance
2021-04-18 21:04:07.752 3669 INFO nova.virt.libvirt.driver [-] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Instance destroyed successfully.
2021-04-18 21:04:07.754 3669 INFO os_vif [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] Successfully unplugged vif VIFBridge(active=False,address=fa:16:3e:f3:84:0a,bridge_name='brq42839010-d3',has_traffic_filtering=True,id=22ca0a05-eaff-4d20-a6bb-238cd5eec031,network=Network(42839010-d321-4259-9e5b-47e0170995fd),plugin='linux_bridge',port_profile=<?>,preserve_on_delete=False,vif_name='tap22ca0a05-ea')
2021-04-18 21:04:07.755 3669 INFO nova.virt.libvirt.driver [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Deletion of /var/lib/nova/instances/7389252e-ce13-4a0f-a75d-6ff18e088bb3_del complete
2021-04-18 21:04:07.839 3669 INFO nova.compute.manager [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Took 0.09 seconds to destroy the instance on the hypervisor.
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Failed to allocate network(s): nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Traceback (most recent call last):
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 6551, in _create_domain_and_network
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] post_xml_callback=post_xml_callback)
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] next(self.gen)
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 513, in wait_for_instance_event
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] actual_event = event.wait()
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/eventlet/event.py", line 125, in wait
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] result = hub.switch()
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 298, in switch
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] return self.greenlet.switch()
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] eventlet.timeout.Timeout: 300 seconds
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] During handling of the above exception, another exception occurred:
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Traceback (most recent call last):
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2378, in _build_and_run_instance
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] accel_info=accel_info)
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 3683, in spawn
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] cleanup_instance_disks=created_disks)
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 6574, in _create_domain_and_network
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] raise exception.VirtualInterfaceCreateException()
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:08.030 3669 ERROR nova.compute.manager [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Build of instance 7389252e-ce13-4a0f-a75d-6ff18e088bb3 aborted: Failed to allocate the network(s), not rescheduling.: nova.exception.BuildAbortException: Build of instance 7389252e-ce13-4a0f-a75d-6ff18e088bb3 aborted: Failed to allocate the network(s), not rescheduling.
---------------------------- /var/log/neutron/neutron-linuxbridge-agent.log ----------------------------------
2021-04-18 21:14:29.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent
2021-04-18 21:14:31.447 3740 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-b5b0d2a4-135f-4a53-bcea-09d39e56fcd3 - - - - -] Linux bridge agent Agent out of sync with plugin!
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent [req-b5b0d2a4-135f-4a53-bcea-09d39e56fcd3 - - - - -] Error in agent loop. Devices info: {'current': set(), 'timestamps': {}, 'added': set(), 'removed': {'tap22ca0a05-ea'}, 'updated': set()}: oslo_messaging.rpc.client.RemoteError: Remote error: NoSuchMethod Endpoint does not support RPC method security_group_info_for_devices
['Traceback (most recent call last):\n', ' File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming\n res = self.dispatcher.dispatch(message)\n', ' File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/dispatcher.py", line 285, in dispatch\n raise NoSuchMethod(method)\n', 'oslo_messaging.rpc.dispatcher.NoSuchMethod: Endpoint does not support RPC method security_group_info_for_devices\n'].
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent Traceback (most recent call last):
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 465, in daemon_loop
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent sync = self.process_network_devices(device_info)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/osprofiler/profiler.py", line 160, in wrapper
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 207, in process_network_devices
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent device_info.get('updated'))
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/agent/securitygroups_rpc.py", line 261, in setup_port_filters
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent if self.use_enhanced_rpc and updated_devices:
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/agent/securitygroups_rpc.py", line 100, in use_enhanced_rpc
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent self._check_enhanced_rpc_is_supported_by_server())
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/agent/securitygroups_rpc.py", line 106, in _check_enhanced_rpc_is_supported_by_server
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.context, devices=[])
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/api/rpc/handlers/securitygroups_rpc.py", line 64, in security_group_info_for_devices
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent call_version=call_version)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron_lib/rpc.py", line 157, in call
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent return self._original_context.call(ctxt, method, **kwargs)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/client.py", line 181, in call
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent transport_options=self.transport_options)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/oslo_messaging/transport.py", line 129, in _send
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent transport_options=transport_options)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 654, in send
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent transport_options=transport_options)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent raise result
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent oslo_messaging.rpc.client.RemoteError: Remote error: NoSuchMethod Endpoint does not support RPC method security_group_info_for_devices
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent ['Traceback (most recent call last):\n', ' File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming\n res = self.dispatcher.dispatch(message)\n', ' File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/dispatcher.py", line 285, in dispatch\n raise NoSuchMethod(method)\n', 'oslo_messaging.rpc.dispatcher.NoSuchMethod: Endpoint does not support RPC method security_group_info_for_devices\n'].
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent