Build of instance xxx aborted: Failed to allocate the network(s), not rescheduling.]

Bug #1924913 reported by ITROBOT
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
oslo.privsep
New
Undecided
Unassigned

Bug Description

---------------------------- /var/log/nova/nova-compute.log ----------------------------------

2021-04-18 21:04:07.575 3669 INFO nova.virt.libvirt.driver [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Deleting instance files /var/lib/nova/instances/7389252e-ce13-4a0f-a75d-6ff18e088bb3_del
2021-04-18 21:04:07.576 3669 INFO nova.virt.libvirt.driver [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Deletion of /var/lib/nova/instances/7389252e-ce13-4a0f-a75d-6ff18e088bb3_del complete
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Instance failed to spawn: nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Traceback (most recent call last):
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 6551, in _create_domain_and_network
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] post_xml_callback=post_xml_callback)
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] next(self.gen)
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 513, in wait_for_instance_event
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] actual_event = event.wait()
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/eventlet/event.py", line 125, in wait
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] result = hub.switch()
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 298, in switch
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] return self.greenlet.switch()
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] eventlet.timeout.Timeout: 300 seconds
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] During handling of the above exception, another exception occurred:
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Traceback (most recent call last):
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2614, in _build_resources
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] yield resources
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2378, in _build_and_run_instance
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] accel_info=accel_info)
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 3683, in spawn
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] cleanup_instance_disks=created_disks)
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 6574, in _create_domain_and_network
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] raise exception.VirtualInterfaceCreateException()
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
2021-04-18 21:04:07.742 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:07.748 3669 INFO nova.compute.manager [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Terminating instance
2021-04-18 21:04:07.752 3669 INFO nova.virt.libvirt.driver [-] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Instance destroyed successfully.
2021-04-18 21:04:07.754 3669 INFO os_vif [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] Successfully unplugged vif VIFBridge(active=False,address=fa:16:3e:f3:84:0a,bridge_name='brq42839010-d3',has_traffic_filtering=True,id=22ca0a05-eaff-4d20-a6bb-238cd5eec031,network=Network(42839010-d321-4259-9e5b-47e0170995fd),plugin='linux_bridge',port_profile=<?>,preserve_on_delete=False,vif_name='tap22ca0a05-ea')
2021-04-18 21:04:07.755 3669 INFO nova.virt.libvirt.driver [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Deletion of /var/lib/nova/instances/7389252e-ce13-4a0f-a75d-6ff18e088bb3_del complete
2021-04-18 21:04:07.839 3669 INFO nova.compute.manager [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Took 0.09 seconds to destroy the instance on the hypervisor.
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Failed to allocate network(s): nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Traceback (most recent call last):
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 6551, in _create_domain_and_network
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] post_xml_callback=post_xml_callback)
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] next(self.gen)
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 513, in wait_for_instance_event
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] actual_event = event.wait()
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/eventlet/event.py", line 125, in wait
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] result = hub.switch()
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 298, in switch
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] return self.greenlet.switch()
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] eventlet.timeout.Timeout: 300 seconds
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] During handling of the above exception, another exception occurred:
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Traceback (most recent call last):
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2378, in _build_and_run_instance
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] accel_info=accel_info)
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 3683, in spawn
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] cleanup_instance_disks=created_disks)
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 6574, in _create_domain_and_network
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] raise exception.VirtualInterfaceCreateException()
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed
2021-04-18 21:04:08.029 3669 ERROR nova.compute.manager [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3]
2021-04-18 21:04:08.030 3669 ERROR nova.compute.manager [req-377b5991-3ac4-40f7-82ed-fa16e5ebcbc8 0cca94c437154131bbff43eed603be6d cf1061c53d9e49c58f222004ebbfb2b7 - 4eeca82e6451495a883ba146773ad3ce 4eeca82e6451495a883ba146773ad3ce] [instance: 7389252e-ce13-4a0f-a75d-6ff18e088bb3] Build of instance 7389252e-ce13-4a0f-a75d-6ff18e088bb3 aborted: Failed to allocate the network(s), not rescheduling.: nova.exception.BuildAbortException: Build of instance 7389252e-ce13-4a0f-a75d-6ff18e088bb3 aborted: Failed to allocate the network(s), not rescheduling.

---------------------------- /var/log/neutron/neutron-linuxbridge-agent.log ----------------------------------

2021-04-18 21:14:29.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent
2021-04-18 21:14:31.447 3740 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-b5b0d2a4-135f-4a53-bcea-09d39e56fcd3 - - - - -] Linux bridge agent Agent out of sync with plugin!
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent [req-b5b0d2a4-135f-4a53-bcea-09d39e56fcd3 - - - - -] Error in agent loop. Devices info: {'current': set(), 'timestamps': {}, 'added': set(), 'removed': {'tap22ca0a05-ea'}, 'updated': set()}: oslo_messaging.rpc.client.RemoteError: Remote error: NoSuchMethod Endpoint does not support RPC method security_group_info_for_devices
['Traceback (most recent call last):\n', ' File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming\n res = self.dispatcher.dispatch(message)\n', ' File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/dispatcher.py", line 285, in dispatch\n raise NoSuchMethod(method)\n', 'oslo_messaging.rpc.dispatcher.NoSuchMethod: Endpoint does not support RPC method security_group_info_for_devices\n'].
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent Traceback (most recent call last):
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 465, in daemon_loop
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent sync = self.process_network_devices(device_info)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/osprofiler/profiler.py", line 160, in wrapper
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 207, in process_network_devices
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent device_info.get('updated'))
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/agent/securitygroups_rpc.py", line 261, in setup_port_filters
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent if self.use_enhanced_rpc and updated_devices:
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/agent/securitygroups_rpc.py", line 100, in use_enhanced_rpc
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent self._check_enhanced_rpc_is_supported_by_server())
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/agent/securitygroups_rpc.py", line 106, in _check_enhanced_rpc_is_supported_by_server
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.context, devices=[])
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron/api/rpc/handlers/securitygroups_rpc.py", line 64, in security_group_info_for_devices
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent call_version=call_version)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/neutron_lib/rpc.py", line 157, in call
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent return self._original_context.call(ctxt, method, **kwargs)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/client.py", line 181, in call
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent transport_options=self.transport_options)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/oslo_messaging/transport.py", line 129, in _send
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent transport_options=transport_options)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 654, in send
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent transport_options=transport_options)
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent raise result
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent oslo_messaging.rpc.client.RemoteError: Remote error: NoSuchMethod Endpoint does not support RPC method security_group_info_for_devices
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent ['Traceback (most recent call last):\n', ' File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming\n res = self.dispatcher.dispatch(message)\n', ' File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/dispatcher.py", line 285, in dispatch\n raise NoSuchMethod(method)\n', 'oslo_messaging.rpc.dispatcher.NoSuchMethod: Endpoint does not support RPC method security_group_info_for_devices\n'].
2021-04-18 21:14:31.454 3740 ERROR neutron.plugins.ml2.drivers.agent._common_agent

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.