Hi,
I have rerun the playbooks but the issue is the same. When I create a vm, it is failing eventually with vif creation failed.
------------ 2019-11-19 08:50:09.830 12956 INFO nova.virt.libvirt.driver [-] [instance: de4b6e59-998b-465c-8e8c-e659619ca025] Instance destroyed successfully. 2019-11-19 08:50:09.833 12956 INFO nova.virt.libvirt.driver [req-068acb5f-d813-44d4-9b1f-14c20995b0a4 9ca30f42033f4e93b72f9be304f66726 e12b8e37797b4fbf8d0d6b28d4b61848 - default default] [instance: de4b6e59-998b-465c-8e8c-e659619ca025] Deletion of /var/lib/nova/instances/de4b6e59-998b-465c-8e8c-e659619ca025_del complete 2019-11-19 08:50:09.921 12956 INFO nova.compute.manager [req-068acb5f-d813-44d4-9b1f-14c20995b0a4 9ca30f42033f4e93b72f9be304f66726 e12b8e37797b4fbf8d0d6b28d4b61848 - default default] [instance: de4b6e59-998b-465c-8e8c-e659619ca025] Took 0.09 seconds to destroy the instance on the hypervisor. 2019-11-19 08:50:10.253 12956 ERROR nova.compute.manager [req-068acb5f-d813-44d4-9b1f-14c20995b0a4 9ca30f42033f4e93b72f9be304f66726 e12b8e37797b4fbf8d0d6b28d4b61848 - default default] [instance: de4b6e59-998b-465c-8e8c-e659619ca025] Failed to allocate network(s): VirtualInterfaceCreateException: Virtual Interface creation failed 2019-11-19 08:50:10.253 12956 ERROR nova.compute.manager [instance: de4b6e59-998b-465c-8e8c-e659619ca025] Traceback (most recent call last): 2019-11-19 08:50:10.253 12956 ERROR nova.compute.manager [instance: de4b6e59-998b-465c-8e8c-e659619ca025] File "/openstack/venvs/nova-18.1.9/lib/python2.7/site-packages/nova/compute/manager.py", line 2133, in _build_and_run_instance 2019-11-19 08:50:10.253 12956 ERROR nova.compute.manager [instance: de4b6e59-998b-465c-8e8c-e659619ca025] block_device_info=block_device_info) 2019-11-19 08:50:10.253 12956 ERROR nova.compute.manager [instance: de4b6e59-998b-465c-8e8c-e659619ca025] File "/openstack/venvs/nova-18.1.9/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3133, in spawn 2019-11-19 08:50:10.253 12956 ERROR nova.compute.manager [instance: de4b6e59-998b-465c-8e8c-e659619ca025] destroy_disks_on_failure=True) 2019-11-19 08:50:10.253 12956 ERROR nova.compute.manager [instance: de4b6e59-998b-465c-8e8c-e659619ca025] File "/openstack/venvs/nova-18.1.9/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 5693, in _create_domain_and_network 2019-11-19 08:50:10.253 12956 ERROR nova.compute.manager [instance: de4b6e59-998b-465c-8e8c-e659619ca025] raise exception.VirtualInterfaceCreateException() 2019-11-19 08:50:10.253 12956 ERROR nova.compute.manager [instance: de4b6e59-998b-465c-8e8c-e659619ca025] VirtualInterfaceCreateException: Virtual Interface creation failed 2019-11-19 08:50:10.253 12956 ERROR nova.compute.manager [instance: de4b6e59-998b-465c-8e8c-e659619ca025] 2019-11-19 08:50:10.269 12956 ERROR nova.compute.manager [req-068acb5f-d813-44d4-9b1f-14c20995b0a4 9ca30f42033f4e93b72f9be304f66726 e12b8e37797b4fbf8d0d6b28d4b61848 - default default] [instance: de4b6e59-998b-465c-8e8c-e659619ca025] Build of instance de4b6e59-998b-465c-8e8c-e659619ca025 aborted: Failed to allocate the network(s), not rescheduling.: BuildAbortException: Build of instance de4b6e59-998b-465c-8e8c-e659619ca025 aborted: Failed to allocate the network(s), not rescheduling. ---------------------
I see messaging timeouts in the neutron agents on the compute nodes.
Hi,
I have rerun the playbooks but the issue is the same. When I create a vm, it is failing eventually
with vif creation failed.
------------ libvirt. driver [-] [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] Instance destroyed successfully. libvirt. driver [req-068acb5f- d813-44d4- 9b1f-14c20995b0 a4 9ca30f42033f4e9 3b72f9be304f667 26 e12b8e37797b4fb f8d0d6b28d4b618 48 - default default] [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] Deletion of /var/lib/ nova/instances/ de4b6e59- 998b-465c- 8e8c-e659619ca0 25_del complete manager [req-068acb5f- d813-44d4- 9b1f-14c20995b0 a4 9ca30f42033f4e9 3b72f9be304f667 26 e12b8e37797b4fb f8d0d6b28d4b618 48 - default default] [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] Took 0.09 seconds to destroy the instance on the hypervisor. manager [req-068acb5f- d813-44d4- 9b1f-14c20995b0 a4 9ca30f42033f4e9 3b72f9be304f667 26 e12b8e37797b4fb f8d0d6b28d4b618 48 - default default] [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] Failed to allocate network(s): VirtualInterfac eCreateExceptio n: Virtual Interface creation failed manager [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] Traceback (most recent call last): manager [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] File "/openstack/ venvs/nova- 18.1.9/ lib/python2. 7/site- packages/ nova/compute/ manager. py", line 2133, in _build_ and_run_ instance manager [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] block_device_ info=block_ device_ info) manager [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] File "/openstack/ venvs/nova- 18.1.9/ lib/python2. 7/site- packages/ nova/virt/ libvirt/ driver. py", line 3133, in spawn manager [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] destroy_ disks_on_ failure= True) manager [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] File "/openstack/ venvs/nova- 18.1.9/ lib/python2. 7/site- packages/ nova/virt/ libvirt/ driver. py", line 5693, in _create_ domain_ and_network manager [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] raise exception. VirtualInterfac eCreateExceptio n() manager [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] VirtualInterfac eCreateExceptio n: Virtual Interface creation failed manager [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] manager [req-068acb5f- d813-44d4- 9b1f-14c20995b0 a4 9ca30f42033f4e9 3b72f9be304f667 26 e12b8e37797b4fb f8d0d6b28d4b618 48 - default default] [instance: de4b6e59- 998b-465c- 8e8c-e659619ca0 25] Build of instance de4b6e59- 998b-465c- 8e8c-e659619ca0 25 aborted: Failed to allocate the network(s), not rescheduling.: BuildAbortExcep tion: Build of instance de4b6e59- 998b-465c- 8e8c-e659619ca0 25 aborted: Failed to allocate the network(s), not rescheduling. ------- -------
2019-11-19 08:50:09.830 12956 INFO nova.virt.
2019-11-19 08:50:09.833 12956 INFO nova.virt.
2019-11-19 08:50:09.921 12956 INFO nova.compute.
2019-11-19 08:50:10.253 12956 ERROR nova.compute.
2019-11-19 08:50:10.253 12956 ERROR nova.compute.
2019-11-19 08:50:10.253 12956 ERROR nova.compute.
2019-11-19 08:50:10.253 12956 ERROR nova.compute.
2019-11-19 08:50:10.253 12956 ERROR nova.compute.
2019-11-19 08:50:10.253 12956 ERROR nova.compute.
2019-11-19 08:50:10.253 12956 ERROR nova.compute.
2019-11-19 08:50:10.253 12956 ERROR nova.compute.
2019-11-19 08:50:10.253 12956 ERROR nova.compute.
2019-11-19 08:50:10.253 12956 ERROR nova.compute.
2019-11-19 08:50:10.269 12956 ERROR nova.compute.
-------
I see messaging timeouts in the neutron agents on the compute nodes.