Juniper Openstack

OOO:DPDK: VM launch errors out eventhough the config has selinux as permissive

Bug #1707073 reported by Vinod Nair
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Won't Fix
High
Kiran
R3.2
Won't Fix
High
Kiran
Juniper Openstack r3.2.5.0

Bug Description

On a Tripleo provisioned dpdk compute VM launch errors out ,,

[root@dpdk-contraildpdk-1 ~]#
[root@dpdk-contraildpdk-1 ~]# getenforce
Permissive

yum list contrail-nova-vif
Loaded plugins: product-id, search-disabled-repos, subscription-manager
Installed Packages
contrail-nova-vif.x86_64 3.2.4.0-45.el7 @Contrail

[root@dpdk-contraildpdk-1 ~]# journalctl -fu libvirtd
-- Logs begin at Thu 2017-07-27 09:08:30 UTC. --
Jul 27 21:55:39 dpdk-contraildpdk-1.localdomain libvirtd[56186]: End of file while reading data: Input/output error
Jul 27 21:55:50 dpdk-contraildpdk-1.localdomain systemd[1]: Stopping Virtualization daemon...
Jul 27 21:55:50 dpdk-contraildpdk-1.localdomain systemd[1]: Starting Virtualization daemon...
Jul 27 21:55:50 dpdk-contraildpdk-1.localdomain systemd[1]: Started Virtualization daemon.
Jul 27 21:56:53 dpdk-contraildpdk-1.localdomain libvirtd[69369]: libvirt version: 2.0.0, package: 10.el7_3.9 (Red Hat, Inc. <http://bugzilla.redhat.com/bugzilla>, 2017-05-04-06:48:37, x86-034.build.eng.bos.redhat.com)
Jul 27 21:56:53 dpdk-contraildpdk-1.localdomain libvirtd[69369]: hostname: dpdk-contraildpdk-1.localdomain
Jul 27 21:56:53 dpdk-contraildpdk-1.localdomain libvirtd[69369]: Unable to read from monitor: Connection reset by peer
Jul 27 21:56:53 dpdk-contraildpdk-1.localdomain libvirtd[69369]: internal error: qemu unexpectedly closed the monitor: 2017-07-27T21:56:53.636089Z qemu-kvm: -chardev socket,id=charnet0,path=/var/run/vrouter/uvh_vif_tapc3b0c69a-ac: Failed to connect socket: No such file or directory
Jul 27 21:57:06 dpdk-contraildpdk-1.localdomain libvirtd[69369]: Unable to read from monitor: Connection reset by peer
Jul 27 21:57:06 dpdk-contraildpdk-1.localdomain libvirtd[69369]: internal error: qemu unexpectedly closed the monitor: 2017-07-27T21:57:06.931020Z qemu-kvm: -chardev socket,id=charnet0,path=/var/run/vrouter/uvh_vif_tapc5c1a9c8-cf: Failed to connect socket: No such file or directory

nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [req-e7323efb-9940-418b-a3a0-7c266234d7c3 48ac793134974400950c60b4a0399300 80512446f04e456da2cd34781f9c8856 - - -] [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] Instance failed to spawn
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] Traceback (most recent call last):
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2083, in _build_resources
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] yield resources
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1924, in _build_and_run_instance
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] block_device_info=block_device_info)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2618, in spawn
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] destroy_disks_on_failure=True)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4923, in _create_domain_and_network
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] destroy_disks_on_failure)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] self.force_reraise()
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] six.reraise(self.type_, self.value, self.tb)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4895, in _create_domain_and_network
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] post_xml_callback=post_xml_callback)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4813, in _create_domain
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] guest.launch(pause=pause)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/guest.py", line 144, in launch
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] self._encoded_xml, errors='ignore')
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] self.force_reraise()
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] six.reraise(self.type_, self.value, self.tb)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/guest.py", line 139, in launch
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] return self._domain.createWithFlags(flags)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 186, in doit
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] result = proxy_call(self._autowrap, f, *args, **kwargs)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 144, in proxy_call
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] rv = execute(f, *args, **kwargs)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 125, in execute
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] six.reraise(c, e, tb)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 83, in tworker
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] rv = meth(*args, **kwargs)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1065, in createWithFlags
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
nova/nova-compute.log:2017-07-27 21:57:07.270 69407 ERROR nova.compute.manager [instance: fa27c9f9-b855-4318-9285-7561df6c44c4] libvirtError: internal error: qemu unexpectedly closed the monitor: 2017-07-27T21:57:06.931020Z qemu-kvm: -chardev socket,id=charnet0,path=/var/run/vrouter/uvh_vif_tapc5c1a9c8-cf: Failed to connect socket: No such file or directo

See original description
Vinod Nair (vinodnair)
Changed in juniperopenstack:
assignee: nobody → Kiran (kiran-kn80)
Vinod Nair (vinodnair)
description: updated
Jeba Paulaiyan (jebap)
no longer affects: juniperopenstack/r4.0
no longer affects: juniperopenstack/trunk
Revision history for this message
Jeba Paulaiyan (jebap) wrote :

This need to be done in upstream Redhat Openstack packages: https://github.com/Juniper/nova/commit/a8fe392917da7a046156daa122ac99a3c1427f39

tags: added: releasenote
Kiran (kiran-kn80)
Changed in juniperopenstack:
status: New → Won't Fix
Revision history for this message
Jeba Paulaiyan (jebap) wrote :

Release-Notes:
==============
On a RHOSP10 provisioned cluster VM launch might fail. Applying the patch in https://github.com/Juniper/nova/commit/a8fe392917da7a046156daa122ac99a3c1427f39 will fix the issue. This change is needed until the Redhat fixes this in upstream packages.

information type: Proprietary → Public
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.