Ubuntu
nova package

Can not attach a volume to a instance

Bug #1732087 reported by XiaoRuiguo
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
nova (Ubuntu)
Expired
Low
Unassigned

Bug Description

2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [req-0364ddaa-8e52-4460-8457-67334117e6f8 c6d634c6516841cc99f06faecc8dd234 0cce6ad60ade451d8fce7c64166c659c - default default] [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] Failed to attach 77b085c5-ad1e-4cc0-ac92-57fdcf5ddb81 at /dev/vdb: libvirtError: internal error: unable to execute QEMU command 'device_add': Property 'virtio-blk-device.drive' can't find value 'drive-virtio-disk1'
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] Traceback (most recent call last):
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/nova/compute/manager.py", line 4851, in _attach_volume
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] do_driver_attach=True)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/nova/virt/block_device.py", line 45, in wrapped
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] ret_val = method(obj, context, *args, **kwargs)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/nova/virt/block_device.py", line 398, in attach
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] connector)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] self.force_reraise()
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] six.reraise(self.type_, self.value, self.tb)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/nova/virt/block_device.py", line 389, in attach
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] device_type=self['device_type'], encryption=encryption)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1270, in attach_volume
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] self._disconnect_volume(connection_info, disk_dev, instance)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] self.force_reraise()
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] six.reraise(self.type_, self.value, self.tb)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1254, in attach_volume
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] guest.attach_device(conf, persistent=True, live=live)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/nova/virt/libvirt/guest.py", line 308, in attach_device
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] self._domain.attachDeviceFlags(device_xml, flags=flags)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/eventlet/tpool.py", line 186, in doit
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] result = proxy_call(self._autowrap, f, *args, **kwargs)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/eventlet/tpool.py", line 144, in proxy_call
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] rv = execute(f, *args, **kwargs)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/eventlet/tpool.py", line 125, in execute
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] six.reraise(c, e, tb)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/eventlet/tpool.py", line 83, in tworker
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] rv = meth(*args, **kwargs)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/libvirt.py", line 587, in attachDeviceFlags
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] if ret == -1: raise libvirtError ('virDomainAttachDeviceFlags() failed', dom=self)
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda] libvirtError: internal error: unable to execute QEMU command 'device_add': Property 'virtio-blk-device.drive' can't find value 'drive-virtio-disk1'
2017-11-10 20:26:38.986 130600 ERROR nova.compute.manager [instance: 44a75d9a-5bfe-4d51-b5b6-e982bad09fda]

Revision history for this message
XiaoRuiguo (705437650-6) wrote :

Openstack pike stable.
QEMU 2.10.1

Revision history for this message
XiaoRuiguo (705437650-6) wrote :
Download full text (3.2 KiB)

NFS,

Failed to attach volume at mountpoint: /dev/vdb: libvirtError: internal error: unable to execute QEMU command 'device_add': Property 'virtio-blk-device.drive' can't find value 'drive-virtio-disk1'

2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] Traceback (most recent call last):
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1254, in attach_volume
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] guest.attach_device(conf, persistent=True, live=live)
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/nova/virt/libvirt/guest.py", line 308, in attach_device
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] self._domain.attachDeviceFlags(device_xml, flags=flags)
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/eventlet/tpool.py", line 186, in doit
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] result = proxy_call(self._autowrap, f, *args, **kwargs)
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/eventlet/tpool.py", line 144, in proxy_call
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] rv = execute(f, *args, **kwargs)
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/eventlet/tpool.py", line 125, in execute
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] six.reraise(c, e, tb)
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/eventlet/tpool.py", line 83, in tworker
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] rv = meth(*args, **kwargs)
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/libvirt.py", line 587, in attachDeviceFlags
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] if ret == -1: raise libvirtError ('virDomainAttachDeviceFlags() failed', dom=self)
2017-11-14 22:00:07.790 68261 ERROR nova.virt.libvirt.driver [instance: c1018f47-437e-4b04-bcb1-ca0a3cac5d6b] libvirtError: internal error: unable to execute QEMU command 'devi...

Read more...

Revision history for this message
XiaoRuiguo (705437650-6) wrote :

OCATA AND PIKE deploy on the same environment.

OCATA, can attach
# qemu-img --version
qemu-img version 2.8.0(Debian 1:2.8+dfsg-3ubuntu2.5~cloud0)
Copyright (c) 2003-2016 Fabrice Bellard and the QEMU Project developers
# virsh --version
2.5.0

PIKE, can not attach.
QEMU 2.10.1
virsh 3.6.0

Revision history for this message
James Page (james-page) wrote :

This smells like something I saw under bug 1495895; my hunch is that apparmor is block access to the second disk for the instance but its a bit hard to say right now; please could you look in /var/log/kern.log for any DENIED type messages from apparmor for the qemu processes.

Changed in nova (Ubuntu):
status: New → Incomplete
importance: Undecided → Low
Revision history for this message
James Page (james-page) wrote :

(just as an aside - /openstack/venvs/nova-16.0.3 indicates you're not using the Ubuntu supplied debs for OpenStack - did you mean to raise this against the nova project itself?)

Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for nova (Ubuntu) because there has been no activity for 60 days.]

Changed in nova (Ubuntu):
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.