Activity log for bug #1077817

Date Who What changed Old value New value Message
2012-11-12 06:55:48 xiaoxi,chen bug added bug
2012-11-12 06:57:01 xiaoxi,chen description When mounting a RBD volume to an instance, nova-volume/cinder doesn't pass Ceph monitor(MON) addresses to libvirt.Whithout the MON address, libvirt failed to tal with MON and then cannot plug in the disk into volume. This bug also affect cinder. Here is the error log from nova-compute: 2012-11-12 12:12:36 ERROR nova.compute.manager [req-0bb59b29-5d0a-4e1d-8f90-b3ceffb41ddb 94baac25958a4400a95535b95fad6012 4b2e53cca0 3245d0ac58041f1b6489d1] [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] Failed to attach volume a69b76be-ce01-4ede-bfac-8230d5e4c48 f at /dev/vdb 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] Traceback (most recent call last): 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] File "/usr/lib/python2.7/dist-pack ages/nova/compute/manager.py", line 1971, in _attach_volume 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] mountpoint) 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] File "/usr/lib/python2.7/dist-pack ages/nova/exception.py", line 117, in wrapped 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] temp_level, payload) 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] File "/usr/lib/python2.7/contextli b.py", line 24, in __exit__ 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] self.gen.next() 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] File "/usr/lib/python2.7/dist-pack ages/nova/exception.py", line 92, in wrapped 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] return f(*args, **kw) 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] File "/usr/lib/python2.7/dist-pack ages/nova/virt/libvirt/driver.py", line 649, in attach_volume 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] raise exception.DeviceIsBusy(dev ice=mount_device) 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] DeviceIsBusy: The supplied device (v db) is busy. When looking into libvirt's log,the following error presents: unable to find any monitors in conf. please specify monitors via -m monaddr or -c ceph.conf Here is the XML generated by libvirt, <disk type="network" device="disk"> <driver name="qemu" type="raw" cache="none"/> <source protocol="rbd" name="nova/volume-a69b76be-ce01-4ede-bfac-8230d5e4c48f"/> <target bus="virtio" dev="vdb"/> <serial>a69b76be-ce01-4ede-bfac-8230d5e4c48f</serial> </disk> But from the link (http://libvirt.org/storage.html#StorageBackendRBD), we can know that monitor's ips can be specified in XML rather than a extra ceph.conf When mounting a RBD volume to an instance, nova-volume/cinder doesn't pass Ceph monitor(MON) addresses to libvirt.Whithout the MON address, libvirt failed to tal with MON and then cannot plug in the disk into volume. This bug also affect cinder. Here is the error log from nova-compute: 2012-11-12 12:12:36 ERROR nova.compute.manager [req-0bb59b29-5d0a-4e1d-8f90-b3ceffb41ddb 94baac25958a4400a95535b95fad6012 4b2e53cca0 3245d0ac58041f1b6489d1] [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] Failed to attach volume a69b76be-ce01-4ede-bfac-8230d5e4c48 f at /dev/vdb 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] Traceback (most recent call last): 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] File "/usr/lib/python2.7/dist-pack ages/nova/compute/manager.py", line 1971, in _attach_volume 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] mountpoint) 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] File "/usr/lib/python2.7/dist-pack ages/nova/exception.py", line 117, in wrapped 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] temp_level, payload) 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] File "/usr/lib/python2.7/contextli b.py", line 24, in __exit__ 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] self.gen.next() 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] File "/usr/lib/python2.7/dist-pack ages/nova/exception.py", line 92, in wrapped 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] return f(*args, **kw) 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] File "/usr/lib/python2.7/dist-pack ages/nova/virt/libvirt/driver.py", line 649, in attach_volume 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] raise exception.DeviceIsBusy(dev ice=mount_device) 2012-11-12 12:12:36 TRACE nova.compute.manager [instance: 5b919282-6e93-4b16-9bb5-9cb95d25bc20] DeviceIsBusy: The supplied device (v db) is busy. When looking into libvirt's log,the following error presents: unable to find any monitors in conf. please specify monitors via -m monaddr or -c ceph.conf Here is the XML generated by libvirt, <disk type="network" device="disk">   <driver name="qemu" type="raw" cache="none"/>   <source protocol="rbd" name="nova/volume-a69b76be-ce01-4ede-bfac-8230d5e4c48f"/>   <target bus="virtio" dev="vdb"/>   <serial>a69b76be-ce01-4ede-bfac-8230d5e4c48f</serial> </disk> But from the link (http://libvirt.org/storage.html#StorageBackendRBD), we can know that monitor's ips can be specified in XML rather than a extra ceph.conf <pool type="rbd"> <name>myrbdpool</name> <source> <name>rbdpool</name> <host name='1.2.3.4' port='6789'/> <host name='my.ceph.monitor' port='6789'/> <host name='third.ceph.monitor' port='6789'/> <auth username='admin' type='ceph'> <secret uuid='2ec115d7-3a88-3ceb-bc12-0ac909a6fd87'/> </auth> </source> </pool>
2012-11-13 08:21:47 Michael Still nova: status New Triaged
2012-11-13 08:21:49 Michael Still nova: importance Undecided High
2012-11-13 08:35:27 xiaoxi,chen bug task added cinder
2012-12-05 11:15:38 Fabrice A. Marie bug added subscriber Fabrice A. Marie
2012-12-05 17:19:08 Josh Durgin cinder: status New Triaged
2012-12-05 17:19:15 Josh Durgin cinder: importance Undecided Medium
2013-05-25 00:57:16 Josh Durgin cinder: assignee Josh Durgin (jdurgin)
2013-05-25 00:57:21 Josh Durgin nova: assignee Josh Durgin (jdurgin)
2013-05-25 00:57:41 Josh Durgin nova: status Triaged In Progress
2013-05-25 00:57:45 Josh Durgin cinder: status Triaged In Progress
2013-05-29 18:17:12 OpenStack Infra cinder: status In Progress Fix Committed
2013-06-12 07:57:20 OpenStack Infra nova: status In Progress Fix Committed
2013-07-17 10:57:52 Thierry Carrez cinder: status Fix Committed Fix Released
2013-07-17 10:57:52 Thierry Carrez cinder: milestone havana-2
2013-07-17 12:11:29 Thierry Carrez nova: status Fix Committed Fix Released
2013-07-17 12:11:29 Thierry Carrez nova: milestone havana-2
2013-10-17 10:21:35 Thierry Carrez cinder: milestone havana-2 2013.2
2013-10-17 11:45:39 Thierry Carrez nova: milestone havana-2 2013.2