OpenStack Compute (nova)

  1. Bug #1349888
  2. Comment #6

Comment 6 for bug 1349888

Revision history for this message
Kevin Fox (kevpn) wrote : Re: Attempting to attach the same volume multiple times can cause bdm record for existing attachment to be deleted.

I have a vm that looks like its in this state....

I do have rdo juno on sl7 with ceph backend and the patch above is already there...

in the dashboard for the instance, I see:

Volumes Attached
Attached To
    LIFT-Dev Extra Storage 2 on /dev/vdb
Attached To
    LIFT-Dev Extra Storage on /dev/vdc
Attached To
    LIFT-Dev Extra Storage on /dev/vdd

Two attachments of the same volume. In the vm, I only see one though /dev/vdc.

If I try and delete the attachment, it goes into detaching forever.

On the compute node:
2015-01-23 11:54:15.894 17425 AUDIT nova.compute.manager [req-5c64523f-765b-441d-9559-aa10cd130ab4 None] [instance: e674bf94-a7f4-4483-bfb8-0a065f2c327f] Detach volume 7be1f689-617d-4d90-909d-2e03139a2920 from m
ountpoint /dev/vdc
2015-01-23 11:54:16.464 17425 INFO nova.scheduler.client.report [req-5c64523f-765b-441d-9559-aa10cd130ab4 None] Compute_service record updated for ('rcn44.cloud.pnnl.gov', 'rcn44.cloud.pnnl.gov')
2015-01-23 11:54:16.475 17425 ERROR oslo.messaging.rpc.dispatcher [req-5c64523f-765b-441d-9559-aa10cd130ab4 ] Exception during message handling: <type 'NoneType'> can't be decoded
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher incoming.message))
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 414, in decorated_function
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in wrapped
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher payload)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in wrapped
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher return f(self, context, *args, **kw)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 298, in decorated_function
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher pass
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 284, in decorated_function
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 326, in decorated_function
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher kwargs['instance'], e, sys.exc_info())
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 314, in decorated_function
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4636, in detach_volume
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher self._detach_volume(context, instance, bdm)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4582, in _detach_volume
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher connection_info = jsonutils.loads(bdm.connection_info)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/openstack/common/jsonutils.py", line 188, in loads
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher return json.loads(strutils.safe_decode(s, encoding), **kwargs)
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/openstack/common/strutils.py", line 145, in safe_decode
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher raise TypeError("%s can't be decoded" % type(text))
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher TypeError: <type 'NoneType'> can't be decoded
2015-01-23 11:54:16.475 17425 TRACE oslo.messaging.rpc.dispatcher