VMWare - Instance with volume attached cannot be resized

Bug #1300697 reported by Sagar Ratnakara Nikam
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
Undecided
Unassigned

Bug Description

The instance has volume attached. While trying to resize that instance, the resize operation fails and instance goes to ERROR state.
Snippet from nova-compute log

2014-04-01 09:28:28.768 23215 ERROR nova.compute.manager [req-390d2d8c-37d1-4689-adcb-e4cf05b86038 a4a3a9f5a25942b5b9a52e86bef6ac5c 693523ae4a8548f9962dee10df9ccf3b] [instance: 983cc3d9-9918-4461-8336-32601b28ea52] Setting instance vm_state to ERROR
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] Traceback (most recent call last):
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 3163, in finish_resize
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] disk_info, image)
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 3122, in _finish_resize
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] context, instance, refresh_conn_info=True)
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1529, in _get_instance_volume_block_device_info
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] self.driver, self.conductor_api)
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/nova/virt/block_device.py", line 290, in refresh_conn_infos
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] block_device_mapping)
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/nova/virt/block_device.py", line 191, in refresh_connection_info
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] connector)
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/nova/volume/cinder.py", line 176, in wrapper
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] res = method(self, ctx, volume_id, *args, **kwargs)
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/nova/volume/cinder.py", line 274, in initialize_connection
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] connector)
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/cinderclient/v1/volumes.py", line 321, in initialize_connection
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] {'connector': connector})[1]['connection_info']
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/cinderclient/v1/volumes.py", line 250, in _action
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] return self.api.client.post(url, body=body)
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/cinderclient/client.py", line 217, in post
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] return self._cs_request(url, 'POST', **kwargs)
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/cinderclient/client.py", line 181, in _cs_request
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] **kwargs)
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] File "/usr/lib/python2.6/site-packages/cinderclient/client.py", line 164, in request
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] raise exceptions.from_response(resp, body)
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52] InvalidInput: Invalid input received: The server could not comply with the request since it is either malformed or otherwise incorrect.
2014-04-01 09:28:28.768 23215 TRACE nova.compute.manager [instance: 983cc3d9-9918-4461-8336-32601b28ea52]
2014-04-01 09:28:31.204 23215 ERROR nova.openstack.common.rpc.amqp [req-390d2d8c-37d1-4689-adcb-e4cf05b86038 a4a3a9f5a25942b5b9a52e86bef6ac5c 693523ae4a8548f9962dee10df9ccf3b] Exception during message handling
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp **args)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp result = getattr(proxyobj, method)(ctxt, **kwargs)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 357, in decorated_function
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/exception.py", line 93, in wrapped
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp payload)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/exception.py", line 76, in wrapped
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 247, in decorated_function
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp pass
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 233, in decorated_function
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 298, in decorated_function
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp function(self, context, *args, **kwargs)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 275, in decorated_function
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp e, sys.exc_info())
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 262, in decorated_function
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 3175, in finish_resize
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp self._set_instance_error_state(context, instance['uuid'])
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 3163, in finish_resize
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp disk_info, image)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 3122, in _finish_resize
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp context, instance, refresh_conn_info=True)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1529, in _get_instance_volume_block_device_info
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp self.driver, self.conductor_api)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/virt/block_device.py", line 290, in refresh_conn_infos
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp block_device_mapping)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/virt/block_device.py", line 191, in refresh_connection_info
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp connector)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/volume/cinder.py", line 176, in wrapper
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp res = method(self, ctx, volume_id, *args, **kwargs)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/volume/cinder.py", line 274, in initialize_connection
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp connector)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinderclient/v1/volumes.py", line 321, in initialize_connection
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp {'connector': connector})[1]['connection_info']
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinderclient/v1/volumes.py", line 250, in _action
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp return self.api.client.post(url, body=body)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinderclient/client.py", line 217, in post
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp return self._cs_request(url, 'POST', **kwargs)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinderclient/client.py", line 181, in _cs_request
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp **kwargs)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinderclient/client.py", line 164, in request
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp raise exceptions.from_response(resp, body)
2014-04-01 09:28:31.204 23215 TRACE nova.openstack.common.rpc.amqp InvalidInput: Invalid input received: The server could not comply with the request since it is either malformed or otherwise incorrect.

Tags: vmware
Allison Randal (allison)
tags: added: vmware
Revision history for this message
Gary Kotton (garyk) wrote :

Hi,
At the moment there is a problem with the resize - please see https://review.openstack.org/#/c/82264/.
When I tried what you suggest above I did not get an exception.
Can you please check if with the patch it addresses your issues.
Thanks
Gary

Changed in nova:
status: New → Incomplete
Sean Dague (sdague)
Changed in nova:
status: Incomplete → Fix Committed
Thierry Carrez (ttx)
Changed in nova:
milestone: none → juno-rc1
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in nova:
milestone: juno-rc1 → 2014.2
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.