Failed to evacuate instances booted from volume

Bug #1624797 reported by javeme
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
In Progress
Undecided
Unassigned

Bug Description

Description:
Failed to evacuate instances booted from volume

Steps to reproduce:
1.Create an instance from volume
nova boot --boot-volume <volume_id> --flavor <flavor> --nic <net-id=net-uuid> test

2.Force nova-compute service to down
nova service-force-down <hostname> nova-compute

3.Evacuate server from failed host
nova evacuate test

Result:
instance "test" fails to evacuate:
InvalidSharedStorage: Invalid state of instance files on shared storage

Environment:
version: Liberty
nova image backend: Ceph RBD

Error Log:
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher executor_callback))
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher executor_callback)
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 129, in _do_dispatch
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 142, in inner
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher return func(*args, **kwargs)
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 89, in wrapped
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 195, in __exit__
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 72, in wrapped
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 353, in decorated_function
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 195, in __exit__
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 326, in decorated_function
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 403, in decorated_function
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 381, in decorated_function
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 195, in __exit__
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 369, in decorated_function
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2712, in rebuild_instance
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2751, in _do_rebuild_instance_with_claim
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2776, in _do_rebuild_instance
2016-08-14 17:37:40.257 930041 ERROR oslo_messaging.rpc.dispatcher InvalidSharedStorage: Invalid state of instance files on shared storage

javeme (javaloveme)
description: updated
description: updated
Revision history for this message
javeme (javaloveme) wrote :
Changed in nova:
status: New → In Progress
Revision history for this message
Sean Dague (sdague) wrote :

There are no currently open reviews on this bug, changing
the status back to the previous state and unassigning. If
there are active reviews related to this bug, please include
links in comments.

Changed in nova:
status: In Progress → New
Revision history for this message
Sean Dague (sdague) wrote :

Automatically discovered version liberty in description. If this is incorrect, please update the description to include 'nova version: ...'

tags: added: openstack-version.liberty
Sean Dague (sdague)
Changed in nova:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on nova (master)

Change abandoned by Sean Dague (<email address hidden>) on branch: master
Review: https://review.openstack.org/372045
Reason: This review is > 4 weeks without comment, and is not mergable in it's current state. We are abandoning this for now. Feel free to reactivate the review by pressing the restore button and leaving a 'recheck' comment to get fresh test results.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.