Additional detail and steps to reproduce using the CLI.
CLI commands to reproduce
=========================
$ nova boot --availability-zone nova --image cirros-0.3.2-x86_64-uec --flavor m1.tiny inst1
$ glance image-delete cirros-0.3.2-x86_64-uec cirros-0.3.2-x86_64-uec-kernel cirros-0.3.2-x86_64-uec-ramdisk
$ nova reboot --hard bcfc5d83-7d22-42c3-b7be-cf83c63c5f10
$ nova list
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+-------+--------+------------+-------------+------------------+
| bcfc5d83-7d22-42c3-b7be-cf83c63c5f10 | inst1 | ERROR | - | Running | private=10.0.0.3 |
+--------------------------------------+-------+--------+------------+-------------+------------------+
Stacktrace from Nova Compute screen log:
========================================
2015-03-11 12:53:17.318 ERROR oslo_messaging.rpc.dispatcher [req-c28bee61-2e10-4363-8f6a-fc83ee0fe48f admin admin] Exception during message handling: Image 68a7d315-5ef6-436f-bd39-739d0076f99c could not be found.
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher executor_callback))
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher executor_callback)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/exception.py", line 88, in wrapped
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher payload)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 82, in __exit__
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/exception.py", line 71, in wrapped
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return f(self, context, *args, **kw)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 302, in decorated_function
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher pass
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 82, in __exit__
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 287, in decorated_function
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 352, in decorated_function
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 330, in decorated_function
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher kwargs['instance'], e, sys.exc_info())
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 82, in __exit__
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 318, in decorated_function
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 3037, in reboot_instance
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher self._set_instance_obj_error_state(context, instance)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 82, in __exit__
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 3018, in reboot_instance
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher bad_volumes_callback=bad_volumes_callback)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 1986, in reboot
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher block_device_info)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 2090, in _hard_reboot
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher disk_info_json)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5915, in _create_images_and_backing
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher context, instance, fallback_from_host=fallback_from_host)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5687, in _fetch_instance_kernel_ramdisk
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher instance, fallback_from_host)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5667, in _try_fetch_image
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher instance.project_id)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/utils.py", line 501, in fetch_image
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher max_size=max_size)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/images.py", line 87, in fetch_to_raw
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher max_size=max_size)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/images.py", line 77, in fetch
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher IMAGE_API.download(context, image_href, dest_path=path)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/image/api.py", line 182, in download
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher dst_path=dest_path)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/image/glance.py", line 352, in download
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher _reraise_translated_image_exception(image_id)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/image/glance.py", line 350, in download
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher image_chunks = self._client.call(context, 1, 'data', image_id)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/image/glance.py", line 219, in call
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return getattr(client.images, method)(*args, **kwargs)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/glanceclient/v1/images.py", line 143, in data
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher % urlparse.quote(str(image_id)))
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/glanceclient/common/http.py", line 262, in get
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return self._request('GET', url, **kwargs)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/glanceclient/common/http.py", line 230, in _request
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher raise exc.from_response(resp, resp.text)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher ImageNotFound: Image 68a7d315-5ef6-436f-bd39-739d0076f99c could not be found.
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher
Additional detail and steps to reproduce using the CLI.
CLI commands to reproduce ======= ======= ==== 0.3.2-x86_ 64-uec --flavor m1.tiny inst1 0.3.2-x86_ 64-uec cirros- 0.3.2-x86_ 64-uec- kernel cirros- 0.3.2-x86_ 64-uec- ramdisk 7d22-42c3- b7be-cf83c63c5f 10
=======
$ nova boot --availability-zone nova --image cirros-
$ glance image-delete cirros-
$ nova reboot --hard bcfc5d83-
$ nova list ------- ------- ------- ------- ----+-- -----+- ------- +------ ------+ ------- ------+ ------- ------- ----+ ------- ------- ------- ------- ----+-- -----+- ------- +------ ------+ ------- ------+ ------- ------- ----+ 7d22-42c3- b7be-cf83c63c5f 10 | inst1 | ERROR | - | Running | private=10.0.0.3 | ------- ------- ------- ------- ----+-- -----+- ------- +------ ------+ ------- ------+ ------- ------- ----+
+------
| ID | Name | Status | Task State | Power State | Networks |
+------
| bcfc5d83-
+------
Stacktrace from Nova Compute screen log: ======= ======= ======= ======= =====
=======
2015-03-11 12:53:17.318 ERROR oslo_messaging. rpc.dispatcher [req-c28bee61- 2e10-4363- 8f6a-fc83ee0fe4 8f admin admin] Exception during message handling: Image 68a7d315- 5ef6-436f- bd39-739d0076f9 9c could not be found. rpc.dispatcher Traceback (most recent call last): rpc.dispatcher File "/usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ rpc/dispatcher. py", line 142, in _dispatch_and_reply rpc.dispatcher executor_callback)) rpc.dispatcher File "/usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ rpc/dispatcher. py", line 186, in _dispatch rpc.dispatcher executor_callback) rpc.dispatcher File "/usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ rpc/dispatcher. py", line 130, in _do_dispatch rpc.dispatcher result = func(ctxt, **new_args) rpc.dispatcher File "/opt/stack/ nova/nova/ exception. py", line 88, in wrapped rpc.dispatcher payload) rpc.dispatcher File "/usr/local/ lib/python2. 7/dist- packages/ oslo_utils/ excutils. py", line 82, in __exit__ rpc.dispatcher six.reraise( self.type_ , self.value, self.tb) rpc.dispatcher File "/opt/stack/ nova/nova/ exception. py", line 71, in wrapped rpc.dispatcher return f(self, context, *args, **kw) rpc.dispatcher File "/opt/stack/ nova/nova/ compute/ manager. py", line 302, in decorated_function rpc.dispatcher pass rpc.dispatcher File "/usr/local/ lib/python2. 7/dist- packages/ oslo_utils/ excutils. py", line 82, in __exit__ rpc.dispatcher six.reraise( self.type_ , self.value, self.tb) rpc.dispatcher File "/opt/stack/ nova/nova/ compute/ manager. py", line 287, in decorated_function rpc.dispatcher return function(self, context, *args, **kwargs) rpc.dispatcher File "/opt/stack/ nova/nova/ compute/ manager. py", line 352, in decorated_function rpc.dispatcher return function(self, context, *args, **kwargs) rpc.dispatcher File "/opt/stack/ nova/nova/ compute/ manager. py", line 330, in decorated_function rpc.dispatcher kwargs['instance'], e, sys.exc_info()) rpc.dispatcher File "/usr/local/ lib/python2. 7/dist- packages/ oslo_utils/ excutils. py", line 82, in __exit__ rpc.dispatcher six.reraise( self.type_ , self.value, self.tb) rpc.dispatcher File "/opt/stack/ nova/nova/ compute/ manager. py", line 318, in decorated_function rpc.dispatcher return function(self, context, *args, **kwargs) rpc.dispatcher File "/opt/stack/ nova/nova/ compute/ manager. py", line 3037, in reboot_instance rpc.dispatcher self._set_ instance_ obj_error_ state(context, instance) rpc.dispatcher File "/usr/local/ lib/python2. 7/dist- packages/ oslo_utils/ excutils. py", line 82, in __exit__ rpc.dispatcher six.reraise( self.type_ , self.value, self.tb) rpc.dispatcher File "/opt/stack/ nova/nova/ compute/ manager. py", line 3018, in reboot_instance rpc.dispatcher bad_volumes_ callback= bad_volumes_ callback) rpc.dispatcher File "/opt/stack/ nova/nova/ virt/libvirt/ driver. py", line 1986, in reboot rpc.dispatcher block_device_info) rpc.dispatcher File "/opt/stack/ nova/nova/ virt/libvirt/ driver. py", line 2090, in _hard_reboot rpc.dispatcher disk_info_json) rpc.dispatcher File "/opt/stack/ nova/nova/ virt/libvirt/ driver. py", line 5915, in _create_ images_ and_backing rpc.dispatcher context, instance, fallback_ from_host= fallback_ from_host) rpc.dispatcher File "/opt/stack/ nova/nova/ virt/libvirt/ driver. py", line 5687, in _fetch_ instance_ kernel_ ramdisk rpc.dispatcher instance, fallback_from_host) rpc.dispatcher File "/opt/stack/ nova/nova/ virt/libvirt/ driver. py", line 5667, in _try_fetch_image rpc.dispatcher instance. project_ id) rpc.dispatcher File "/opt/stack/ nova/nova/ virt/libvirt/ utils.py" , line 501, in fetch_image rpc.dispatcher max_size=max_size) rpc.dispatcher File "/opt/stack/ nova/nova/ virt/images. py", line 87, in fetch_to_raw rpc.dispatcher max_size=max_size) rpc.dispatcher File "/opt/stack/ nova/nova/ virt/images. py", line 77, in fetch rpc.dispatcher IMAGE_API. download( context, image_href, dest_path=path) rpc.dispatcher File "/opt/stack/ nova/nova/ image/api. py", line 182, in download rpc.dispatcher dst_path=dest_path) rpc.dispatcher File "/opt/stack/ nova/nova/ image/glance. py", line 352, in download rpc.dispatcher _reraise_ translated_ image_exception (image_ id) rpc.dispatcher File "/opt/stack/ nova/nova/ image/glance. py", line 350, in download rpc.dispatcher image_chunks = self._client. call(context, 1, 'data', image_id) rpc.dispatcher File "/opt/stack/ nova/nova/ image/glance. py", line 219, in call rpc.dispatcher return getattr( client. images, method)(*args, **kwargs) rpc.dispatcher File "/usr/local/ lib/python2. 7/dist- packages/ glanceclient/ v1/images. py", line 143, in data rpc.dispatcher % urlparse. quote(str( image_id) )) rpc.dispatcher File "/usr/local/ lib/python2. 7/dist- packages/ glanceclient/ common/ http.py" , line 262, in get rpc.dispatcher return self._request( 'GET', url, **kwargs) rpc.dispatcher File "/usr/local/ lib/python2. 7/dist- packages/ glanceclient/ common/ http.py" , line 230, in _request rpc.dispatcher raise exc.from_ response( resp, resp.text) rpc.dispatcher ImageNotFound: Image 68a7d315- 5ef6-436f- bd39-739d0076f9 9c could not be found. rpc.dispatcher
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.
2015-03-11 12:53:17.318 TRACE oslo_messaging.