Comment 1 for bug 1430966

Revision history for this message
Darren Sanders (darren-s) wrote :

Additional detail and steps to reproduce using the CLI.

CLI commands to reproduce
=========================
$ nova boot --availability-zone nova --image cirros-0.3.2-x86_64-uec --flavor m1.tiny inst1
$ glance image-delete cirros-0.3.2-x86_64-uec cirros-0.3.2-x86_64-uec-kernel cirros-0.3.2-x86_64-uec-ramdisk
$ nova reboot --hard bcfc5d83-7d22-42c3-b7be-cf83c63c5f10

$ nova list
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+-------+--------+------------+-------------+------------------+
| bcfc5d83-7d22-42c3-b7be-cf83c63c5f10 | inst1 | ERROR | - | Running | private=10.0.0.3 |
+--------------------------------------+-------+--------+------------+-------------+------------------+

Stacktrace from Nova Compute screen log:
========================================

2015-03-11 12:53:17.318 ERROR oslo_messaging.rpc.dispatcher [req-c28bee61-2e10-4363-8f6a-fc83ee0fe48f admin admin] Exception during message handling: Image 68a7d315-5ef6-436f-bd39-739d0076f99c could not be found.
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher executor_callback))
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher executor_callback)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/exception.py", line 88, in wrapped
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher payload)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 82, in __exit__
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/exception.py", line 71, in wrapped
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return f(self, context, *args, **kw)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 302, in decorated_function
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher pass
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 82, in __exit__
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 287, in decorated_function
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 352, in decorated_function
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 330, in decorated_function
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher kwargs['instance'], e, sys.exc_info())
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 82, in __exit__
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 318, in decorated_function
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 3037, in reboot_instance
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher self._set_instance_obj_error_state(context, instance)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 82, in __exit__
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/compute/manager.py", line 3018, in reboot_instance
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher bad_volumes_callback=bad_volumes_callback)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 1986, in reboot
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher block_device_info)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 2090, in _hard_reboot
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher disk_info_json)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5915, in _create_images_and_backing
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher context, instance, fallback_from_host=fallback_from_host)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5687, in _fetch_instance_kernel_ramdisk
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher instance, fallback_from_host)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5667, in _try_fetch_image
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher instance.project_id)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/libvirt/utils.py", line 501, in fetch_image
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher max_size=max_size)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/images.py", line 87, in fetch_to_raw
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher max_size=max_size)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/virt/images.py", line 77, in fetch
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher IMAGE_API.download(context, image_href, dest_path=path)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/image/api.py", line 182, in download
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher dst_path=dest_path)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/image/glance.py", line 352, in download
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher _reraise_translated_image_exception(image_id)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/image/glance.py", line 350, in download
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher image_chunks = self._client.call(context, 1, 'data', image_id)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/nova/nova/image/glance.py", line 219, in call
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return getattr(client.images, method)(*args, **kwargs)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/glanceclient/v1/images.py", line 143, in data
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher % urlparse.quote(str(image_id)))
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/glanceclient/common/http.py", line 262, in get
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher return self._request('GET', url, **kwargs)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/glanceclient/common/http.py", line 230, in _request
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher raise exc.from_response(resp, resp.text)
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher ImageNotFound: Image 68a7d315-5ef6-436f-bd39-739d0076f99c could not be found.
2015-03-11 12:53:17.318 TRACE oslo_messaging.rpc.dispatcher