Mirantis OpenStack

Failed to copy image to volume: [Errno 32] Corrupted image.

Bug #1342176 reported by Miroslav Anashkin on 2014-07-15

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Mirantis OpenStack	Invalid	High	Miroslav Anashkin	Mirantis OpenStack 5.1

Bug Description

Environment:
Mirantis OpenStack 5.0
Ubuntu environment.
Neutron+VLAN.
Cinder is using the Eqlx driver for storage on SAN.

Hello,

We are having a problem booting from an image after editing it.
We are able to boot to non-block storage, however whenever we try to boot it via block storage, we get the error, posted at the end of this description.

I edited the image to get around a bug with ubuntu and cloud-init described here: http://dmsimard.com/2014/05/02/no-network-on-ubuntu-14-04-cloud-image-with-cloud-init/

I used “guestfish” to remove the eth0.config file as described in the bug report.
As stated, the image boots fine using non-cinder storage, I imagine I have to edit a or something, and I looked in the database and see MANY occurrences of the checksum it is expecting, so I do not know what to change.

ImageCopyFailure: Failed to copy image to volume: [Errno 32] Corrupted image. Checksum was 78e6d5e5d8d5f46bec2f62ace58b6343 expected 9451d4b09d8df81b92452a061975880d

I tried updating the image checksum in glance via:

glance image-update 045e055e-da65-4261-9a03-ac3c59aab07b --checksum 78e6d5e5d8d5f46bec2f62ace58b6343

But still receiving the same error, even after restarting Cinder services.

2014-07-06 14:06:42.957 9941 INFO cinder.volume.flows.create_volume [req-2fac4c46-72ec-40df-92d2-cfd9b5d3c006 5e0e6b64eb4642bab61be213240ffcc7 0419e5918ffc464c8493564ff865ed74] Volume 00fb4c12-0d0b-4cb6-9fe1-a513766f02c7: being created using CreateVolumeFromSpecTask._create_from_image with specification: {'status': u'creating', 'image_location': (None, None), 'volume_size': 75, 'volume_name': u'volume-00fb4c12-0d0b-4cb6-9fe1-a513766f02c7', 'image_id': u'045e055e-da65-4261-9a03-ac3c59aab07b', 'image_service': <cinder.image.glance.GlanceImageService object at 0x2fd3e50>, 'image_meta': {'status': u'active', 'name': u'pixafyhosting-ubuntu-12.04-x86_64-v1', 'deleted': False, 'container_format': u'bare', 'created_at': datetime.datetime(2014, 4, 29, 20, 40, 23, tzinfo=<iso8601.iso8601.Utc object at 0x3425d50>), 'disk_format': u'qcow2', 'updated_at': datetime.datetime(2014, 4, 29, 20, 40, 27, tzinfo=<iso8601.iso8601.Utc object at 0x3425d50>), 'id': u'045e055e-da65-4261-9a03-ac3c59aab07b', 'owner': u'0419e5918ffc464c8493564ff865ed74', 'min_ram': 256, 'checksum': u'9451d4b09d8df81b92452a061975880d', 'min_disk': 5, 'is_public': True, 'deleted_at': None, 'properties': {}, 'size': 261226496}}
2014-07-06 14:06:42.959 9941 INFO cinder.volume.drivers.eqlx [req-2fac4c46-72ec-40df-92d2-cfd9b5d3c006 5e0e6b64eb4642bab61be213240ffcc7 0419e5918ffc464c8493564ff865ed74] EQL-driver: executing "volume create volume-00fb4c12-0d0b-4cb6-9fe1-a513766f02c7 75G thin-provision"
2014-07-06 14:06:42.962 9941 INFO paramiko.transport [-] Secsh channel 242 opened.
2014-07-06 14:06:43.398 9941 INFO cinder.volume.drivers.eqlx [req-2fac4c46-72ec-40df-92d2-cfd9b5d3c006 5e0e6b64eb4642bab61be213240ffcc7 0419e5918ffc464c8493564ff865ed74] EQL-driver: executing "volume select volume-00fb4c12-0d0b-4cb6-9fe1-a513766f02c7 multihost-access enable"
2014-07-06 14:06:43.402 9941 INFO paramiko.transport [-] Secsh channel 243 opened.
2014-07-06 14:06:44.289 9941 INFO cinder.volume.drivers.eqlx [req-2fac4c46-72ec-40df-92d2-cfd9b5d3c006 5e0e6b64eb4642bab61be213240ffcc7 0419e5918ffc464c8493564ff865ed74] EQL-driver: executing "volume select volume-00fb4c12-0d0b-4cb6-9fe1-a513766f02c7 access create initiator iqn.1994-05.com.redhat:34ff91b3a4a"
2014-07-06 14:06:44.291 9941 INFO paramiko.transport [-] Secsh channel 244 opened.
2014-07-06 14:06:54.440 9941 INFO cinder.volume.drivers.eqlx [req-2fac4c46-72ec-40df-92d2-cfd9b5d3c006 5e0e6b64eb4642bab61be213240ffcc7 0419e5918ffc464c8493564ff865ed74] EQL-driver: executing "volume select volume-00fb4c12-0d0b-4cb6-9fe1-a513766f02c7 access delete 1"
2014-07-06 14:06:54.443 9941 INFO paramiko.transport [-] Secsh channel 245 opened.
2014-07-06 14:06:54.638 9941 ERROR cinder.volume.flows.create_volume [req-2fac4c46-72ec-40df-92d2-cfd9b5d3c006 5e0e6b64eb4642bab61be213240ffcc7 0419e5918ffc464c8493564ff865ed74] Failed to copy image 045e055e-da65-4261-9a03-ac3c59aab07b to volume: 00fb4c12-0d0b-4cb6-9fe1-a513766f02c7, error: [Errno 32] Corrupted image. Checksum was 78e6d5e5d8d5f46bec2f62ace58b6343 expected 9451d4b09d8df81b92452a061975880d
2014-07-06 14:06:54.639 9941 WARNING cinder.taskflow.utils [-] Activating 5 rollbacks due to <cinder.taskflow.utils.FlowFailure object at 0x3237bd0>.
2014-07-06 14:06:54.680 9941 ERROR cinder.volume.flows.create_volume [req-2fac4c46-72ec-40df-92d2-cfd9b5d3c006 5e0e6b64eb4642bab61be213240ffcc7 0419e5918ffc464c8493564ff865ed74] Volume 00fb4c12-0d0b-4cb6-9fe1-a513766f02c7: create failed
2014-07-06 14:06:54.681 9941 ERROR cinder.volume.flows.create_volume [req-2fac4c46-72ec-40df-92d2-cfd9b5d3c006 5e0e6b64eb4642bab61be213240ffcc7 0419e5918ffc464c8493564ff865ed74] Unexpected build error:
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume Traceback (most recent call last):
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.6/site-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume result = runner(context, *args, **kwargs)
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.6/site-packages/cinder/taskflow/utils.py", line 260, in __call__
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume self.result = self.task(*args, **kwargs)
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.6/site-packages/cinder/volume/flows/create_volume/__init__.py", line 1505, in __call__
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume **volume_spec)
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.6/site-packages/cinder/volume/flows/create_volume/__init__.py", line 1462, in _create_from_image
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume image_id, image_location, image_service)
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.6/site-packages/cinder/volume/flows/create_volume/__init__.py", line 1376, in _copy_image_to_volume
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume raise exception.ImageCopyFailure(reason=ex)
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume ImageCopyFailure: Failed to copy image to volume: [Errno 32] Corrupted image. Checksum was 78e6d5e5d8d5f46bec2f62ace58b6343 expected 9451d4b09d8df81b92452a061975880d
2014-07-06 14:06:54.681 9941 TRACE cinder.volume.flows.create_volume
2014-07-06 14:06:54.700 9941 ERROR cinder.openstack.common.rpc.amqp [req-2fac4c46-72ec-40df-92d2-cfd9b5d3c006 5e0e6b64eb4642bab61be213240ffcc7 0419e5918ffc464c8493564ff865ed74] Exception during message handling
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last):
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/amqp.py", line 441, in _process_data
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp **args)
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/dispatcher.py", line 148, in dispatch
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs)
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py", line 256, in create_volume
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp flow.run(context.elevated())
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinder/taskflow/decorators.py", line 105, in wrapper
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp return f(self, *args, **kwargs)
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinder/taskflow/patterns/linear_flow.py", line 232, in run
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp run_it(r)
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinder/taskflow/patterns/linear_flow.py", line 212, in run_it
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp self.rollback(context, cause)
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp self.gen.next()
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp result = runner(context, *args, **kwargs)
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinder/taskflow/utils.py", line 260, in __call__
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp self.result = self.task(*args, **kwargs)
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinder/volume/flows/create_volume/__init__.py", line 1505, in __call__
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp **volume_spec)
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinder/volume/flows/create_volume/__init__.py", line 1462, in _create_from_image
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp image_id, image_location, image_service)
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/cinder/volume/flows/create_volume/__init__.py", line 1376, in _copy_image_to_volume
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp raise exception.ImageCopyFailure(reason=ex)
2014-07-06 14:06:54.700 9941 TRACE cinder.openstack.common.rpc.amqp ImageCopyFailure: Failed to copy image to volume: [Errno 32] Corrupted image. Checksum was 78e6d5e5d8d5f46bec2f62ace58b6343 expected 9451d4b09d8df81b92452a061975880d

See original description

Tags:

Revision history for this message

Miroslav Anashkin (manashkin) wrote on 2014-07-15:

Related upstream bug:
https://bugs.launchpad.net/cinder/+bug/1323065

Miroslav Anashkin (manashkin) on 2014-07-15

description:

updated

Miroslav Anashkin (manashkin) on 2014-07-17

tags:

added: customer-found

Dmitry Mescheryakov (dmitrymex) on 2014-07-17

Changed in mos:
importance:	Undecided → High

Dmitry Mescheryakov (dmitrymex) on 2014-07-17

Changed in mos:
milestone:	none → 5.1

Revision history for this message

Miroslav Anashkin (manashkin) wrote on 2014-07-17:

May this issue be related to NFS backend?
Corresponding upstream bug discussion points the Eqlx/NFS driver is just one of the several affected Cinder configurations.

Revision history for this message

Ivan Kolodyazhny (e0ne) wrote on 2014-07-30:

Miroslav, could you provide me, please, more details about env? I can'r reproduce it neither with default backend, nor with RDB like like a upstream bug steps.

Changed in mos:
assignee:	MOS Cinder (mos-cinder) → Ivan Kolodyazhny (e0ne)

Revision history for this message

Ivan Kolodyazhny (e0ne) wrote on 2014-08-06:

More logs and cinder configs are required. Fuel debug snapshot will be very helpful

Changed in mos:
status:	New → Incomplete

Dmitry Mescheryakov (dmitrymex) on 2014-08-07

Changed in mos:
assignee:	Ivan Kolodyazhny (e0ne) → Miroslav Anashkin (manashkin)

Revision history for this message

Dmitry Mescheryakov (dmitrymex) wrote on 2014-08-28:

We can't work on this bug until we get the logs. Hence moving it to invalid.

Changed in mos:
status:	Incomplete → Invalid

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.