Version
- PowerFlex 3.6.2
- 2023.2(Bobcat)
- Rocky 9.1
Issue/problem detail
- After setting the Glance backend to PowerFlex Cinder, uploading an image and creating an image volume does not result in the image volume being created correctly.
- In a normal OpenStack environment (Zed), procedures such as volume creation, attachment, and image copy must be performed after the deleting attachment log, but in the bobcat environment, no operation is performed after the deleting attachment log.
- And approximately 6 minutes later, an error occurs stating "corrupt image download".
- save image" command isn't working
- the issue doesn't seem to be related to the images themselves
- command and cinder_volume log
#openstack volume create --size 8 --type powerflex --image cirros_flex --bootable test_image_volume2
. . . . . . . . . .
2024-06-06 12:01:23.921 23 DEBUG cinder.volume.flows.manager.create_volume [None req-45f58e33-f17e-4510-a0c2-35a9a3a74a84 6cf258b3daa04991b25b1c0dee5d3f30 14593f2bbcb8496e946ddbbba410eb1a - - - -] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['rocky9@powerflex#PD01:SP01'], 'hosts': ['rocky9@powerflex#PD01:SP01']} get_flow /var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/volume/flows/manager/create_volume.py:1368
2024-06-06 12:01:23.930 23 DEBUG cinder.volume.manager [None req-45f58e33-f17e-4510-a0c2-35a9a3a74a84 6cf258b3daa04991b25b1c0dee5d3f30 14593f2bbcb8496e946ddbbba410eb1a - - - -] Flow 'volume_create_manager' (6997b66f-2daf-471a-a7ec-9c182d49a119) transitioned into state 'RUNNING' from state 'PENDING' _flow_receiver /var/lib/kolla/venv/lib64/python3.9/site-packages/taskflow/listeners/logging.py:141
2024-06-06 12:01:23.933 23 DEBUG cinder.volume.manager [None req-45f58e33-f17e-4510-a0c2-35a9a3a74a84 6cf258b3daa04991b25b1c0dee5d3f30 14593f2bbcb8496e946ddbbba410eb1a - - - -] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97cec17a-b54f-4e4d-91a9-3444e926970b) transitioned into state 'RUNNING' from state 'PENDING' _task_receiver /var/lib/kolla/venv/lib64/python3.9/site-packages/taskflow/listeners/logging.py:190
. .. . . . . . . . . .
2024-06-06 12:01:26.931 23 INFO cinder.volume.manager [req-a1596919-b6c7-4a8f-a62b-b7fd02f78aec req-ee03d4e1-70d2-4cf0-8379-79660a8f048b 3782a94d24f4433cba14ee40a8360011 cf60ddb02b7844c58085da4375870cb8 - - - -] Terminate volume connection completed successfully.
2024-06-06 12:01:26.931 23 DEBUG cinder.volume.manager [req-a1596919-b6c7-4a8f-a62b-b7fd02f78aec req-ee03d4e1-70d2-4cf0-8379-79660a8f048b 3782a94d24f4433cba14ee40a8360011 cf60ddb02b7844c58085da4375870cb8 - - - -] Deleting attachment a6921aa9-5b93-4cd4-989a-c2c40a720897. attachment_delete /var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/volume/manager.py:4981
2024-06-06 12:02:01.828 23 DEBUG oslo_service.periodic_task [None req-d6827c72-992b-4b95-a966-fca4c95accc5 - - - - - -] Running periodic task VolumeManager.publish_service_capabilities run_periodic_tasks /var/lib/kolla/ven v/lib64/python3.9/site-packages/oslo_service/periodic_task.py:210
2024-06-06 12:02:01.830 23 INFO cinder.volume.drivers.dell_emc.powerflex.driver [None req-d6827c72-992b-4b95-a966-fca4c95accc5 - - - - - -] Query stats for Storage Pool SP01.
2024-06-06 12:02:01.879 23 WARNING py.warnings [None req-d6827c72-992b-4b95-a966-fca4c95accc5 - - - - - -] /var/lib/kolla/venv/lib64/python3.9/site-packages/urllib3/connectionpool.py:1045: InsecureRequestWarning: Unverifie d HTTPS request is being made to host '10.118.100.237'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
warnings.warn(
2024-06-06 12:02:01.890 23 DEBUG cinder.volume.drivers.dell_emc.powerflex.rest_client [None req-d6827c72-992b-4b95-a966-fca4c95accc5 - - - - - -] REST Request: https://10.118.100.237:443/api/types/StoragePool/instances/act ion/querySelectedStatistics with params {"ids": ["8c9d180d00000000"], "properties": ["snapshotCapacityInKb", "thickCapacityInUseInKb", "netCapacityInUseInKb", "netUnusedCapacityInKb", "thinCapacityAllocatedInKb"]} _check_r esponse /var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/volume/drivers/dell_emc/powerflex/rest_client.py:523
2024-06-06 12:02:01.892 23 DEBUG cinder.volume.drivers.dell_emc.powerflex.rest_client [None req-d6827c72-992b-4b95-a966-fca4c95accc5 - - - - - -] REST Response: 200 with data {"8c9d180d00000000":{"snapshotCapacityInKb":0," netCapacityInUseInKb":11812864,"thickCapacityInUseInKb":0,"thinCapacityAllocatedInKb":117440512,"netUnusedCapacityInKb":78455808}} _check_response /var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/volume/drivers/del l_emc/powerflex/rest_client.py:527
2024-06-06 12:02:01.893 23 INFO cinder.volume.drivers.dell_emc.powerflex.driver [None req-d6827c72-992b-4b95-a966-fca4c95accc5 - - - - - -] Free capacity of Storage Pool PD01:SP01: 74, total capacity: 86, provisioned capac ity: 56.
2024-06-06 12:02:01.893 23 INFO cinder.volume.drivers.dell_emc.powerflex.driver [None req-d6827c72-992b-4b95-a966-fca4c95accc5 - - - - - -] Free capacity for backend 'powerflex': 74, total capacity: 86, provisioned capacit y: 56.
2024-06-06 12:02:01.893 23 DEBUG cinder.manager [None req-d6827c72-992b-4b95-a966-fca4c95accc5 - - - - - -] Notifying Schedulers of capabilities ... _publish_service_capabilities /var/lib/kolla/venv/lib64/python3.9/site-pa ckages/cinder/manager.py:202
2024-06-06 12:03:01.830 23 DEBUG oslo_service.periodic_task [None req-d6827c72-992b-4b95-a966-fca4c95accc5 - - - - - -] Running periodic task VolumeManager.publish_service_capabilities run_periodic_tasks /var/lib/kolla/ven v/lib64/python3.9/site-packages/oslo_service/periodic_task.py:210
. . . . . . . . . . . .
2024-06-06 12:07:22.819 23 ERROR cinder.image.image_utils [None req-7ebec027-6ca6-4350-8420-5f5c53d09eef 6cf258b3daa04991b25b1c0dee5d3f30 14593f2bbcb8496e946ddbbba410eb1a - - - -] IOError: 32 Corrupt image download. Hash was cf83e1357eefb8bdf1542850d66d8007d620e4050b5715dc83f4a921d36ce9ce47d0d13c5d85f2b0ff8318d2877eec2f63b931bd47417a81a538327af927da3e expected 1b03ca1bc3fafe448b90583c12f367949f8b0e665685979d95b004e48574b953316799e23240f4f739d1b5eb4c4ca24d38fdc6f4f9d8247a2bc64db25d6bbdb2: BrokenPipeError: [Errno 32] Corrupt image download. Hash was cf83e1357eefb8bdf1542850d66d8007d620e4050b5715dc83f4a921d36ce9ce47d0d13c5d85f2b0ff8318d2877eec2f63b931bd47417a81a538327af927da3e expected 1b03ca1bc3fafe448b90583c12f367949f8b0e665685979d95b004e48574b953316799e23240f4f739d1b5eb4c4ca24d38fdc6f4f9d8247a2bc64db25d6bbdb2
2024-06-06 12:07:22.826 23 WARNING cinder.volume.manager [None req-7ebec027-6ca6-4350-8420-5f5c53d09eef 6cf258b3daa04991b25b1c0dee5d3f30 14593f2bbcb8496e946ddbbba410eb1a - - - -] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40b4a60-f3ae-4759-b6c7-c13fdad5fa51) transitioned into state 'FAILURE' from state 'RUNNING'
5 predecessors (most recent first):
Atom 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f36110c6be0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2024-06-06T10:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='test_image_volume',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='rocky9@powerflex#PD01:SP01',id=2803f5e2-2f03-473a-b1e2-d3c256ce9323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14593f2bbcb8496e946ddbbba410eb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2024-06-06T10:52:18Z,service_uuid=None,shared_targets=True,size=8,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2024-06-06T10:52:18Z,use_quota=True,user_id='6cf258b3daa04991b25b1c0dee5d3f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da37f706-7d0b-4a7c-bc94-204ac67d4907),volume_type_id=da37f706-7d0b-4a7c-bc94-204ac67d4907)}, 'provides': None}
|__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f36110c6be0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2024-06-06T10:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='test_image_volume',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='rocky9@powerflex#PD01:SP01',id=2803f5e2-2f03-473a-b1e2-d3c256ce9323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14593f2bbcb8496e946ddbbba410eb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2024-06-06T10:52:18Z,service_uuid=None,shared_targets=True,size=8,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2024-06-06T10:52:18Z,use_quota=True,user_id='6cf258b3daa04991b25b1c0dee5d3f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da37f706-7d0b-4a7c-bc94-204ac67d4907),volume_type_id=da37f706-7d0b-4a7c-bc94-204ac67d4907), 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=23d602d3-9dcb-475e-8489-7c2e90a1af54,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(2803f5e2-2f03-473a-b1e2-d3c256ce9323),volume_id=2803f5e2-2f03-473a-b1e2-d3c256ce9323,volume_properties=VolumeProperties,volume_type=VolumeType(da37f706-7d0b-4a7c-bc94-204ac67d4907))}, 'provides': {'status': 'creating', 'type': 'image', 'volume_id': '2803f5e2-2f03-473a-b1e2-d3c256ce9323', 'volume_name': 'volume-2803f5e2-2f03-473a-b1e2-d3c256ce9323', 'volume_size': 8, 'image_id': '23d602d3-9dcb-475e-8489-7c2e90a1af54', 'image_location': (None, None), 'image_meta': {'name': 'cirros_flex', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'public', 'size': 13287936, 'virtual_size': 13287936, 'status': 'active', 'checksum': 'ee1eca47dc88f4879d8a229cc70a07c6', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14593f2bbcb8496e946ddbbba410eb1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1b03ca1bc3fafe448b90583c12f367949f8b0e665685979d95b004e48574b953316799e23240f4f739d1b5eb4c4ca24d38fdc6f4f9d8247a2bc64db25d6bbdb2', 'id': '23d602d3-9dcb-475e-8489-7c2e90a1af54', 'created_at': datetime.datetime(2024, 6, 4, 22, 38, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 6, 4, 22, 38, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23d602d3-9dcb-475e-8489-7c2e90a1af54/file', 'stores': 'cinder', 'properties': {'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros_flex'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36116ff580>}}
|__Atom 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'filter_properties': {'request_spec': {'consistencygroup_id': None, 'group_id': None, 'cgsnapshot_id': None, 'image_id': '23d602d3-9dcb-475e-8489-7c2e90a1af54', 'snapshot_id': None, 'source_volid': None, 'volume_id': '2803f5e2-2f03-473a-b1e2-d3c256ce9323', 'volume': {'id': '2803f5e2-2f03-473a-b1e2-d3c256ce9323', '_name_id': None, 'ec2_id': None, 'user_id': '6cf258b3daa04991b25b1c0dee5d3f30', 'project_id': '14593f2bbcb8496e946ddbbba410eb1a', 'use_quota': True, 'snapshot_id': None, 'cluster_name': None, 'host': None, 'size': 8, 'availability_zone': 'nova', 'status': 'creating', 'attach_status': 'detached', 'migration_status': None, 'scheduled_at': None, 'launched_at': None, 'terminated_at': None, 'display_name': 'test_image_volume', 'display_description': None, 'provider_id': None, 'provider_location': None, 'provider_auth': None, 'provider_geometry': None, 'volume_type_id': 'da37f706-7d0b-4a7c-bc94-204ac67d4907', 'source_volid': None, 'encryption_key_id': None, 'consistencygroup_id': None, 'group_id': None, 'deleted': False, 'bootable': False, 'multiattach': False, 'replication_status': None, 'replication_extended_status': None, 'replication_driver_data': None, 'previous_status': None, 'metadata': {}, 'admin_metadata': {}, 'glance_metadata': {}, 'volume_type': {'id': 'da37f706-7d0b-4a7c-bc94-204ac67d4907', 'name': 'powerflex', 'description': None, 'is_public': True, 'extra_specs': {'volume_backend_name': 'powerflex'}, 'qos_specs_id': None, 'created_at': '2024-06-03T17:25:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_attachment': [], 'service_uuid': None, 'shared_targets': True, 'created_at': '2024-06-06T10:37:13.000000', 'updated_at': None, 'deleted_at': None, 'name': 'volume-2803f5e2-2f03-473a-b1e2-d3c256ce9323', 'name_id': '2803f5e2-2f03-473a-b1e2-d3c256ce9323', 'volume_metadata': [], 'volume_admin_metadata': [], 'volume_glance_metadata': []}, 'volume_type': {'id': 'da37f706-7d0b-4a7c-bc94-204ac67d4907', 'name': 'powerflex', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'powerflex'}, 'qos_specs_id': None, 'created_at': '2024-06-03T17:25:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'test_image_volume', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': '14593f2bbcb8496e946ddbbba410eb1a', 'qos_specs': None, 'reservations': ['f4f0a6fe-7738-472f-b556-86413d3418e9', '78619b13-b8a6-4c1b-82c2-c80ad5d78dc7', '58e544d6-f041-42cf-9b26-15f66f65664f', '9351fbb8-6b5f-4058-a8a9-d52e06f270ac'], 'size': 8, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': '6cf258b3daa04991b25b1c0dee5d3f30', 'volume_type_id': 'da37f706-7d0b-4a7c-bc94-204ac67d4907'}, 'backup_id': None, 'availability_zones': ['nova'], 'resource_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'test_image_volume', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': '14593f2bbcb8496e946ddbbba410eb1a', 'qos_specs': None, 'reservations': ['f4f0a6fe-7738-472f-b556-86413d3418e9', '78619b13-b8a6-4c1b-82c2-c80ad5d78dc7', '58e544d6-f041-42cf-9b26-15f66f65664f', '9351fbb8-6b5f-4058-a8a9-d52e06f270ac'], 'size': 8, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': '6cf258b3daa04991b25b1c0dee5d3f30', 'volume_type_id': 'da37f706-7d0b-4a7c-bc94-204ac67d4907'}}, 'config_options': {}, 'volume_type': VolumeType(created_at=2024-06-03T17:25:33Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='powerflex'},id=da37f706-7d0b-4a7c-bc94-204ac67d4907,is_public=True,name='powerflex',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'resource_type': VolumeType(created_at=2024-06-03T17:25:33Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='powerflex'},id=da37f706-7d0b-4a7c-bc94-204ac67d4907,is_public=True,name='powerflex',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'size': 8, 'availability_zone': 'nova', 'user_id': '6cf258b3daa04991b25b1c0dee5d3f30', 'metadata': {}, 'qos_specs': None, 'retry': {'num_attempts': 2, 'backends': ['rocky9@powerflex#PD01:SP01', 'rocky9@powerflex#PD01:SP01'], 'hosts': ['rocky9@powerflex#PD01:SP01', 'rocky9@powerflex#PD01:SP01']}}, 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=23d602d3-9dcb-475e-8489-7c2e90a1af54,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(2803f5e2-2f03-473a-b1e2-d3c256ce9323),volume_id=2803f5e2-2f03-473a-b1e2-d3c256ce9323,volume_properties=VolumeProperties,volume_type=VolumeType(da37f706-7d0b-4a7c-bc94-204ac67d4907)), 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2024-06-06T10:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='test_image_volume',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='rocky9@powerflex#PD01:SP01',id=2803f5e2-2f03-473a-b1e2-d3c256ce9323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14593f2bbcb8496e946ddbbba410eb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2024-06-06T10:52:18Z,service_uuid=None,shared_targets=True,size=8,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2024-06-06T10:52:18Z,use_quota=True,user_id='6cf258b3daa04991b25b1c0dee5d3f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da37f706-7d0b-4a7c-bc94-204ac67d4907),volume_type_id=da37f706-7d0b-4a7c-bc94-204ac67d4907), 'context': <cinder.context.RequestContext object at 0x7f36110c6be0>}, 'provides': None}
|__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f36110c6be0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2024-06-06T10:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='test_image_volume',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='rocky9@powerflex#PD01:SP01',id=2803f5e2-2f03-473a-b1e2-d3c256ce9323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14593f2bbcb8496e946ddbbba410eb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2024-06-06T10:52:18Z,service_uuid=None,shared_targets=True,size=8,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2024-06-06T10:52:18Z,use_quota=True,user_id='6cf258b3daa04991b25b1c0dee5d3f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da37f706-7d0b-4a7c-bc94-204ac67d4907),volume_type_id=da37f706-7d0b-4a7c-bc94-204ac67d4907)}, 'provides': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2024-06-06T10:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='test_image_volume',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='rocky9@powerflex#PD01:SP01',id=2803f5e2-2f03-473a-b1e2-d3c256ce9323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14593f2bbcb8496e946ddbbba410eb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2024-06-06T10:52:18Z,service_uuid=None,shared_targets=True,size=8,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2024-06-06T10:52:18Z,use_quota=True,user_id='6cf258b3daa04991b25b1c0dee5d3f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da37f706-7d0b-4a7c-bc94-204ac67d4907),volume_type_id=da37f706-7d0b-4a7c-bc94-204ac67d4907)}
|__Flow 'volume_create_manager': cinder.exception.ImageDownloadFailed: Failed to download image 23d602d3-9dcb-475e-8489-7c2e90a1af54, reason: IOError: 32 Corrupt image download. Hash was cf83e1357eefb8bdf1542850d66d8007d620e4050b5715dc83f4a921d36ce9ce47d0d13c5d85f2b0ff8318d2877eec2f63b931bd47417a81a538327af927da3e expected 1b03ca1bc3fafe448b90583c12f367949f8b0e665685979d95b004e48574b953316799e23240f4f739d1b5eb4c4ca24d38fdc6f4f9d8247a2bc64db25d6bbdb2
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager Traceback (most recent call last):
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/image/image_utils.py", line 610, in fetch
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager image_service.download(context, image_id,
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/image/glance.py", line 420, in download
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager for chunk in image_chunks:
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/glanceclient/common/utils.py", line 570, in __iter__
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager for chunk in self.iterable:
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/glanceclient/common/utils.py", line 518, in serious_integrity_iter
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager raise IOError(errno.EPIPE,
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager BrokenPipeError: [Errno 32] Corrupt image download. Hash was cf83e1357eefb8bdf1542850d66d8007d620e4050b5715dc83f4a921d36ce9ce47d0d13c5d85f2b0ff8318d2877eec2f63b931bd47417a81a538327af927da3e expected 1b03ca1bc3fafe448b90583c12f367949f8b0e665685979d95b004e48574b953316799e23240f4f739d1b5eb4c4ca24d38fdc6f4f9d8247a2bc64db25d6bbdb2
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager During handling of the above exception, another exception occurred:
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager Traceback (most recent call last):
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager result = task.execute(**arguments)
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/volume/flows/manager/create_volume.py", line 1237, in execute
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager model_update = self._create_from_image(context,
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/utils.py", line 669, in _wrapper
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager return r(f, *args, **kwargs)
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/tenacity/__init__.py", line 423, in __call__
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager do = self.iter(retry_state=retry_state)
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/tenacity/__init__.py", line 360, in iter
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager return fut.result()
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 439, in result
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager return self.__get_result()
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager raise self._exception
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/tenacity/__init__.py", line 426, in __call__
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager result = fn(*args, **kwargs)
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager model_update = self._create_from_image_cache_or_download(
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/volume/flows/manager/create_volume.py", line 978, in _create_from_image_cache_or_download
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager with image_utils.TemporaryImages.fetch(
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/usr/lib64/python3.9/contextlib.py", line 119, in __enter__
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager return next(self.gen)
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/image/image_utils.py", line 1293, in fetch
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager fetch_verify_image(context, image_service, image_id, tmp)
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/image/image_utils.py", line 781, in fetch_verify_image
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager fetch(context, image_service, image_id, dest,
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager File "/var/lib/kolla/venv/lib64/python3.9/site-packages/cinder/image/image_utils.py", line 626, in fetch
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager raise exception.ImageDownloadFailed(image_href=image_id,
2024-06-06 12:07:22.826 23 ERROR cinder.volume.manager cinder.exception.ImageDownloadFailed: Failed to download image 23d602d3-9dcb-475e-8489-7c2e90a1af54, reason: IOError: 32 Corrupt image download. Hash was cf83e1357eefb8bdf1542850d66d8007d620e4050b5715dc83f4a921d36ce9ce47d0d13c5d85f2b0ff8318d2877eec2f63b931bd47417a81a538327af927da3e expected 1b03ca1bc3fafe448b90583c12f367949f8b0e665685979d95b004e48574b953316799e23240f4f739d1b5eb4c4ca24d38fdc6f4f9d8247a2bc64db25d6bbdb2
