IBM Spectrum Scale Cinder driver (gpfs) throws an error when gpfs_images_share_mode is set to copy_on_write in GPFSNFS configuration.
2021-09-21 07:45:12.609 4373 INFO cinder.volume.flows.manager.create_volume [req-4c87e2b5-e500-4e47-86fc-60961ec59c5f afea48f8d5474f66a6db9fd3d4db1faf 5311c56042934c6ea797c4060b11abad - default default] Volume 5570c5d3-e446-4099-81bc-7aeaf8ff1579: being created as image with specification: {'status': u'creating', 'image_location': (None, None), 'volume_size': 1, 'volume_name': u'volume-5570c5d3-e446-4099-81bc-7aeaf8ff1579', 'image_id': u'731c00d1-5295-4452-87d0-7a0b12089b88', 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1f29a5fa10>, 'image_meta': {u'status': u'active', u'file': u'/v2/images/731c00d1-5295-4452-87d0-7a0b12089b88/file', u'id': u'731c00d1-5295-4452-87d0-7a0b12089b88', u'name': u'cirros', u'tags': [], u'container_format': u'bare', u'created_at': datetime.datetime(2021, 9, 20, 10, 50, 55, tzinfo=<iso8601.Utc>), u'disk_format': u'qcow2', u'updated_at': datetime.datetime(2021, 9, 20, 10, 50, 56, tzinfo=<iso8601.Utc>), u'visibility': u'public', u'os_hash_algo': u'sha512', u'owner': u'5311c56042934c6ea797c4060b11abad', u'protected': False, u'os_hash_value': u'6513f21e44aa3da349f248188a44bc304a3653a04122d8fb4535423c8e1d14cd6a153f735bb0982e2161b5b5186106570c17a9e58b64dd39390617cd5a350f78', u'min_ram': 0, u'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', u'min_disk': 0, u'os_hidden': False, u'virtual_size': None, 'properties': {}, u'size': 12716032}}
2021-09-21 07:45:12.765 4373 WARNING cinder.volume.manager [req-4c87e2b5-e500-4e47-86fc-60961ec59c5f afea48f8d5474f66a6db9fd3d4db1faf 5311c56042934c6ea797c4060b11abad - default default] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7275b8ff-7d2e-407e-879e-e95ae645b94e) transitioned into state 'FAILURE' from state 'RUNNING'
5 predecessors (most recent first):
Atom 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-09-21T11:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='qcow-vol-1',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='openstack.novalocal@GPFSNFS#GPFSNFS',id=5570c5d3-e446-4099-81bc-7aeaf8ff1579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5311c56042934c6ea797c4060b11abad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-09-21T11:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-09-21T11:45:12Z,user_id='afea48f8d5474f66a6db9fd3d4db1faf',volume_attachment=<?>,volume_type=<?>,volume_type_id=None), 'context': <cinder.context.RequestContext object at 0x7f1f29c52810>}, 'provides': None}
|__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-09-21T11:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='qcow-vol-1',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='openstack.novalocal@GPFSNFS#GPFSNFS',id=5570c5d3-e446-4099-81bc-7aeaf8ff1579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5311c56042934c6ea797c4060b11abad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-09-21T11:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-09-21T11:45:12Z,user_id='afea48f8d5474f66a6db9fd3d4db1faf',volume_attachment=<?>,volume_type=<?>,volume_type_id=None), 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=731c00d1-5295-4452-87d0-7a0b12089b88,operation='create_volume',resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5570c5d3-e446-4099-81bc-7aeaf8ff1579),volume_id=5570c5d3-e446-4099-81bc-7aeaf8ff1579,volume_properties=VolumeProperties,volume_type=None), 'context': <cinder.context.RequestContext object at 0x7f1f29c52810>}, 'provides': {'status': u'creating', 'image_location': (None, None), 'image_id': u'731c00d1-5295-4452-87d0-7a0b12089b88', 'volume_id': u'5570c5d3-e446-4099-81bc-7aeaf8ff1579', 'volume_size': 1, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1f29a5fa10>, 'image_meta': {u'status': u'active', u'file': u'/v2/images/731c00d1-5295-4452-87d0-7a0b12089b88/file', u'id': u'731c00d1-5295-4452-87d0-7a0b12089b88', u'name': u'cirros', u'tags': [], u'container_format': u'bare', u'created_at': datetime.datetime(2021, 9, 20, 10, 50, 55, tzinfo=<iso8601.Utc>), u'disk_format': u'qcow2', u'updated_at': datetime.datetime(2021, 9, 20, 10, 50, 56, tzinfo=<iso8601.Utc>), u'visibility': u'public', u'os_hash_algo': u'sha512', u'owner': u'5311c56042934c6ea797c4060b11abad', u'protected': False, u'os_hash_value': u'6513f21e44aa3da349f248188a44bc304a3653a04122d8fb4535423c8e1d14cd6a153f735bb0982e2161b5b5186106570c17a9e58b64dd39390617cd5a350f78', u'min_ram': 0, u'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', u'min_disk': 0, u'os_hidden': False, u'virtual_size': None, 'properties': {}, u'size': 12716032}, 'volume_name': u'volume-5570c5d3-e446-4099-81bc-7aeaf8ff1579', 'type': 'image'}}
|__Atom 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-09-21T11:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='qcow-vol-1',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='openstack.novalocal@GPFSNFS#GPFSNFS',id=5570c5d3-e446-4099-81bc-7aeaf8ff1579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5311c56042934c6ea797c4060b11abad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-09-21T11:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-09-21T11:45:12Z,user_id='afea48f8d5474f66a6db9fd3d4db1faf',volume_attachment=<?>,volume_type=<?>,volume_type_id=None), 'filter_properties': {u'config_options': {}, u'request_spec': {u'backup_id': None, u'volume_id': u'5570c5d3-e446-4099-81bc-7aeaf8ff1579', u'volume_properties': {u'status': u'creating', u'volume_type_id': None, u'project_id': u'5311c56042934c6ea797c4060b11abad', u'user_id': u'afea48f8d5474f66a6db9fd3d4db1faf', u'availability_zone': u'nova', u'reservations': [u'bcd1d297-bd51-4917-88b2-d29217a7c050', u'7c5eee82-ec9f-44a9-9f1f-b260a78585bc'], u'multiattach': False, u'attach_status': u'detached', u'source_volid': None, u'cgsnapshot_id': None, u'metadata': {}, u'qos_specs': None, u'encryption_key_id': None, u'display_description': None, u'snapshot_id': None, u'display_name': u'qcow-vol-1', u'group_id': None, u'consistencygroup_id': None, u'size': 1}, u'source_volid': None, u'cgsnapshot_id': None, u'volume': {u'migration_status': None, u'provider_id': None, u'availability_zone': u'nova', u'terminated_at': None, u'updated_at': None, u'provider_geometry': None, u'replication_extended_status': None, u'replication_status': None, u'snapshot_id': None, u'ec2_id': None, u'deleted_at': None, u'id': u'5570c5d3-e446-4099-81bc-7aeaf8ff1579', u'size': 1, u'display_name': u'qcow-vol-1', u'display_description': None, u'cluster_name': None, u'name_id': u'5570c5d3-e446-4099-81bc-7aeaf8ff1579', u'volume_admin_metadata': [], u'project_id': u'5311c56042934c6ea797c4060b11abad', u'launched_at': None, u'scheduled_at': None, u'status': u'creating', u'volume_type_id': None, u'multiattach': False, u'deleted': False, u'service_uuid': None, u'provider_location': None, u'volume_glance_metadata': [], u'host': None, u'consistencygroup_id': None, u'source_volid': None, u'provider_auth': None, u'previous_status': None, u'group_id': None, u'name': u'volume-5570c5d3-e446-4099-81bc-7aeaf8ff1579', u'user_id': u'afea48f8d5474f66a6db9fd3d4db1faf', u'bootable': False, u'shared_targets': True, u'attach_status': u'detached', u'volume_metadata': [], u'_name_id': None, u'encryption_key_id': None, u'replication_driver_data': None, u'metadata': {}, u'created_at': u'2021-09-21T11:45:11.000000'}, u'image_id': u'731c00d1-5295-4452-87d0-7a0b12089b88', u'availability_zones': [u'nova'], u'consistencygroup_id': None, u'volume_type': None, u'snapshot_id': None, u'operation': u'create_volume', u'resource_properties': {u'status': u'creating', u'volume_type_id': None, u'project_id': u'5311c56042934c6ea797c4060b11abad', u'user_id': u'afea48f8d5474f66a6db9fd3d4db1faf', u'availability_zone': u'nova', u'reservations': [u'bcd1d297-bd51-4917-88b2-d29217a7c050', u'7c5eee82-ec9f-44a9-9f1f-b260a78585bc'], u'multiattach': False, u'attach_status': u'detached', u'source_volid': None, u'cgsnapshot_id': None, u'metadata': {}, u'qos_specs': None, u'encryption_key_id': None, u'display_description': None, u'snapshot_id': None, u'display_name': u'qcow-vol-1', u'group_id': None, u'consistencygroup_id': None, u'size': 1}, u'group_id': None}, u'user_id': u'afea48f8d5474f66a6db9fd3d4db1faf', u'availability_zone': u'nova', u'volume_type': None, u'qos_specs': None, u'retry': {u'num_attempts': 1, u'backends': [u'openstack.novalocal@GPFSNFS#GPFSNFS'], u'hosts': [u'openstack.novalocal@GPFSNFS#GPFSNFS']}, u'metadata': {}, u'resource_type': {}, u'size': 1}, 'context': <cinder.context.RequestContext object at 0x7f1f29c52810>, 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=731c00d1-5295-4452-87d0-7a0b12089b88,operation='create_volume',resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5570c5d3-e446-4099-81bc-7aeaf8ff1579),volume_id=5570c5d3-e446-4099-81bc-7aeaf8ff1579,volume_properties=VolumeProperties,volume_type=None)}, 'provides': None}
|__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-09-21T11:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='qcow-vol-1',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='openstack.novalocal@GPFSNFS#GPFSNFS',id=5570c5d3-e446-4099-81bc-7aeaf8ff1579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5311c56042934c6ea797c4060b11abad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-09-21T11:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-09-21T11:45:12Z,user_id='afea48f8d5474f66a6db9fd3d4db1faf',volume_attachment=<?>,volume_type=<?>,volume_type_id=None), 'context': <cinder.context.RequestContext object at 0x7f1f29c52810>}, 'provides': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-09-21T11:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='qcow-vol-1',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='openstack.novalocal@GPFSNFS#GPFSNFS',id=5570c5d3-e446-4099-81bc-7aeaf8ff1579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5311c56042934c6ea797c4060b11abad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-09-21T11:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-09-21T11:45:12Z,user_id='afea48f8d5474f66a6db9fd3d4db1faf',volume_attachment=<?>,volume_type=<?>,volume_type_id=None)}
|__Flow 'volume_create_manager': TypeError: md5() argument 1 must be string or buffer, not None
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager Traceback (most recent call last):
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager result = task.execute(**arguments)
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 980, in execute
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager **volume_spec)
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/utils.py", line 818, in _wrapper
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager return r.call(f, *args, **kwargs)
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/retrying.py", line 223, in call
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager return attempt.get(self._wrap_exception)
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/retrying.py", line 261, in get
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager six.reraise(self.value[0], self.value[1], self.value[2])
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/retrying.py", line 217, in call
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 848, in _create_from_image
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager image_service)
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/ibm/gpfs.py", line 902, in clone_image
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager return self._clone_image(volume, image_location, image_meta['id'])
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/ibm/gpfs.py", line 937, in _clone_image
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager vol_path = self.local_path(volume)
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/ibm/gpfs.py", line 1629, in local_path
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager base_local_path = self._get_mount_point_for_share(remotefs_share)
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/nfs.py", line 340, in _get_mount_point_for_share
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager return self._remotefsclient.get_mount_point(nfs_share)
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/os_brick/remotefs/remotefs.py", line 81, in get_mount_point
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager self._get_hash_str(device_name))
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/os_brick/remotefs/remotefs.py", line 73, in _get_hash_str
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager return hashlib.md5(base_str).hexdigest()
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager TypeError: md5() argument 1 must be string or buffer, not None
2021-09-21 07:45:12.765 4373 ERROR cinder.volume.manager
Reviewed: https:/ /review. opendev. org/c/openstack /cinder/ +/813984 /opendev. org/openstack/ cinder/ commit/ dcc191646985fa0 be76ee763935ef3 7a8456d1e6
Committed: https:/
Submitter: "Zuul (22348)"
Branch: master
commit dcc191646985fa0 be76ee763935ef3 7a8456d1e6
Author: digvijay2016 <email address hidden>
Date: Thu Oct 14 07:24:18 2021 -0400
Fixed copy-on-write mode in GPFS NFS driver
IBM Spectrum Scale cinder driver (GPFS) support copy-on-write feature
in all the configuration. Resolving the bug mentioned below will
enable mmclone feature of the IBM Spectrum Scale filesystem to provide
better performance while configured in GPFS NFS mode.
Closes-Bug: #1947134 85dab92500eae98 9b4dff9824d
Closes-Bug: #1947123
Change-Id: I3e77c890c7abca