| 2020-01-21 21:26:07 |
Fernando Ferraz |
description |
After retyping a volume from NetApp OnTAP backend to SolidFire, SF driver fails to attach the volume to a instance in Nova. |
Cinder fails to retype a attached volume from NetApp OnTAP backend to SolidFire. However, all tests I've performed shows that Cinder can successfully retype attached volumes from Solidfire to OnTAP.
The error message from the volume service:
Jan 21 21:05:29.821928 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Volume 3b29da6b-8808-417b-bc2b-924e45f24aab, not found on SF Cluster.
Jan 21 21:05:29.822830 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Volume ID 3b29da6b-8808-417b-bc2b-924e45f24aab was not found on the SolidFire Cluster while attempting attach_volume operation!
Jan 21 21:05:29.823776 51-sfernand-development cinder-volume[11780]: INFO cinder.message.api [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Creating message record for request_id = req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Exception during message handling: cinder.exception.VolumeNotFound: Volume 3b29da6b-8808-417b-bc2b-924e45f24aab could not be found.
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 274, in dispatch
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/manager.py", line 4570, in attachment_update
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server fields.VolumeAttachStatus.ERROR_ATTACHING})
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server self.force_reraise()
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/six.py", line 693, in reraise
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server raise value
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/manager.py", line 4560, in attachment_update
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server connector.get('mountpoint', 'na'))
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/drivers/solidfire.py", line 2082, in attach_volume
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server raise exception.VolumeNotFound(volume_id=volume['id'])
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server cinder.exception.VolumeNotFound: Volume 3b29da6b-8808-417b-bc2b-924e45f24aab could not be found.
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server
Jan 21 21:05:30.108045 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-4401c014-5207-4af0-9dd3-2c5e57e94e75 service None] Volume 3b29da6b-8808-417b-bc2b-924e45f24aab, not found on SF Cluster.
Jan 21 21:05:30.109065 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-4401c014-5207-4af0-9dd3-2c5e57e94e75 service None] Volume ID 3b29da6b-8808-417b-bc2b-924e45f24aab was not found on the SolidFire Cluster while attempting detach_volume operation! |
|
| 2020-01-21 21:29:17 |
Fernando Ferraz |
description |
Cinder fails to retype a attached volume from NetApp OnTAP backend to SolidFire. However, all tests I've performed shows that Cinder can successfully retype attached volumes from Solidfire to OnTAP.
The error message from the volume service:
Jan 21 21:05:29.821928 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Volume 3b29da6b-8808-417b-bc2b-924e45f24aab, not found on SF Cluster.
Jan 21 21:05:29.822830 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Volume ID 3b29da6b-8808-417b-bc2b-924e45f24aab was not found on the SolidFire Cluster while attempting attach_volume operation!
Jan 21 21:05:29.823776 51-sfernand-development cinder-volume[11780]: INFO cinder.message.api [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Creating message record for request_id = req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Exception during message handling: cinder.exception.VolumeNotFound: Volume 3b29da6b-8808-417b-bc2b-924e45f24aab could not be found.
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 274, in dispatch
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/manager.py", line 4570, in attachment_update
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server fields.VolumeAttachStatus.ERROR_ATTACHING})
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server self.force_reraise()
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/six.py", line 693, in reraise
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server raise value
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/manager.py", line 4560, in attachment_update
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server connector.get('mountpoint', 'na'))
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/drivers/solidfire.py", line 2082, in attach_volume
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server raise exception.VolumeNotFound(volume_id=volume['id'])
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server cinder.exception.VolumeNotFound: Volume 3b29da6b-8808-417b-bc2b-924e45f24aab could not be found.
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server
Jan 21 21:05:30.108045 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-4401c014-5207-4af0-9dd3-2c5e57e94e75 service None] Volume 3b29da6b-8808-417b-bc2b-924e45f24aab, not found on SF Cluster.
Jan 21 21:05:30.109065 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-4401c014-5207-4af0-9dd3-2c5e57e94e75 service None] Volume ID 3b29da6b-8808-417b-bc2b-924e45f24aab was not found on the SolidFire Cluster while attempting detach_volume operation! |
Cinder fails to retype a attached volume from NetApp OnTAP backend to SolidFire. However, all tests I've performed shows that Cinder can successfully retype attached volumes from Solidfire to OnTAP.
Cinder also successfully retyped detached volumes on both directions.
The error message from the volume service:
Jan 21 21:05:29.821928 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Volume 3b29da6b-8808-417b-bc2b-924e45f24aab, not found on SF Cluster.
Jan 21 21:05:29.822830 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Volume ID 3b29da6b-8808-417b-bc2b-924e45f24aab was not found on the SolidFire Cluster while attempting attach_volume operation!
Jan 21 21:05:29.823776 51-sfernand-development cinder-volume[11780]: INFO cinder.message.api [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Creating message record for request_id = req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-ef5917f3-fb4a-41ad-b118-3fbedcb6c569 service None] Exception during message handling: cinder.exception.VolumeNotFound: Volume 3b29da6b-8808-417b-bc2b-924e45f24aab could not be found.
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 274, in dispatch
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/manager.py", line 4570, in attachment_update
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server fields.VolumeAttachStatus.ERROR_ATTACHING})
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server self.force_reraise()
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.7/dist-packages/six.py", line 693, in reraise
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server raise value
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/manager.py", line 4560, in attachment_update
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server connector.get('mountpoint', 'na'))
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/drivers/solidfire.py", line 2082, in attach_volume
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server raise exception.VolumeNotFound(volume_id=volume['id'])
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server cinder.exception.VolumeNotFound: Volume 3b29da6b-8808-417b-bc2b-924e45f24aab could not be found.
Jan 21 21:05:29.838113 51-sfernand-development cinder-volume[11780]: ERROR oslo_messaging.rpc.server
Jan 21 21:05:30.108045 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-4401c014-5207-4af0-9dd3-2c5e57e94e75 service None] Volume 3b29da6b-8808-417b-bc2b-924e45f24aab, not found on SF Cluster.
Jan 21 21:05:30.109065 51-sfernand-development cinder-volume[11780]: ERROR cinder.volume.drivers.solidfire [req-2ae12450-aa3b-4eb5-be4b-18585178dcc5 req-4401c014-5207-4af0-9dd3-2c5e57e94e75 service None] Volume ID 3b29da6b-8808-417b-bc2b-924e45f24aab was not found on the SolidFire Cluster while attempting detach_volume operation! |
|
