Volume Retype failures

[Paul Bessa]

Mirantis OS9 (Mitaka) environment.
One Controller/Cinder Node
Two Compute Nodes.
Multiple EMC Storage Backend

I successfully performed a volume migration between two different EMC storage backend arrays.
cinder show cc1027a3-d4cc-467a-b176-8166b445b178
+--------------------------------+-----------------------------------------------+
| Property | Value |
+--------------------------------+-----------------------------------------------+
| attachments | [] |
| availability_zone | nova |
| bootable | false |
| consistencygroup_id | None |
| created_at | 2016-10-18T17:30:58.000000 |
| description | |
| encrypted | False |
| id | cc1027a3-d4cc-467a-b176-8166b445b178 |
| metadata | {} |
| migration_status | success |
| multiattach | False |
| name | VMAX-v3-FC-lvm-vol-7 |
| os-vol-host-attr:host | node-2.domain.tld@xio_190_iscsi#xio_190_iscsi |
| os-vol-mig-status-attr:migstat | success |
| os-vol-mig-status-attr:name_id | None |
| os-vol-tenant-attr:tenant_id | 303aa64b6a574bf4912b3fc1731f0fd0 |
| replication_status | disabled |
| size | 100 |
| snapshot_id | None |
| source_volid | None |
| status | available |
| updated_at | 2016-10-19T17:11:56.000000 |
| user_id | 545ec91844e547efbfa7f972287cdd5e |
| volume_type | vmax_1559_fc |
+--------------------------------+-----------------------------------------------+

After the migration I ran the "Retype" operation to change the volume type to the new type "xio_190_iscsi" -

cinder retype cc1027a3-d4cc-467a-b176-8166b445b178 xio_190_iscsi --migration-policy on-demand

The volume type does not change. I checked the logs and the operation failed with the following error message.

oslo_messaging.rpc.dispatcher [req-d29444c1-78f9-4c94-b0df-80d1bb0933ef 545ec91844e547efbfa7f972287cdd5e 303aa64b6a574bf4912b3fc1731f0fd0 - - -] Exception during message handling: Volume migration failed: Retype requires migration but is not allowed.
2016-10-19 17:11:55.870 11878 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2016-10-19 17:11:55.870 11878 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
2016-10-19 17:11:55.870 11878 ERROR oslo_messaging.rpc.dispatcher incoming.message))
2016-10-19 17:11:55.870 11878 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
2016-10-19 17:11:55.870 11878 ERROR oslo_messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args)
2016-10-19 17:11:55.870 11878 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
2016-10-19 17:11:55.870 11878 ERROR oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2016-10-19 17:11:55.870 11878 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 2281, in retype
2016-10-19 17:11:55.870 11878 ERROR oslo_messaging.rpc.dispatcher raise exception.VolumeMigrationFailed(reason=msg)
2016-10-19 17:11:55.870 11878 ERROR oslo_messaging.rpc.dispatcher VolumeMigrationFailed: Volume migration failed: Retype requires migration but is not allowed.
2016-10-19 17:11:55.870 11878 ERROR oslo_messaging.rpc.dispatcher

It appears that the Retype operation wants to perform a migration even though the migration policy is set to on demand.

[Oleksiy Molchanov (omolchanov)]

Cinder team, can you check this?

[Ivan Kolodyazhny (e0ne)]

An error in a bug description is not related to the issue. Here is related log: http://paste.openstack.org/show/587455/

[Ivan Kolodyazhny (e0ne)]

Paul, it looks like a valid issue. I didn't find related bug in the upstream Cinder. Unfortunately, I don't have an env to reproduce and fix it. Is it possible to have webex session for bug investigation?

[Paul Bessa (paul-bessa)]

Hi Ivan,

Sure, please let me know when you want to do the WebEx - I'm am based in the US on EST zone. Once a date/time is confirmed I will send out the WebEx invite.

Thanks

Paul

[Ivan Kolodyazhny (e0ne)]

Paul, could we schedule a webex on Monday or Tuesday next week? I'll be available until 11am PST