When migrating an attached volume from an LVM backend to another backend, the provider location of the source volume is left as LVM while its type is changed to destynation_type. When Cinder tries to delete it, an error is returned:
2016-11-22 10:29:59.669 ERROR oslo_messaging.rpc.server [req-09f4e39b-e463-4026-8415-e45a2e3fc9ce tempest-TestVolumeMigrateRetypeAttached-270983756] Exception during message handling
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 155, in _process_incoming
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 225, in dispatch
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 195, in _do_dispatch
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "<decorator-gen-238>", line 2, in delete_volume
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/coordination.py", line 286, in _synchronized
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server return f(*a, **k)
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "<decorator-gen-237>", line 2, in delete_volume
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/objects/cleanable.py", line 191, in wrapper
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server result = f(*args, **kwargs)
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/manager.py", line 737, in delete_volume
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server 'error_deleting')
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server self.force_reraise()
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/manager.py", line 723, in delete_volume
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server self.driver.delete_volume(volume)
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/utils.py", line 895, in trace_logging_wrapper
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server result = f(*args, **kwargs)
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/drivers/remotefs.py", line 291, in delete_volume
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server self._ensure_share_mounted(volume.provider_location)
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server File "/opt/stack/new/cinder/cinder/volume/drivers/nfs.py", line 175, in _ensure_share_mounted
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server raise exception.NfsException(six.text_type(e))
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server NfsException: NFS mount failed for share 10.10.189.194:3260,1 iqn.2010-10.org.openstack:volume-2e6af913-4fd4-42f9-bfec-2f9a9605bca0 1. Error - {'pnfs': u"Unexpected error while running command.\nCommand: sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount -t nfs -o vers=4,minorversion=1 10.10.189.194:3260,1 iqn.2010-10.org.openstack:volume-2e6af913-4fd4-42f9-bfec-2f9a9605bca0 1 /opt/stack/data/cinder/mnt/e9185466064158ed77d76716ee97b295\nExit code: 32\nStdout: u''\nStderr: u'mount.nfs: access denied by server while mounting 10.10.189.194:3260,1 iqn.2010-10.org.openstack:volume-2e6af913-4fd4-42f9-bfec-2f9a9605bca0 1\\n'", 'nfs': u"Unexpected error while running command.\nCommand: sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount -t nfs 10.10.189.194:3260,1 iqn.2010-10.org.openstack:volume-2e6af913-4fd4-42f9-bfec-2f9a9605bca0 1 /opt/stack/data/cinder/mnt/e9185466064158ed77d76716ee97b295\nExit code: 32\nStdout: u''\nStderr: u'mount.nfs: access denied by server while mounting 10.10.189.194:3260,1 iqn.2010-10.org.openstack:volume-2e6af913-4fd4-42f9-bfec-2f9a9605bca0 1\\n'"}
2016-11-22 10:29:59.669 11222 ERROR oslo_messaging.rpc.server
----------------
Full error and more logs here: http://logs.openstack.org/92/396592/7/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/6a9b3e5/
