Starting 2016-01-29 our Cinder CI hits this issue during online snapshot tests (c-vol.log):
2016-02-01 12:09:27.966 DEBUG cinder.compute.nova [req-27a055ff-6730-4b96-a1a8-5bfae7f01add service] Creating a Nova client using "nova" user novaclient /opt/stack/cinder/cinder/compute/nova.py:125
2016-02-01 12:09:27.985 ERROR cinder.volume.drivers.remotefs [req-27a055ff-6730-4b96-a1a8-5bfae7f01add service] Call to Nova to create snapshot failed
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs Traceback (most recent call last):
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs File "/opt/stack/cinder/cinder/volume/drivers/remotefs.py", line 1275, in _create_snapshot_online
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs connection_info)
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs File "/opt/stack/cinder/cinder/compute/nova.py", line 179, in create_volume_snapshot
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs create_info=create_info)
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs File "/usr/local/lib/python2.7/dist-packages/novaclient/v2/contrib/assisted_volume_snapshots.py", line 41, in create
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs return self._create('/os-assisted-volume-snapshots', body, 'snapshot')
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs File "/usr/local/lib/python2.7/dist-packages/novaclient/base.py", line 302, in _create
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs _resp, body = self.api.client.post(url, body=body)
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 451, in post
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs return self._cs_request(url, 'POST', **kwargs)
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 404, in _cs_request
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs self.authenticate()
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 587, in authenticate
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs self._v2_auth(auth_url)
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 652, in _v2_auth
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs return self._authenticate(url, body)
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 665, in _authenticate
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs **kwargs)
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 399, in _time_request
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs resp, body = self.request(url, method, **kwargs)
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 393, in request
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs raise exceptions.from_response(resp, body, url, method)
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs NotFound: The resource could not be found. (HTTP 404)
2016-02-01 12:09:27.985 14017 ERROR cinder.volume.drivers.remotefs
Example logs can be found at these jobs:
http://osci4.ext/logs/refs-changes-95-271595-5/
http://osci4.ext/logs/refs-changes-28-253328-5/
http://osci4.ext/logs/refs-changes-54-273154-4/
http://osci4.ext/logs/refs-changes-68-274468-6/
Last stable run of the CI without this issue can be found here:
http://osci4.ext/logs/refs-changes-35-245635-7/