cinder fails to snapshot with nfs driver

Bug #1772959 reported by Vladislav Belogrudov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla-ansible
Fix Released
Undecided
Vladislav Belogrudov

Bug Description

When trying to create a snapshot from nfs volume cinder-volume reports issues while trying to reach nova:

2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs [req-e6e8daa1-6656-4873-bcd8-aff0351493ee f4f4721cb2af4dffacea3d0279fb8f7b ddacc04e7c6b426c891aece8060a57b0 - - -] Call to Nova to create snapshot failed: NotFound: (http://10.196.245.222:5000/v2.0/tokens): The resource could not be found. (HTTP 404) (Request-ID: req-dce9c679-dfda-4a42-b5c8-a56ce4ace879)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs Traceback (most recent call last):
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/cinder/volume/drivers/remotefs.py", line 1452, in _create_snapshot_online
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs connection_info)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/cinder/compute/nova.py", line 188, in create_volume_snapshot
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs create_info=create_info)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/novaclient/v2/assisted_volume_snapshots.py", line 43, in create
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs return self._create('/os-assisted-volume-snapshots', body, 'snapshot')
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/novaclient/base.py", line 361, in _create
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs resp, body = self.api.client.post(url, body=body)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 310, in post
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs return self.request(url, 'POST', **kwargs)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/novaclient/client.py", line 77, in request
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs **kwargs)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 463, in request
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs resp = super(LegacyJsonAdapter, self).request(*args, **kwargs)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 189, in request
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs return self.session.request(url, method, **kwargs)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/session.py", line 573, in request
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs auth_headers = self.get_auth_headers(auth)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/session.py", line 900, in get_auth_headers
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs return auth.get_headers(self, **kwargs)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/plugin.py", line 95, in get_headers
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs token = self.get_token(session)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 88, in get_token
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs return self.get_access(session).auth_token
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 134, in get_access
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs self.auth_ref = self.get_auth_ref(session)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/identity/generic/base.py", line 201, in get_auth_ref
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs return self._plugin.get_auth_ref(session, **kwargs)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/identity/v2.py", line 63, in get_auth_ref
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs authenticated=False, log=False)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/session.py", line 848, in post
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs return self.request(url, 'POST', **kwargs)
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs File "/var/lib/kolla/venv/lib/python2.7/site-packages/keystoneauth1/session.py", line 737, in request
2018-05-23 17:17:43.555 33 ERROR cinder.volume.drivers.remotefs raise exceptions.from_response(resp, method, url)

Revision history for this message
Vladislav Belogrudov (vlad-belogrudov) wrote :

when re-using [nova] section from neutron configuration everything works again

Changed in kolla-ansible:
assignee: nobody → Vladislav Belogrudov (vlad-belogrudov)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (master)

Fix proposed to branch: master
Review: https://review.openstack.org/570225

Changed in kolla-ansible:
status: New → In Progress
Revision history for this message
p.cipriano (ctpeter) wrote :

[nova]
interface = internal
auth_url = {{ keystone_admin_url }}
auth_type = password
project_domain_id = {{ default_project_domain_id }}
user_domain_id = {{ default_user_domain_id }}
region_name = {{ openstack_region_name }}
project_name = service
username = {{ nova_keystone_user }}
password = {{ nova_keystone_password }}

[database]
connection = mysql+pymysql://{{ cinder_database_user }}:{{ cinder_database_password }}@{{ cinder_database_address }}/{{ cinder_database_name }}
max_retries = -1

[keystone_authtoken]
www_authenticate_uri = {{ internal_protocol }}://{{ kolla_internal_fqdn }}:{{ keystone_public_port }}

Revision history for this message
p.cipriano (ctpeter) wrote :

Im sorry wrong post

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (master)

Reviewed: https://review.openstack.org/570225
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=8af7372c3dfa8e951c4188a6538cd174688cc849
Submitter: Zuul
Branch: master

commit 8af7372c3dfa8e951c4188a6538cd174688cc849
Author: Vladislav Belogrudov <email address hidden>
Date: Wed May 23 19:25:57 2018 +0300

    Fix Nova authentication in Cinder configuration file

    Cinder requires access to Nova during Nova assisted backups and
    snapshots. Both fail without proper Nova authentication section
    in cinder.conf file.

    Change-Id: I5d1fc3b466bf2df919e426d2052c1ee31c27030d
    Closes-Bug: #1772959

Changed in kolla-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 7.0.0.0b2

This issue was fixed in the openstack/kolla-ansible 7.0.0.0b2 development milestone.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.