Keystone failures in Okata due to insufficient number of fernet keys

Bug #1655253 reported by Stanislaw Bogatkin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Invalid
Critical
Vladimir Kuklin
Nominated for Ocata by Stanislaw Bogatkin
Mitaka
Invalid
Undecided
Unassigned
Newton
Invalid
Undecided
Unassigned

Bug Description

11.0 (current master) is broken due to

2017-01-10 01:27:32 DEBUG (v2) Making authentication request to https://10.109.13.4:5000/v2.0/tokens
2017-01-10 01:27:32 DEBUG (session) Request returned failure status: 401
2017-01-10 01:27:32 ERROR (test_mixins) The request you have made requires authentication. (HTTP 401) (Request-ID: req-41ef355a-1e04-4912-b9bd-fe9fbc0c7b03)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/fuel_health/common/test_mixins.py", line 174, in verify
    result = func(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/fuel_health/tests/sanity/test_sanity_infrastructure.py", line 63, in get_controllers_down_states
    svc = self._list_services(self.compute_client, host=controller)
  File "/usr/lib/python2.7/site-packages/fuel_health/nmanager.py", line 1266, in _list_services
    services = client.services.list(host=host, binary=binary)
  File "/usr/lib/python2.7/site-packages/novaclient/v2/services.py", line 52, in list
    return self._list(url, "services")
  File "/usr/lib/python2.7/site-packages/novaclient/base.py", line 254, in _list
    resp, body = self.api.client.get(url)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 217, in get
    return self.request(url, 'GET', **kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 77, in request
    **kwargs)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 374, in request
    resp = super(LegacyJsonAdapter, self).request(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 142, in request
    return self.session.request(url, method, **kwargs)
  File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 101, in inner
    return wrapped(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 467, in request
    auth_headers = self.get_auth_headers(auth)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 770, in get_auth_headers
    return auth.get_headers(self, **kwargs)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/plugin.py", line 90, in get_headers
    token = self.get_token(session)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 90, in get_token
    return self.get_access(session).auth_token
  File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 136, in get_access
    self.auth_ref = self.get_auth_ref(session)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/generic/base.py", line 198, in get_auth_ref
    return self._plugin.get_auth_ref(session, **kwargs)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/v2.py", line 65, in get_auth_ref
    authenticated=False, log=False)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 718, in post
    return self.request(url, 'POST', **kwargs)
  File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 101, in inner
    return wrapped(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 607, in request
    raise exceptions.from_response(resp, method, url)
Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-41ef355a-1e04-4912-b9bd-fe9fbc0c7b03)
2017-01-10 01:27:32 ERROR (nose_storage_plugin) fuel_health.tests.sanity.test_sanity_infrastructure.SanityInfrastructureTest.test_001_services_state
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 67, in testPartExecutor
    yield
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 601, in run
    testMethod()
  File "/usr/lib/python2.7/site-packages/fuel_health/tests/sanity/test_sanity_infrastructure.py", line 75, in test_001_services_state
    "'nova service-list' command execution",
  File "/usr/lib/python2.7/site-packages/fuel_health/common/test_mixins.py", line 180, in verify
    " Please refer to OpenStack logs for more details.")
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 666, in fail
    raise self.failureException(msg)
AssertionError: Step 1 failed: 'nova service-list' command execution failed. Please refer to OpenStack logs for more details.

Example jenkins job: https://product-ci.infra.mirantis.net/view/11.0/job/11.0.main.ubuntu.smoke_neutron/161/

summary: - AssertionError: Step 1 failed: 'nova service-list' command execution
- failed at master OSTF tests
+ Keystone failures in Okata due to insufficient number of fernet keys
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/418239

Changed in fuel:
assignee: Fuel Sustaining (fuel-sustaining-team) → Vladimir Kuklin (vkuklin)
status: New → In Progress
Changed in fuel:
status: In Progress → Invalid
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-library (master)

Change abandoned by Vladimir Kuklin (<email address hidden>) on branch: master
Review: https://review.openstack.org/418239

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.