congress

401 error on update from datasource (on postgres devstack)

Bug #1655777 reported by Eric K on 2017-01-11

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	congress	Fix Released	High	Eric K	congress ocata-3

Bug Description

Produced on fresh devstack (commit 1ba23d6ac6cb3dae3de67674f510f03077976ee9) and congress (commit fa1bacdf4e2ca79676e8c749c509d19317e90fa0), with the the attached local.conf.

Selected log error trace reproduced below. Full log to be attached.

Nova:
2017-01-11 13:49:14.081 INFO congress.datasources.datasource_driver [-] nova:: polling
2017-01-11 13:49:14.082 DEBUG congress.datasources.datasource_driver [-] update table flavors
. from (pid=122204) update_from_datasource /opt/stack/congress/congress/datasources/datasourc
e_driver.py:1374
2017-01-11 13:49:14.093 ERROR congress.datasources.datasource_driver [-] Datasource driver raised exception
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver Traceback (most recent call last):
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/opt/stack/congress/congress/datasources/datasource_driver.py", line 1388, in poll
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver self.update_from_datasource() # sets self.state
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/opt/stack/congress/congress/datasources/datasource_driver.py", line 1375, in update_from_datasource
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver self.update_methods[registered_table]()
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/opt/stack/congress/congress/datasources/nova_driver.py", line 207, in <lambda>
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver self.nova_client.flavors.list())
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/novaclient/v2/flavors.py", line 132, in list
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver return self._list("/flavors%s%s" % (detail, query_string), "flavors")
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/novaclient/base.py", line 249, in _list
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver resp, body = self.api.client.get(url)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 217, in get
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver return self.request(url, 'GET', **kwargs)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 107, in request
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver **kwargs)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 374, in request
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver resp = super(LegacyJsonAdapter, self).request(*args, **kwargs)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 142, in request
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver return self.session.request(url, method, **kwargs)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver return wrapped(*args, **kwargs)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 484, in request
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver auth_headers = self.get_auth_headers(auth)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 787, in get_auth_headers
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver return auth.get_headers(self, **kwargs)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/plugin.py", line 90, in get_headers
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver token = self.get_token(session)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 90, in get_token
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver return self.get_access(session).auth_token
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 136, in get_access
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver self.auth_ref = self.get_auth_ref(session)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/v3/base.py", line 167, in get_auth_ref
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver authenticated=False, log=False, **rkwargs)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 735, in post
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver return self.request(url, 'POST', **kwargs)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver return wrapped(*args, **kwargs)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 624, in request
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver raise exceptions.from_response(resp, method, url)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-25d1f9c1-5cc6-4f78-b160-8fa257580eed)
2017-01-11 13:49:14.093 TRACE congress.datasources.datasource_driver
2017-01-11 13:49:14.095 INFO congress.datasources.datasource_driver [-] nova:: finished polling

Cinder:
2017-01-11 13:48:39.268 ERROR congress.datasources.datasource_driver [-] Datasource driver ra
ised exception
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver Traceback (most recent c
all last):
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/opt/stack/congr
ess/congress/datasources/datasource_driver.py", line 1388, in poll
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver self.update_from_dat
asource() # sets self.state
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/opt/stack/congr
ess/congress/datasources/datasource_driver.py", line 1375, in update_from_datasource
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver self.update_methods[
registered_table]()
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/opt/stack/congr
ess/congress/datasources/cinder_driver.py", line 113, in <lambda>
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver self.cinder_client.s
ervices.list(host=None, binary=None))
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/cinderclient/v3/services.py", line 47, in list
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver return self._list(url, "services")
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/cinderclient/base.py", line 83, in _list
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver resp, body = self.api.client.get(url)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/cinderclient/client.py", line 143, in get
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver return self._cs_request(url, 'GET', **kwargs)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/cinderclient/client.py", line 134, in _cs_request
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver return self.request(url, method, **kwargs)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/cinderclient/client.py", line 116, in request
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver **kwargs)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 374, in request
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver resp = super(LegacyJsonAdapter, self).request(*args, **kwargs)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 142, in request
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver return self.session.request(url, method, **kwargs)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver return wrapped(*args, **kwargs)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 484, in request
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver auth_headers = self.get_auth_headers(auth)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 787, in get_auth_headers
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver return auth.get_headers(self, **kwargs)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/plugin.py", line 90, in get_headers
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver token = self.get_token(session)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 90, in get_token
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver return self.get_access(session).auth_token
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 136, in get_access
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver self.auth_ref = self.get_auth_ref(session)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/v3/base.py", line 167, in get_auth_ref
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver authenticated=False, log=False, **rkwargs)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 735, in post
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver return self.request(url, 'POST', **kwargs)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver return wrapped(*args, **kwargs)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 624, in request
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver raise exceptions.from_response(resp, method, url)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-bd593a96-1ed6-4423-b9c4-6c6c8a4ed237)
2017-01-11 13:48:39.268 TRACE congress.datasources.datasource_driver
2017-01-11 13:48:39.269 INFO congress.datasources.datasource_driver [-] cinder:: finished polling

Tags:

Revision history for this message

Eric K (ekcs) wrote on 2017-01-11:

local.conf Edit (444 bytes, text/plain)

Revision history for this message

Eric K (ekcs) wrote on 2017-01-11:

congress.log Edit (6.9 MiB, text/plain)

Revision history for this message

Eric K (ekcs) wrote on 2017-01-12:

Discussions of potential root cause:
https://bugs.launchpad.net/murano/+bug/1580611
https://ask.openstack.org/en/question/67398/error-openstack-the-request-you-have-made-requires-authentication-http-401/?answer=99528#post-id-99528

Eric K (ekcs) on 2017-01-12

Changed in congress:
assignee:	nobody → Eric K (ekcs)

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-01-12: Fix proposed to congress (master)

Fix proposed to branch: master
Review: https://review.openstack.org/419677

Changed in congress:
status:	New → In Progress

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-01-17: Fix merged to congress (master)

Reviewed: https://review.openstack.org/419677
Committed: https://git.openstack.org/cgit/openstack/congress/commit/?id=681ad6fb7d0d731a1aa90c7dad15f037d8042c6d
Submitter: Jenkins
Branch: master

commit 681ad6fb7d0d731a1aa90c7dad15f037d8042c6d
Author: Eric K <email address hidden>
Date: Thu Jan 12 14:38:51 2017 -0800

Correct default to Default in auth params

    Change-Id: I7d1e466c557ad60fd9c1d591f7615b658a996ff0
    Closes-Bug: 1655777
    Closes-Bug: 1655772

Changed in congress:
status:	In Progress → Fix Released

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-01-27: Fix included in openstack/congress 5.0.0.0b3

This issue was fixed in the openstack/congress 5.0.0.0b3 development milestone.

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-02-20: Fix proposed to congress (stable/newton)

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/436188

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-02-21: Fix merged to congress (stable/newton)

Reviewed: https://review.openstack.org/436188
Committed: https://git.openstack.org/cgit/openstack/congress/commit/?id=c9c5dd37e3f01a84574aa424cef39d3500734bf6
Submitter: Jenkins
Branch: stable/newton

commit c9c5dd37e3f01a84574aa424cef39d3500734bf6
Author: Eric K <email address hidden>
Date: Thu Jan 12 14:38:51 2017 -0800

Correct default to Default in auth params

    Change-Id: I7d1e466c557ad60fd9c1d591f7615b658a996ff0
    Closes-Bug: 1655777
    Closes-Bug: 1655772
    (cherry picked from commit 681ad6fb7d0d731a1aa90c7dad15f037d8042c6d)