Beaker tests failing due to keystone config changes

Bug #1746389 reported by Tony Breeds
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
puppet-ironic
Fix Released
Undecided
Tony Breeds

Bug Description

Since approximately Jan 20th the puppet-ironic gate has been blocked with the following[1]:

---
Jan 30 09:04:39 centos-7-ovh-gra1-0002261339 ironic-inspector[4773]: 2018-01-30 09:04:39.575 4773 WARNING keystoneauth.identity.generic.base [-] Failed to discover available identity versions when contacting https://centos-7-ovh-gra1-0002261339:5000/v2.0. Attempting to parse version from URL.: ConnectFailure: Unable to establish connection to https://centos-7-ovh-gra1-0002261339:5000/v2.0: HTTPSConnectionPool(host='centos-7-ovh-gra1-0002261339', port=5000): Max retries exceeded with url: /v2.0 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x59b53d0>: Failed to establish a new connection: [Errno 111] ECONNREFUSED',))
Jan 30 09:04:39 centos-7-ovh-gra1-0002261339 ironic-inspector[4773]: 2018-01-30 09:04:39.576 4773 CRITICAL ironic_inspector [-] Unhandled error: DiscoveryFailure: Cannot use v2 authentication with domain scope
Jan 30 09:04:39 <SNIP> Traceback (most recent call last):
Jan 30 09:04:39 <SNIP> File "/usr/bin/ironic-inspector", line 10, in <module>
Jan 30 09:04:39 <SNIP> sys.exit(main())
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/ironic_inspector/cmd/all.py", line 26, in main
Jan 30 09:04:39 <SNIP> server.run()
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/ironic_inspector/wsgi_service.py", line 183, in run
Jan 30 09:04:39 <SNIP> self._init_host()
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/ironic_inspector/wsgi_service.py", line 125, in _init_host
Jan 30 09:04:39 <SNIP> callables=[(driver.get_periodic_sync_task(), None, None),
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/ironic_inspector/pxe_filter/base.py", line 191, in get_periodic_sync_task
Jan 30 09:04:39 <SNIP> ironic = ir_utils.get_client()
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/ironic_inspector/common/ironic.py", line 119, in get_client
Jan 30 09:04:39 <SNIP> endpoint = adapter.get_endpoint()
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 223, in get_endpoint
Jan 30 09:04:39 <SNIP> return self.session.get_endpoint(auth or self.auth, **kwargs)
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 942, in get_endpoint
Jan 30 09:04:39 <SNIP> return auth.get_endpoint(self, **kwargs)
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 379, in get_endpoint
Jan 30 09:04:39 <SNIP> allow_version_hack=allow_version_hack, **kwargs)
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 270, in get_endpoint_data
Jan 30 09:04:39 <SNIP> service_catalog = self.get_access(session).service_catalog
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 134, in get_access
Jan 30 09:04:39 <SNIP> self.auth_ref = self.get_auth_ref(session)
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/generic/base.py", line 196, in get_auth_ref
Jan 30 09:04:39 <SNIP> self._plugin = self._do_create_plugin(session)
Jan 30 09:04:39 <SNIP> File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/generic/base.py", line 149, in _do_create_plugin
Jan 30 09:04:39 <SNIP> 'Cannot use v2 authentication with domain scope')
Jan 30 09:04:39 <SNIP> DiscoveryFailure: Cannot use v2 authentication with domain scope
Jan 30 09:04:39 <SNIP>
Jan 30 09:04:39 centos-7-ovh-gra1-0002261339 systemd[1]: openstack-ironic-inspector.service: main process exited, code=exited, status=1/FAILURE
---

We seem to be trying to talk to keystone (v2) on the external IP of the box rather then (v3) on localhost.

[1] http://logs.openstack.org/22/535622/7/check/puppet-openstack-beaker-centos-7/d04885d/logs/syslog.txt.gz#_Jan_30_09_04_39

Changed in puppet-ironic:
assignee: nobody → Tony Breeds (o-tony)
status: New → In Progress
Tony Breeds (o-tony)
Changed in puppet-ironic:
status: In Progress → New
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to puppet-ironic (master)

Reviewed: https://review.openstack.org/538721
Committed: https://git.openstack.org/cgit/openstack/puppet-ironic/commit/?id=93b8afe76e0d3ae1a34b881b0b429ab6e338fde0
Submitter: Zuul
Branch: master

commit 93b8afe76e0d3ae1a34b881b0b429ab6e338fde0
Author: Tony Breeds <email address hidden>
Date: Mon Jan 29 13:51:21 2018 +1100

    Update keystone Auth_url

    Update the ironic-inspector auth?_url to be http (not https) on
    localhost (not the fddn) and v3 (not v2.0)

    Closes-Bug: 1746389
    Change-Id: I65c6b54ad3fc815711ffa2e1eadb6d81fa9b8420
    Depends-On: Ia363e7eca12157e0b15b29b4d517c75e07d596de

Changed in puppet-ironic:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/puppet-ironic 12.3.0

This issue was fixed in the openstack/puppet-ironic 12.3.0 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.