EndpointNotFound: public endpoint for metering service not found

[Eric K]

On a fresh devstack* on ubuntu xenial, the following errors occur. Full congress log attached. devstack local.conf attached.

*devstack commit df09c433867a9ce204d1b14807cb5510c0bd0385
congress commit 507b81f15ed5fb50613b29273bbd941ee50c3b86
ceilometer commit 198381cd6a132d3aa8c57511f5faaf96917873aa
keystone commit 5dc7af8fb555dca02409ab1ab016eca9aec7240d

2017-01-19 17:35:56.122 111744 INFO congress.datasources.datasource_driver [-] ceilometer:: polling
2017-01-19 17:35:56.123 111744 DEBUG congress.datasources.datasource_driver [-] update table alarms. update_from_datasource /opt/stack/congress/congress/datasources/datasource_driver.py:1374
2017-01-19 17:35:56.128 111744 INFO congress.datasources.datasource_driver [-] heat:: polling
2017-01-19 17:35:56.129 111744 DEBUG congress.datasources.datasource_driver [-] update table events. update_from_datasource /opt/stack/congress/congress/datasources/datasource_driver.py:1374
2017-01-19 17:35:56.136 111744 DEBUG cinderclient.v2.client [-] RESP: [200] X-Compute-Request-Id: req-da1f6c54-befc-4014-a32f-5fd2ea28e33b Content-Type: application/json Content-Length: 443 X-Openstack-Request-Id: req-da1f6c54-befc-4014-a32f-5fd2ea28e33b Date: Fri, 20 Jan 2017 01:35:56 GMT Connection: keep-alive
RESP BODY: {"services": [{"status": "enabled", "binary": "cinder-scheduler", "zone": "nova", "state": "up", "updated_at": "2017-01-20T01:35:53.000000", "host": "ubuntu", "disabled_reason": null}, {"status": "enabled", "binary": "cinder-volume", "zone": "nova", "frozen": false, "state": "up", "updated_at": "2017-01-20T01:35:53.000000", "host": "ubuntu@lvmdriver-1", "replication_status": "disabled", "active_backend_id": null, "disabled_reason": null}]}
 _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py:395
2017-01-19 17:35:56.136 111744 DEBUG cinderclient.v2.client [-] GET call to volumev2 for http://192.168.218.184:8776/v2/b526cbf280bd461aa3dce566a5f39967/os-services used request id req-da1f6c54-befc-4014-a32f-5fd2ea28e33b request /usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py:640
2017-01-19 17:35:56.136 111744 DEBUG cinderclient.client [-] GET call to volumev2 for http://192.168.218.184:8776/v2/b526cbf280bd461aa3dce566a5f39967/os-services used request id req-da1f6c54-befc-4014-a32f-5fd2ea28e33b _log_request_id /usr/local/lib/python2.7/dist-packages/cinderclient/client.py:95
2017-01-19 17:35:56.137 111744 DEBUG congress.datasources.datasource_driver [-] update table snapshots. update_from_datasource /opt/stack/congress/congress/datasources/datasource_driver.py:1374
2017-01-19 17:35:56.138 111744 DEBUG cinderclient.v2.client [-] REQ: curl -g -i -X GET http://192.168.218.184:8776/v2/b526cbf280bd461aa3dce566a5f39967/snapshots/detail?all_tenants=1 -H "User-Agent: python-cinderclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}23115a008e9977afd01089773634b236ede92c7e" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py:347
2017-01-19 17:35:56.171 111744 DEBUG congress.datasources.ceilometer_driver [-] ALARMS: [] _translate_alarms /opt/stack/congress/congress/datasources/ceilometer_driver.py:239
2017-01-19 17:35:56.171 111744 DEBUG congress.datasources.datasource_driver [-] update table statistics. update_from_datasource /opt/stack/congress/congress/datasources/datasource_driver.py:1374
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver [-] Datasource driver raised exception
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver Traceback (most recent call last):
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/opt/stack/congress/congress/datasources/datasource_driver.py", line 1388, in poll
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver self.update_from_datasource() # sets self.state
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/opt/stack/congress/congress/datasources/datasource_driver.py", line 1375, in update_from_datasource2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver self.update_methods[registered_table]()
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/opt/stack/congress/congress/datasources/ceilometer_driver.py", line 202, in <lambda>
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver self._get_statistics(self.ceilometer_client.meters.list()))
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/ceilometerclient/v2/meters.py", line 38, in list
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver return self._list(options.build_url(path, q, params))
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/ceilometerclient/common/base.py", line 63, in _list
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver resp = self.api.get(url)
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 217, in get
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver return self.request(url, 'GET', **kwargs)
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/ceilometerclient/client.py", line 470, in request
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver **kwargs)
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 374, in request
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver resp = super(LegacyJsonAdapter, self).request(*args, **kwargs)
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 142, in request
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver return self.session.request(url, method, **kwargs)
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver return wrapped(*args, **kwargs)
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 513, in request
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver **endpoint_filter)
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 856, in get_endpoint
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver return auth.get_endpoint(self, **kwargs)
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 216, in get_endpoint
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver service_name=service_name)
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver return wrapped(*args, **kwargs)
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/access/service_catalog.py", line 228, in url_for
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver raise exceptions.EndpointNotFound(msg)
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver EndpointNotFound: public endpoint for metering service not found
2017-01-19 17:35:56.172 111744 ERROR congress.datasources.datasource_driver
2017-01-19 17:35:56.173 111744 INFO congress.datasources.datasource_driver [-] ceilometer:: finished polling

[Eric K (ekcs)]

Continues to affect Aodh driver.

http://logs.openstack.org/04/509604/2/check/gate-congress-dsvm-api-mysql-ubuntu-xenial/23ce61d/logs/screen-congress-datasources.txt.gz#_Oct_11_23_46_26_358123
ERROR congress.dse2.dse_node [-] Error loading instance of module 'congress.datasources.aodh_driver.AodhDriver': EndpointNotFound: publicURL endpoint for alarming service not found
ERROR congress.dse2.dse_node Traceback (most recent call last):
ERROR congress.dse2.dse_node File "/opt/stack/new/congress/congress/dse2/dse_node.py", line 692, in create_datasource_service
ERROR congress.dse2.dse_node service = getattr(module, class_name)(**kwargs)
ERROR congress.dse2.dse_node File "/opt/stack/new/congress/congress/datasources/aodh_driver.py", line 78, in __init__
ERROR congress.dse2.dse_node interface='publicURL')
ERROR congress.dse2.dse_node File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 942, in get_endpoint
ERROR congress.dse2.dse_node return auth.get_endpoint(self, **kwargs)
ERROR congress.dse2.dse_node File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 380, in get_endpoint
ERROR congress.dse2.dse_node allow_version_hack=allow_version_hack, **kwargs)
ERROR congress.dse2.dse_node File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 279, in get_endpoint_data
ERROR congress.dse2.dse_node service_name=service_name)
ERROR congress.dse2.dse_node File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/access/service_catalog.py", line 400, in endpoint_data_for
ERROR congress.dse2.dse_node raise exceptions.EndpointNotFound(msg)
ERROR congress.dse2.dse_node EndpointNotFound: publicURL endpoint for alarming service not found