tripleo

CI failing with nova/neutron NotFound error

Bug #1543493 reported by Steven Hardy
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
tripleo
Expired
Undecided
Unassigned

Bug Description

2016-02-09 01:52:13.115 | <class 'keystoneauth1.exceptions.http.NotFound'> (HTTP 500) (Request-ID: req-5a85078e-feab-4807-8e2
2016-02-09 01:52:13.115 | 2016-02-09 01:51:51 [UserData]: CREATE_IN_PROGRESS state changed
2016-02-09 01:52:13.115 | 2016-02-09 01:51:51 [NodeUserData]: CREATE_IN_PROGRESS state changed
2016-02-09 01:52:13.115 | 2016-02-09 01:51:51 [NodeAdminUserData]: CREATE_COMPLETE state changed
2016-02-09 01:52:13.115 | 2016-02-09 01:51:52 [overcloud-Controller-t443fhatejiy-1-6fmbjzo5zivh]: CREATE_FAILED Resource CREATE failed: ClientException: resources.Controller: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.

2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 154, in get_client
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions auth_token = _ADMIN_AUTH.get_token(_SESSION)
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 211, in get_token
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions return self.get_access(session).auth_token
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 257, in get_access
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions self.auth_ref = self.get_auth_ref(session)
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/v3/base.py", line 190, in get_auth_ref
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions authenticated=False, log=False, **rkwargs)
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 505, in post
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions return self.request(url, 'POST', **kwargs)
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 94, in inner
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 405, in request
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions raise exceptions.from_response(resp, method, url)
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions NotFound: The resource could not be found. (HTTP 404) (Request-ID: req-d9f26f10-09eb-476c-bcec-b4f48bc1e7cf)
2016-02-09 01:51:56.285 18365 ERROR nova.api.openstack.extensions·

Possibly related to https://github.com/openstack/puppet-nova/commit/d09868a59c451932d67c66101b725182d7066a14

Going to try a pin to test

Revision history for this message
David Hill (david-hill-ubisoft) wrote :
Download full text (5.4 KiB)

Seems like this is the main error:

2016-02-18 18:32:34.471 28733 WARNING keystonemiddleware.auth_token [-] Authorization failed for token
2016-02-18 18:32:34.473 28733 WARNING keystonemiddleware.auth_token [-] Identity response: {"error": {"message": "Could not find token: 9a7c7818af8c41f3a2a778fdc175e25b", "code": 404, "title": "Not Found"}}
2016-02-18 18:32:34.476 28733 WARNING keystonemiddleware.auth_token [-] Authorization failed for token

And the token is obviously present in the database:

MariaDB [keystone]> select * from token where id like '9a7c7818af8c41f3a2a778fdc175e25b'\G
*************************** 1. row ***************************
      id: 9a7c7818af8c41f3a2a778fdc175e25b
 expires: 2016-02-18 23:32:33
   extra: {"bind": null, "token_data": {"access": {"token": {"issued_at": "2016-02-18T22:32:33.467858", "expires": "2016-02-18T23:32:33Z", "id": "9a7c7818af8c41f3a2a778fdc175e25b", "tenant": {"id": "acceac23bcf1424fa8da4282d1cec50f", "enabled": true, "description": null, "name": "service"}, "audit_ids": ["bVlXAqT3SaK1d4b6U6Aa5A"]}, "serviceCatalog": [{"endpoints": [{"adminURL": "http://172.17.0.11:8774/v2/acceac23bcf1424fa8da4282d1cec50f", "region": "regionOne", "id": "523d2327892140a99e717ce67a057983", "internalURL": "http://172.17.0.11:8774/v2/acceac23bcf1424fa8da4282d1cec50f", "publicURL": "http://192.168.122.130:8774/v2/acceac23bcf1424fa8da4282d1cec50f"}], "endpoints_links": [], "type": "compute", "name": "nova"}, {"endpoints": [{"adminURL": "http://172.17.0.11:9696/", "region": "regionOne", "id": "3eee04bfa82a4e4da1690ef9bc2049f0", "internalURL": "http://172.17.0.11:9696/", "publicURL": "http://192.168.122.130:9696/"}], "endpoints_links": [], "type": "network", "name": "neutron"}, {"endpoints": [{"adminURL": "http://172.17.0.11:8776/v2/acceac23bcf1424fa8da4282d1cec50f", "region": "regionOne", "id": "7b1c023f711e4a8c98c3f1bb7858a0d6", "internalURL": "http://172.17.0.11:8776/v2/acceac23bcf1424fa8da4282d1cec50f", "publicURL": "http://192.168.122.130:8776/v2/acceac23bcf1424fa8da4282d1cec50f"}], "endpoints_links": [], "type": "volumev2", "name": "cinderv2"}, {"endpoints": [{"adminURL": "http://172.17.0.11:8774/v3", "region": "regionOne", "id": "000b3951b1474f9e90fc7356e79c9724", "internalURL": "http://172.17.0.11:8774/v3", "publicURL": "http://192.168.122.130:8774/v3"}], "endpoints_links": [], "type": "computev3", "name": "nova"}, {"endpoints": [{"adminURL": "http://172.18.0.10:9292/", "region": "regionOne", "id": "0708c5c416e6408880dc270bc66200a6", "internalURL": "http://172.18.0.10:9292/", "publicURL": "http://192.168.122.130:9292/"}], "endpoints_links": [], "type": "image", "name": "glance"}, {"endpoints": [{"adminURL": "http://172.17.0.11:8777/", "region": "regionOne", "id": "6159ace7543d4b9cbaed6f38476c8a44", "internalURL": "http://172.17.0.11:8777/", "publicURL": "http://192.168.122.130:8777/"}], "endpoints_links": [], "type": "metering", "name": "ceilometer"}, {"endpoints": [{"adminURL": "http://172.17.0.11:8776/v1/acceac23bcf1424fa8da4282d1cec50f", "region": "regionOne", "id": "1641117070e14b87b9a1b3d905426dd9", "internalURL": "http://172.17.0.11:8776/v1/acceac23bcf1424fa8da4282d1cec50f", "publicURL": "http://192.168.1...

Read more...

Revision history for this message
Emilien Macchi (emilienm) wrote :

This bug is > 365 days without activity. We are unsetting assignee and milestone and setting status to Incomplete in order to allow its expiry in 60 days.

If the bug is still valid, then update the bug status.

Changed in tripleo:
status: New → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for tripleo because there has been no activity for 60 days.]

Changed in tripleo:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.