I confirm that behavior. In first try stack is not deleted due to:
2015-01-21 11:52:25.153 23101 DEBUG heat.engine.stack [-] Context user_id doesn't match trustor, using stored context _delete_credentials /usr/lib/python2.7/site-packages/heat/engine/stack.py:904 2015-01-21 11:52:25.158 23101 DEBUG keystoneclient.auth.identity.v3 [req-e37aec2d-9ceb-47de-bb7a-7f4e91224758 ] Making authentication request to http://10.20.71.252:5000/v3/auth/tokens get_auth_ref /usr/lib/python2.7/site-packages/keystoneclient/auth/identity/v3.py:117 2015-01-21 11:52:25.178 23101 DEBUG keystoneclient.session [req-e37aec2d-9ceb-47de-bb7a-7f4e91224758 ] Request returned failure status: 401 request /usr/lib/python2.7/site-packages/keystoneclient/session.py:353 2015-01-21 11:52:25.179 23101 DEBUG keystoneclient.v3.client [req-e37aec2d-9ceb-47de-bb7a-7f4e91224758 ] Authorization failed. get_raw_token_from_identity_service /usr/lib/python2.7/site-packages/keystoneclient/v3/client.py:268 2015-01-21 11:52:25.179 23101 ERROR heat.common.keystoneclient [req-e37aec2d-9ceb-47de-bb7a-7f4e91224758 None] Keystone client authentication failed 2015-01-21 11:52:25.180 23101 ERROR heat.engine.stack [req-e37aec2d-9ceb-47de-bb7a-7f4e91224758 None] Authorization failed.
However it deletes projects: 2015-01-21 11:52:25.233 23101 DEBUG keystoneclient.session [req-e37aec2d-9ceb-47de-bb7a-7f4e91224758 ] REQ: curl -i -X DELETE http://10.20.71.252:5000/v3/projects/575ca8909fa04ddd863fc5e3603ea5f2 -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: {SHA1}dda52cd0e0b79ce391720850ec07e93ea82ad321" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:162 2015-01-21 11:52:25.280 23101 DEBUG keystoneclient.session [req-e37aec2d-9ceb-47de-bb7a-7f4e91224758 ] RESP: [204] date: Wed, 21 Jan 2015 10:51:12 GMT content-length: 0 vary: X-Auth-Token _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:190
And just after this:
2015-01-21 11:52:25.281 23101 DEBUG keystoneclient.httpclient [req-e37aec2d-9ceb-47de-bb7a-7f4e91224758 ] No body was returned. _decode_body /usr/lib/python2.7/site-packages/keystoneclient/httpclient.py:578 2015-01-21 11:52:25.285 23101 INFO heat.engine.stack [req-e37aec2d-9ceb-47de-bb7a-7f4e91224758 None] Stack DELETE FAILED (ubuntu_14b0bd88d0f): Error deleting trust: Authorization failed. 2015-01-21 11:52:25.291 23101 DEBUG heat.engine.stack_lock [req-e37aec2d-9ceb-47de-bb7a-7f4e91224758 None] Engine fc9cd09a-1d12-4f23-8deb-134d12e3e4b9 released lock on stack 454d3449-0a9d-4caf-a9ea-044d039f44b8 release /usr/lib/python2.7/site-packages/heat/engine/stack_lock.py:123
So I try to delete again and:
2015-01-21 12:01:40.241 23101 DEBUG keystoneclient.auth.identity.v3 [-] Making authentication request to http://10.20.71.252:5000/v3/auth/tokens get_auth_ref /usr/lib/python2.7/site-packages/keystoneclient/auth/identity/v3.py:117 2015-01-21 12:01:40.370 23101 DEBUG keystoneclient.session [-] REQ: curl -i -X GET http://10.20.71.252:5000/v3/projects/575ca8909fa04ddd863fc5e3603ea5f2 -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: {SHA1}ee2dce50712deea0bb573cdd996d7a225eafdd96" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:162 2015-01-21 12:01:40.391 23101 DEBUG keystoneclient.session [-] RESP: _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:190 2015-01-21 12:01:40.391 23101 DEBUG keystoneclient.session [-] Request returned failure status: 404 request /usr/lib/python2.7/site-packages/keystoneclient/session.py:353 2015-01-21 12:01:40.392 23101 ERROR heat.engine.stack [-] Could not find project: 575ca8909fa04ddd863fc5e3603ea5f2 (HTTP 404) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack Traceback (most recent call last): 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/heat/engine/stack.py", line 938, in _delete_credentials 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack project_id=self.stack_user_project_id) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/heat/common/heat_keystoneclient.py", line 531, in delete_stack_domain_project 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack project = self.domain_admin_client.projects.get(project=project_id) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/keystoneclient/v3/projects.py", line 84, in get 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack project_id=base.getid(project)) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/keystoneclient/base.py", line 72, in func 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack return f(*args, **new_kwargs) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/keystoneclient/base.py", line 334, in get 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack self.key) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/keystoneclient/base.py", line 136, in _get 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack resp, body = self.client.get(url, **kwargs) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/keystoneclient/httpclient.py", line 629, in get 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack return self._cs_request(url, 'GET', **kwargs) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/keystoneclient/httpclient.py", line 621, in _cs_request 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack return self.request(url, method, **kwargs) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/keystoneclient/httpclient.py", line 596, in request 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack resp = super(HTTPClient, self).request(url, method, **kwargs) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/keystoneclient/baseclient.py", line 21, in request 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack return self.session.request(url, method, **kwargs) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 318, in inner 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack return func(*args, **kwargs) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 354, in request 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack raise exceptions.from_response(resp, method, url) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack NotFound: Could not find project: 575ca8909fa04ddd863fc5e3603ea5f2 (HTTP 404) 2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack 2015-01-21 12:01:40.403 23101 INFO heat.engine.stack [-] Stack DELETE FAILED (ubuntu_14b0bd88d0f): Error deleting project: Could not find project: 575ca8909fa04ddd863fc5e3603ea5f2 (HTTP 404)
I confirm that behavior.
In first try stack is not deleted due to:
2015-01-21 11:52:25.153 23101 DEBUG heat.engine.stack [-] Context user_id doesn't match trustor, using stored context _delete_credentials /usr/lib/ python2. 7/site- packages/ heat/engine/ stack.py: 904 auth.identity. v3 [req-e37aec2d- 9ceb-47de- bb7a-7f4e912247 58 ] Making authentication request to http:// 10.20.71. 252:5000/ v3/auth/ tokens get_auth_ref /usr/lib/ python2. 7/site- packages/ keystoneclient/ auth/identity/ v3.py:117 session [req-e37aec2d- 9ceb-47de- bb7a-7f4e912247 58 ] Request returned failure status: 401 request /usr/lib/ python2. 7/site- packages/ keystoneclient/ session. py:353 v3.client [req-e37aec2d- 9ceb-47de- bb7a-7f4e912247 58 ] Authorization failed. get_raw_ token_from_ identity_ service /usr/lib/ python2. 7/site- packages/ keystoneclient/ v3/client. py:268 keystoneclient [req-e37aec2d- 9ceb-47de- bb7a-7f4e912247 58 None] Keystone client authentication failed 9ceb-47de- bb7a-7f4e912247 58 None] Authorization failed.
2015-01-21 11:52:25.158 23101 DEBUG keystoneclient.
2015-01-21 11:52:25.178 23101 DEBUG keystoneclient.
2015-01-21 11:52:25.179 23101 DEBUG keystoneclient.
2015-01-21 11:52:25.179 23101 ERROR heat.common.
2015-01-21 11:52:25.180 23101 ERROR heat.engine.stack [req-e37aec2d-
However it deletes projects: session [req-e37aec2d- 9ceb-47de- bb7a-7f4e912247 58 ] REQ: curl -i -X DELETE http:// 10.20.71. 252:5000/ v3/projects/ 575ca8909fa04dd d863fc5e3603ea5 f2 -H "User-Agent: python- keystoneclient" -H "X-Auth-Token: {SHA1}dda52cd0e 0b79ce391720850 ec07e93ea82ad32 1" _http_log_request /usr/lib/ python2. 7/site- packages/ keystoneclient/ session. py:162 session [req-e37aec2d- 9ceb-47de- bb7a-7f4e912247 58 ] RESP: [204] date: Wed, 21 Jan 2015 10:51:12 GMT content-length: 0 vary: X-Auth-Token _http_log_response /usr/lib/ python2. 7/site- packages/ keystoneclient/ session. py:190
2015-01-21 11:52:25.233 23101 DEBUG keystoneclient.
2015-01-21 11:52:25.280 23101 DEBUG keystoneclient.
And just after this:
2015-01-21 11:52:25.281 23101 DEBUG keystoneclient. httpclient [req-e37aec2d- 9ceb-47de- bb7a-7f4e912247 58 ] No body was returned. _decode_body /usr/lib/ python2. 7/site- packages/ keystoneclient/ httpclient. py:578 9ceb-47de- bb7a-7f4e912247 58 None] Stack DELETE FAILED (ubuntu_ 14b0bd88d0f) : Error deleting trust: Authorization failed. stack_lock [req-e37aec2d- 9ceb-47de- bb7a-7f4e912247 58 None] Engine fc9cd09a- 1d12-4f23- 8deb-134d12e3e4 b9 released lock on stack 454d3449- 0a9d-4caf- a9ea-044d039f44 b8 release /usr/lib/ python2. 7/site- packages/ heat/engine/ stack_lock. py:123
2015-01-21 11:52:25.285 23101 INFO heat.engine.stack [req-e37aec2d-
2015-01-21 11:52:25.291 23101 DEBUG heat.engine.
So I try to delete again and:
2015-01-21 12:01:40.241 23101 DEBUG keystoneclient. auth.identity. v3 [-] Making authentication request to http:// 10.20.71. 252:5000/ v3/auth/ tokens get_auth_ref /usr/lib/ python2. 7/site- packages/ keystoneclient/ auth/identity/ v3.py:117 session [-] REQ: curl -i -X GET http:// 10.20.71. 252:5000/ v3/projects/ 575ca8909fa04dd d863fc5e3603ea5 f2 -H "User-Agent: python- keystoneclient" -H "X-Auth-Token: {SHA1}ee2dce507 12deea0bb573cdd 996d7a225eafdd9 6" _http_log_request /usr/lib/ python2. 7/site- packages/ keystoneclient/ session. py:162 session [-] RESP: _http_log_response /usr/lib/ python2. 7/site- packages/ keystoneclient/ session. py:190 session [-] Request returned failure status: 404 request /usr/lib/ python2. 7/site- packages/ keystoneclient/ session. py:353 d863fc5e3603ea5 f2 (HTTP 404) python2. 7/site- packages/ heat/engine/ stack.py" , line 938, in _delete_credentials id=self. stack_user_ project_ id) python2. 7/site- packages/ heat/common/ heat_keystonecl ient.py" , line 531, in delete_ stack_domain_ project admin_client. projects. get(project= project_ id) python2. 7/site- packages/ keystoneclient/ v3/projects. py", line 84, in get id=base. getid(project) ) python2. 7/site- packages/ keystoneclient/ base.py" , line 72, in func python2. 7/site- packages/ keystoneclient/ base.py" , line 334, in get python2. 7/site- packages/ keystoneclient/ base.py" , line 136, in _get get(url, **kwargs) python2. 7/site- packages/ keystoneclient/ httpclient. py", line 629, in get request( url, 'GET', **kwargs) python2. 7/site- packages/ keystoneclient/ httpclient. py", line 621, in _cs_request python2. 7/site- packages/ keystoneclient/ httpclient. py", line 596, in request python2. 7/site- packages/ keystoneclient/ baseclient. py", line 21, in request request( url, method, **kwargs) python2. 7/site- packages/ keystoneclient/ utils.py" , line 318, in inner python2. 7/site- packages/ keystoneclient/ session. py", line 354, in request from_response( resp, method, url) d863fc5e3603ea5 f2 (HTTP 404) 14b0bd88d0f) : Error deleting project: Could not find project: 575ca8909fa04dd d863fc5e3603ea5 f2 (HTTP 404)
2015-01-21 12:01:40.370 23101 DEBUG keystoneclient.
2015-01-21 12:01:40.391 23101 DEBUG keystoneclient.
2015-01-21 12:01:40.391 23101 DEBUG keystoneclient.
2015-01-21 12:01:40.392 23101 ERROR heat.engine.stack [-] Could not find project: 575ca8909fa04dd
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack Traceback (most recent call last):
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack project_
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack project = self.domain_
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack project_
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack return f(*args, **new_kwargs)
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack self.key)
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack resp, body = self.client.
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack return self._cs_
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack return self.request(url, method, **kwargs)
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack resp = super(HTTPClient, self).request(url, method, **kwargs)
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack return self.session.
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack return func(*args, **kwargs)
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack File "/usr/lib/
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack raise exceptions.
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack NotFound: Could not find project: 575ca8909fa04dd
2015-01-21 12:01:40.392 23101 TRACE heat.engine.stack
2015-01-21 12:01:40.403 23101 INFO heat.engine.stack [-] Stack DELETE FAILED (ubuntu_