Failure in gate job :
http://logs.openstack.org/38/107438/2/check/check-tempest-dsvm-postgres-full/3ea4f12/console.html
console log shows this:
2014-07-18 14:28:27.539 |
2014-07-18 14:28:27.539 | tempest.api.orchestration.stacks.test_non_empty_stack.StacksTestJSON.test_suspend_resume_stack[gate]
2014-07-18 14:28:27.539 | ----------------------------------------------------------------------------------------------------
2014-07-18 14:28:27.540 |
2014-07-18 14:28:27.540 | Captured traceback:
2014-07-18 14:28:27.540 | ~~~~~~~~~~~~~~~~~~~
2014-07-18 14:28:27.541 | Traceback (most recent call last):
2014-07-18 14:28:27.541 | File "tempest/api/orchestration/stacks/test_non_empty_stack.py", line 89, in test_suspend_resume_stack
2014-07-18 14:28:27.541 | resp, resume_stack = self.client.resume_stack(self.stack_identifier)
2014-07-18 14:28:27.542 | File "tempest/services/orchestration/json/orchestration_client.py", line 123, in resume_stack
2014-07-18 14:28:27.542 | resp, body = self.post(url, json.dumps(body))
2014-07-18 14:28:27.542 | File "tempest/common/rest_client.py", line 218, in post
2014-07-18 14:28:27.542 | return self.request('POST', url, extra_headers, headers, body)
2014-07-18 14:28:27.543 | File "tempest/common/rest_client.py", line 430, in request
2014-07-18 14:28:27.543 | resp, resp_body)
2014-07-18 14:28:27.543 | File "tempest/common/rest_client.py", line 484, in _error_checker
2014-07-18 14:28:27.544 | raise exceptions.Conflict(resp_body)
2014-07-18 14:28:27.544 | Conflict: An object with that identifier already exists
2014-07-18 14:28:27.551 | Details: {u'title': u'Conflict', u'explanation': u'There was a conflict when trying to complete your request.', u'code': 409, u'error': {u'message': u'Stack heat-1398706498 already has an action (SUSPEND) in progress.', u'traceback': u'Traceback (most recent call last):\n\n File "/opt/stack/new/heat/heat/engine/service.py", line 63, in wrapped\n return func(self, ctx, *args, **kwargs)\n\n File "/opt/stack/new/heat/heat/engine/service.py", line 1036, in stack_resume\n _stack_resume, stack)\n\n File "/opt/stack/new/heat/heat/engine/service.py", line 113, in start_with_lock\n with lock.thread_lock(stack.id):\n\n File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__\n return self.gen.next()\n\n File "/opt/stack/new/heat/heat/engine/stack_lock.py", line 136, in thread_lock\n self.release(stack_id)\n\n File "/opt/stack/new/heat/heat/openstack/common/excutils.py", line 82, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n\n File "/opt/stack/new/heat/heat/engine/stack_lock.py", line 132, in thread_lock\n self.acquire()\n\n File "/opt/stack/new/heat/heat/engine/stack_lock.py", line 81, in acquire\n action=self.stack.action)\n\nActionInProgress: Stack heat-1398706498 already has an action (SUSPEND) in progress.\n', u'type': u'ActionInProgress'}}
tempest logs show this:
2014-07-18 14:20:12.678 21570 INFO tempest.common.rest_client [req-e4e89cd6-9ed8-4625-a8f0-d17ad6b31ea4 None] Request (StacksTestJSON:test_suspend_resume_stack): 409 POST http://10.0.0.251:8004/v1/fa5ea85ceefd4f059a6c3fb9e86f7e29/stacks/heat-1398706498/b8b254a4-3f0a-4a21-ac7a-c5a65fb6f092/actions 0.810s
heat engine job logs show this:
/heat/engine/stack_lock.py:122
2014-07-18 14:20:11.954 19225 WARNING heat.engine.stack_lock [req-e4e89cd6-9ed8-4625-a8f0-d17ad6b31ea4 None] Lock was already released on stack b8b254a4-3f0a-4a21-ac7a-c5a65fb6f092!
/usr/lib/python2.7/dist-packages/amqp/channel.py:608: DeprecationWarning: auto_delete exchanges has been deprecated
'auto_delete exchanges has been deprecated'))
/usr/lib/python2.7/dist-packages/amqp/channel.py:608: DeprecationWarning: auto_delete exchanges has been deprecated
'auto_delete exchanges has been deprecated'))
Hit it again here:
http://
http://