Stack DELETE IN_PROGRESS: Unhandled error in asynchronous task

[Emilien Macchi]

This bug is not easily reproducible but I thought it would be useful feedback anyway.
Puppet OpenStack CI is deploying Heat from trunk, and we've seen a transient error in heat engine when a stack is deleted. It looks like a timeout.

The complete trace is available here:
http://logs.openstack.org/01/369201/1/check/gate-puppet-openstack-integration-3-scenario003-tempest-centos-7/5db05f9/logs/heat/heat-engine.txt.gz#_2016-09-13_08_17_09_100

The actual Tempest failure is visible here:
http://logs.openstack.org/01/369201/1/check/gate-puppet-openstack-integration-3-scenario003-tempest-centos-7/5db05f9/console.html#_2016-09-13_08_37_16_806586

Maybe we're running with low resources and it causes timeout? I'm not sure.

[Thomas Herve (therve)]

Convergence is on, FWIW. This happens:

DBReferenceError: (pymysql.err.IntegrityError) (1452, u'Cannot add or update a child row: a foreign key constraint fails (`heat`.`stack`, CONSTRAINT `stack_ibfk_3` FOREIGN KEY (`user_creds_id`) REFERENCES `user_creds` (`id`))') [SQL: u'UPDATE stack SET action=%s, status=%s, status_reason=%s, name=%s, raw_template_id=%s, prev_raw_template_id=%s, username=%s, tenant=%s, user_creds_id=%s, owner_id=%s, parent_resource_name=%s, timeout=%s, disable_rollback=%s, stack_user_project_id=%s, backup=%s, nested_depth=%s, convergence=%s, current_traversal=%s, current_deps=%s, updated_at=%s WHERE stack.id = %s AND stack.current_traversal = %s'] [parameters: ('DELETE', 'IN_PROGRESS', 'Stack DELETE started', u'tempest-heat-489261592', 3, 2, u'tempest-StacksTestJSON-880625563', u'ca9077fb1f7443958cf398a1476db4f6', 1, None, None, 60, 1, u'92b524b2cf164c999441d7b4f418ef12', 0, 0, 1, '580db086-3791-4fe3-8a8e-96c8d8a00c28', '{"edges": []}', datetime.datetime(2016, 9, 13, 8, 17, 9, 49912), u'7383bf08-6da0-427b-a8ab-5ff6337ba157', u'580db086-3791-4fe3-8a8e-96c8d8a00c28')]