resource CREATE failed in tempest heat slow

[David Kranz]

This has been happening sporadically:

 FAIL: setUpClass (tempest.api.orchestration.stacks.test_neutron_resources.NeutronResourcesTestJSON)
2014-03-21 11:57:56.275 | setUpClass (tempest.api.orchestration.stacks.test_neutron_resources.NeutronResourcesTestJSON)
2014-03-21 11:57:56.275 | ----------------------------------------------------------------------
2014-03-21 11:57:56.275 | _StringException: Traceback (most recent call last):
2014-03-21 11:57:56.275 | File "tempest/api/orchestration/stacks/test_neutron_resources.py", line 131, in setUpClass
2014-03-21 11:57:56.275 | cls.client.wait_for_stack_status(cls.stack_id, 'CREATE_COMPLETE')
2014-03-21 11:57:56.275 | File "tempest/services/orchestration/json/orchestration_client.py", line 185, in wait_for_stack_status
2014-03-21 11:57:56.275 | stack_status_reason=body['stack_status_reason'])
2014-03-21 11:57:56.275 | StackBuildErrorException: Stack 0e795d27-2a5a-4a80-a07d-5e5e71e132f0 is in CREATE_FAILED status due to 'Resource CREATE failed: Error: Creation of server heat-796983816-Server-taolr5uyujhh failed: No valid host was found. (500)'
2014-03-21 11:57:56.275

Log file: http://logs.openstack.org/32/79232/4/gate/gate-tempest-dsvm-neutron-heat-slow/ffe15e8/console.html

[Steve Baker (steve-stevebaker)]

A recheck rule for this would be useful.

[Steve Baker (steve-stevebaker)]

Please note these changes will help diagnose this:
https://review.openstack.org/#/c/81935/
https://review.openstack.org/#/c/81936/

And the error is almost certainly not related to the heat codebase.

[Masayuki Igawa (igawa)]

Sometime we can see this failure recently. All cases are in the scenario, though.
The frequency is not so high. But I think this should be resolved.

2014-10-07 12:44:11.234 | 2014-10-07 12:44:11.330 | ======================================================================
2014-10-07 12:44:11.236 | 2014-10-07 12:44:11.332 | FAIL: heat_integrationtests.scenario.test_server_cfn_init.CfnInitIntegrationTest.test_server_cfn_init
2014-10-07 12:44:11.237 | 2014-10-07 12:44:11.333 | tags: worker-0
2014-10-07 12:44:11.239 | 2014-10-07 12:44:11.335 | ----------------------------------------------------------------------
2014-10-07 12:44:11.240 | 2014-10-07 12:44:11.336 | Traceback (most recent call last):
2014-10-07 12:44:11.242 | 2014-10-07 12:44:11.338 | File "heat_integrationtests/scenario/test_server_cfn_init.py", line 125, in test_server_cfn_init
2014-10-07 12:44:11.243 | 2014-10-07 12:44:11.339 | self.check_stack()
2014-10-07 12:44:11.272 | 2014-10-07 12:44:11.341 | File "heat_integrationtests/scenario/test_server_cfn_init.py", line 72, in check_stack
2014-10-07 12:44:11.273 | 2014-10-07 12:44:11.342 | sid, 'SmokeServer', 'CREATE_COMPLETE')
2014-10-07 12:44:11.273 | 2014-10-07 12:44:11.343 | File "heat_integrationtests/common/test.py", line 252, in _wait_for_resource_status
2014-10-07 12:44:11.273 | 2014-10-07 12:44:11.345 | resource_status_reason=res.resource_status_reason)
2014-10-07 12:44:11.274 | 2014-10-07 12:44:11.346 | StackResourceBuildErrorException: Resource SmokeServer in stack CfnInitIntegrationTest-1482842015/2198d0d9-d8a6-4fe4-814e-06fea5fc3beb is in CREATE_FAILED status due to 'FlavorMissing: The Flavor ID (m1.micro) could not be found.'
2014-10-07 12:44:24.893 | 2014-10-07 12:44:24.995 | Ran 1 tests in 18.930s
2014-10-07 12:44:24.894 | 2014-10-07 12:44:24.997 | FAILED (id=0, failures=1)
2014-10-07 12:44:24.895 | 2014-10-07 12:44:24.998 | error: testr failed (1)
2014-10-07 12:44:24.918 | 2014-10-07 12:44:25.020 | ERROR: InvocationError: '/opt/stack/new/heat/.tox/integration/bin/python setup.py testr --slowest --testr-args=--concurrency=1 ^heat_integrationtests '
2014-10-07 12:44:24.920 | 2014-10-07 12:44:25.022 | ___________________________________ summary ____________________________________
2014-10-07 12:44:24.921 | 2014-10-07 12:44:25.024 | ERROR: integration: commands failed

logstash query:
message:"StackResourceBuildErrorException"
http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiU3RhY2tSZXNvdXJjZUJ1aWxkRXJyb3JFeGNlcHRpb25cIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiYWxsIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQxMjY5MTYwNTM3NX0=

[Andrea Frittoli (andrea-frittoli)]

This is 2y+ old and it does not happen in the gate anymore.