test_software_config in heat integration keeps failing when eabling SSL on keystone

[Guoping Jia]

A list of software configuration tests fails with timeout in Heat Integration test-suite when we enable SSL on keystone (see below such a test failure):

heat_integrationtests.functional.test_software_config.ParallelDeploymentsTest.test_deployments_metadata [1249.277667s] ... FAILED

Captured traceback:
 ~~~~~~~~~~~~~~~~~~~
 Traceback (most recent call last):
 File "/home/stack/hos-qa-tests/hos-qa-tests/heat/testcase/heat_integrations/heat_integrationtests/functional/test_software_config.py", line 72, in test_deployments_metadata
 enable_cleanup=self.enable_cleanup)
 File "/home/stack/hos-qa-tests/hos-qa-tests/heat/testcase/heat_integrations/heat_integrationtests/common/test.py", line 448, in stack_create
 self._wait_for_stack_status(**kwargs)
 File "/home/stack/hos-qa-tests/hos-qa-tests/heat/testcase/heat_integrations/heat_integrationtests/common/test.py", line 321, in _wait_for_stack_status
 raise exceptions.TimeoutException(message)
 heat_integrationtests.common.exceptions.TimeoutException: Request timed out

[Guoping Jia (guoping-jia)]

We saw the test failures in both Liberty and Mitaka.

[Guoping Jia (guoping-jia)]

I've checked several existing Openstack branches, e.g., Liberty, Mitaka, etc. The SoftwareConfigIntegrationTest seems to have always been skipped (tests being added to 'skip_scenario_test_list' in the config file).

Is there any plan to include those tests as part of Heat integration tests ? Heat Software Configuration is an interesting feature. However it keeps failing when enable those tests in Heat integration. One key issue is from the testing image used in Heat integration (from http://tarballs.openstack.org/heat-test-image/fedora-heat-test-image.qcow2). This image is not built with all the required hook elements for Software Configuration (ref. https://github.com/openstack/heat-templates/tree/master/hot/software-config/elements).

The bug filed in this ticket is actually from testing using our own built image. It works over non-SSL keystone, only failing when SSL enabled in keystone. However, rebuilding the test image will be the first step if we need to enable the Software Configuration tests in Heat integration.