[OSTF] Test 'Check stack autoscaling' fails with 'Time limit exceeded' error

[Artem Panchenko]

OSTF test 'Check stack autoscaling' fails either on step #9 or on step #11

2016-02-17 15:35:55 (nose_storage_plugin) fuel_health.tests.tests_platform.test_heat.HeatSmokeTests.test_autoscaling
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 67, in testPartExecutor
    yield
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 601, in run
    testMethod()
  File "/usr/lib/python2.7/site-packages/fuel_health/tests/tests_platform/test_heat.py", line 688, in test_autoscaling
    vm_connection, 120, 15
  File "/usr/lib/python2.7/site-packages/fuel_health/common/test_mixins.py", line 183, in verify
    " Please refer to OpenStack logs for more details.")
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 666, in fail
    raise self.failureException(msg)
AssertionError: Step 9 failed: ssh -o StrictHostKeyChecking=no -i /tmp/tmp.eGwuW71Ocp cirros@172.16.162.82 'touch /tmp/ostf-heat.txt; test -f /tmp/ostf-heat.txt && echo -ne YES || echo -ne NO' command failed. Please refer to OpenStack logs for more details.
...
2016-02-17 16:15:31 ERROR (nose_storage_plugin) fuel_health.tests.tests_platform.test_heat.HeatSmokeTests.test_autoscaling
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 67, in testPartExecutor
    yield
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 601, in run
    testMethod()
  File "/usr/lib/python2.7/site-packages/fuel_health/tests/tests_platform/test_heat.py", line 704, in test_autoscaling
    len(instances) + 1, 720, 11, reduced_stack_name
  File "/usr/lib/python2.7/site-packages/fuel_health/common/test_mixins.py", line 183, in verify
    " Please refer to OpenStack logs for more details.")
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 666, in fail
    raise self.failureException(msg)
AssertionError: Step 11 failed: Time limit exceeded while waiting for terminating the 2nd instance per autoscaling alarm to finish. Please refer to OpenStack logs for more details.

Other OSTF test pass, manually I can create instance, assign floating IP and SSH to it without any problems.

Steps to reproduce:

1. Create environment (NeutronTUN, Ceph for all storage options, Ceilometer)
2. Add 3 controller, 3 mongodb, 3 ceph+compute nodes
3. Deploy changes
4. Run OSTF

Expected result: all tests passed

Actual result: test 'Check stack autoscaling' permanently fails

Diagnostic snapshot: https://drive.google.com/file/d/0BzaZINLQ8-xkZ0l5dnFJTTNXMjQ/view?usp=sharing

[Timur Nurlygayanov (tnurlygayanov)]

Marked as won't fix for 8.0 because of HCF.
We need to fix it in 9.0.