[system-tests] Deploy of environment fails with Timeout Error in system test "deploy_heat_ha_one_controller_nova"

[Anastasia Kuznetsova]

System test "deploy_heat_ha_one_controller_nova" failed in swarm job:
http://jenkins-product.srt.mirantis.net:8080/view/6.1_swarm/job/6.1.system_test.ubuntu.services_ha_one_controller/118/console

because of TimeoutError: Waiting task "deploy" timeout 7800 sec was exceeded:

ENV: ISO 469, Ubuntu, Nova Network, 1 controller, 1 compute

grep ERROR /var/log/docker-nailgun.log
Stopping supervisord: ERROR: unix:///var/run/supervisor.sock refused connection (already shut down?)
2015-05-27 12:38:05.442 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 12:42:47.518 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 12:47:38.628 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 12:52:11.660 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 12:57:01.769 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:02:12.877 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:07:06.985 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:12:01.091 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:16:57.168 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:21:41.278 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:26:50.331 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:31:26.440 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:36:19.485 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:40:50.559 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:45:35.628 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:50:45.739 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 13:55:36.845 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 14:00:38.955 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 14:05:23.011 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 14:10:45.104 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError
2015-05-27 14:16:03.213 ERROR [7fbb63cac700] (statsenderd) Collector ping failed: ConnectionError

[Ihor Kalnytskyi (ikalnytskyi)]

It's indeed something strange. The logs confuse me. Astute's logs are crazy at all. =\ Looks like something bad happened to the env, and Astute perform orchestration in strange way. For instance, report about successful provisioning was after successful deployment. Afte rsuccessful deployment, there were a lot of reports about progress (not during deployment, but after deployment).

Unfortunately, I can't revert snapshot and debug it. Move it to Incomplete until new reproduce.

[Ihor Kalnytskyi (ikalnytskyi)]

Wasn't reproduced for a long time. Move it to Invalid.