[murano] ostf can be failed by the timeout

[Alex Kholkin]

Steps to reproduce:
1) deploy mos 9.0 with enabled murano, enable glance artifact repository
2) run OSTF "Check application deployment in Murano environment with GLARE"

Expected result:
test will pass

Actual result:
test failed

Info:

fuel_health.muranomanager: DEBUG: Failed to get environment status or environment no more exists
fuel_health.common.test_mixins: INFO: Timeout 60s exceeded for deleting environment
fuel_health.common.test_mixins: DEBUG: Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/fuel_health/common/test_mixins.py", line 177, in verify
    result = func(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/fuel_health/common/test_mixins.py", line 223, in __exit__
    raise AssertionError(msg)
AssertionError: Time limit exceeded while waiting for deleting environment to finish.

But the environment was deleted successfully (was deleted in few seconds after test failed)

[Victor Ryzhenkin (vryzhenkin)]

Just would like to clarify the situation.
Not a long time ago someone filed a bug like this for swarm tests (9.x)
It was really rare reproducible and bug was moved to invalid (can't find it now).

So, the last week we are facing this problem on plugin-ci. The Murano OSTF tests now supports Murano plugin installation and we using OSTF tests for the validation of the plugin. This reproduces not always, but we have a lot of system tests and this is increases a chance to face this problem again.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/373473

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/373474

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/373473
Committed: https://git.openstack.org/cgit/openstack/fuel-ostf/commit/?id=e58e5a9bd5f4b8a257dd1251bdd98b19f9c6df1f
Submitter: Jenkins
Branch: master

commit e58e5a9bd5f4b8a257dd1251bdd98b19f9c6df1f
Author: Victor Ryzhenkin <email address hidden>
Date: Tue Sep 20 20:16:44 2016 +0300

    [Murano] Multiple fixes for murano OSTF tests

    - Reduce time between environment deletion checks
    - Increase timeout for environment removal verification

    Change-Id: Iad6e9c5f2e976c9130682e705b4d609393eccd92
    Closes-Bug: #1625727

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/373474
Committed: https://git.openstack.org/cgit/openstack/fuel-ostf/commit/?id=3313174c545e646cb40c99fe8176ad6d8b4ee2fc
Submitter: Jenkins
Branch: stable/mitaka

commit 3313174c545e646cb40c99fe8176ad6d8b4ee2fc
Author: Victor Ryzhenkin <email address hidden>
Date: Tue Sep 20 20:16:44 2016 +0300

    [Murano] Multiple fixes for murano OSTF tests

    - Reduce time between environment deletion checks
    - Increase timeout for environment removal verification

    Change-Id: Iad6e9c5f2e976c9130682e705b4d609393eccd92
    Closes-Bug: #1625727

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/fuel-ostf 10.0.0rc1 release candidate.

[Ekaterina Shutova (eshutova)]

Verified on:
cat /etc/fuel_build_id:
 495
cat /etc/fuel_build_number:
 495
cat /etc/fuel_release:
 9.0
cat /etc/fuel_openstack_version:
 mitaka-9.0
rpm -qa | egrep 'fuel|astute|network-checker|nailgun|packetary|shotgun':
 fuelmenu-9.0.0-1.mos276.noarch
 python-packetary-9.0.0-1.mos155.noarch
 fuel-migrate-9.0.0-1.mos8621.noarch
 fuel-release-9.0.0-1.mos6358.noarch
 fuel-misc-9.0.0-1.mos8621.noarch
 fuel-bootstrap-cli-9.0.0-1.mos291.noarch
 fuel-openstack-metadata-9.0.0-1.mos8870.noarch
 shotgun-9.0.0-1.mos90.noarch
 rubygem-astute-9.0.0-1.mos776.noarch
 fuel-provisioning-scripts-9.0.0-1.mos8870.noarch
 fuel-ui-9.0.0-1.mos2824.noarch
 fuel-utils-9.0.0-1.mos8621.noarch
 network-checker-9.0.0-1.mos77.x86_64
 fuel-9.0.0-1.mos6358.noarch
 nailgun-mcagents-9.0.0-1.mos776.noarch
 fuel-setup-9.0.0-1.mos6358.noarch
 python-fuelclient-9.0.0-1.mos359.noarch
 fuel-agent-9.0.0-1.mos291.noarch
 fuel-ostf-9.0.0-1.mos947.noarch
 fuel-nailgun-9.0.0-1.mos8870.noarch
 fuel-mirror-9.0.0-1.mos155.noarch
 fuel-notify-9.0.0-1.mos8621.noarch
 fuel-library9.0-9.0.0-1.mos8621.noarch

OSTF "Check application deployment in Murano environment with GLARE" was run several times, passed.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/fuel-ostf 10.0.0 release.