System test 'upgrade_ha_env' should add assertions that nodes are online in nailgun after HA cluster upgraded after L130 in test_upgrade.py

[Dennis Dmitriev]

System test 'upgrade_ha_env' runs OSTF after the cluster upgrade too early:

== http://jenkins-product.srt.mirantis.net:8080/job/5.1_fuelmain.system_test.ubuntu.upgrade/67/
AssertionError: Failed tests, fails: 21

== http://jenkins-product.srt.mirantis.net:8080/job/5.1_fuelmain.system_test.centos.upgrade/66/
AssertionError: Failed tests, fails: 21

Both environment passed OSTF tests after revert.

The test must contain a check for online nodes statuses before ostf run.

[Tatyanka (tatyana-leontovich)]

Actually in upgrade tests - only master node are upgraded, so pacemaker should be ok, according to we do not run any actions on the clusters here. We need found the reason of failures

[Tatyanka (tatyana-leontovich)]

So seems nailgun says that all nodes are offline - so that - ostf fail wit such message, we need to add asertion that nodes a online - and then run ostf

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/145756

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/145756
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=de1434ba7810e024afb47610a4a2c57dc47d52cb
Submitter: Jenkins
Branch: master

commit de1434ba7810e024afb47610a4a2c57dc47d52cb
Author: asledzinskiy <email address hidden>
Date: Thu Jan 8 13:57:05 2015 +0200

    Add wait for nodes to get online state after upgrade

    - Add wait for nodes to get online state after upgrade
    to prevent OSTF failure

    Change-Id: Ie9714eed49aea7aa6ae06fa9e6285796e070b8fd
    Closes-Bug: #1398825

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/6.0
Review: https://review.openstack.org/145803

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/5.1
Review: https://review.openstack.org/145804

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/145803
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=f1e063891d2a91cf7f4797ad2b6500c3b2fe959f
Submitter: Jenkins
Branch: stable/6.0

commit f1e063891d2a91cf7f4797ad2b6500c3b2fe959f
Author: asledzinskiy <email address hidden>
Date: Thu Jan 8 13:57:05 2015 +0200

    Add wait for nodes to get online state after upgrade

    - Add wait for nodes to get online state after upgrade
    to prevent OSTF failure

    Change-Id: Ie9714eed49aea7aa6ae06fa9e6285796e070b8fd
    Closes-Bug: #1398825
    (cherry picked from commit de1434ba7810e024afb47610a4a2c57dc47d52cb)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/145804
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=b26a23ed0906adde01accb42827dcd954a45a6da
Submitter: Jenkins
Branch: stable/5.1

commit b26a23ed0906adde01accb42827dcd954a45a6da
Author: asledzinskiy <email address hidden>
Date: Thu Jan 8 13:57:05 2015 +0200

    Add wait for nodes to get online state after upgrade

    - Add wait for nodes to get online state after upgrade
    to prevent OSTF failure

    Change-Id: Ie9714eed49aea7aa6ae06fa9e6285796e070b8fd
    Closes-Bug: #1398825
    (cherry picked from commit de1434ba7810e024afb47610a4a2c57dc47d52cb)

[Tatyanka (tatyana-leontovich)]

check at latest runs