[system-test]Update a method of verifying bootstrap on a node to wait appropriately for the node to appear online

[Dmitriy Kruglov]

Detailed bug description:

The automated system test "reset_on_ready_ubuntu_bootstrap" ("deploy_reset_on_ready_ubuntu_bootstrap" group) fails as sometimes a node doesn't appear online in time after resetting environment https://github.com/openstack/fuel-qa/blob/master/fuelweb_test/tests/test_ubuntu_bootstrap.py#L528

Steps to reproduce:

1. Create a cluster with 1 controller, 1 compute and 1 cinder nodes
2. Reset the cluster
3. Verify bootstrap on slaves

Expected result: Ubuntu bootstrap is used.
Actual result: not all nodes are online after resetting the cluster https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.bvt_ubuntu_bootstrap/83/testReport/(root)/reset_on_ready_ubuntu_bootstrap/reset_on_ready_ubuntu_bootstrap/

The corresponding waiter method should be used (not just to wait 'online' node status, but ensure that it is possible to ssh to node after resetting the cluster).

[Aleksei Stepanov (penguinolog)]

wait_nodes_get_online_state pass, but node not become ready.
At short time node becomes ready, but test is already failed.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/316809

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/316809
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=af1955cffc6081a8221143d4090950910ac99c9e
Submitter: Jenkins
Branch: master

commit af1955cffc6081a8221143d4090950910ac99c9e
Author: Dmitriy Kruglov <email address hidden>
Date: Thu May 12 16:19:24 2016 +0000

    Fix 'reset_on_ready_ubuntu_bootstrap' test

    Update the approach to waiting nodes to appear online after
    env reset. Wait not only for 'online' nailgun status of nodes,
    but also ensure that nodes are accessible.

    Change-Id: Iae7fde7646d1edf2a3353c664def134589cc41e0
    Closes-Bug: #1572470

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/319855

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/319855
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=7ed3f6e8ae5448fd287c64bff97217beb2cf502c
Submitter: Jenkins
Branch: stable/mitaka

commit 7ed3f6e8ae5448fd287c64bff97217beb2cf502c
Author: Dmitriy Kruglov <email address hidden>
Date: Thu May 12 16:19:24 2016 +0000

    Fix 'reset_on_ready_ubuntu_bootstrap' test

    Update the approach to waiting nodes to appear online after
    env reset. Wait not only for 'online' nailgun status of nodes,
    but also ensure that nodes are accessible.

    Change-Id: Iae7fde7646d1edf2a3353c664def134589cc41e0
    Closes-Bug: #1572470
    (cherry picked from commit af1955cffc6081a8221143d4090950910ac99c9e)

[Dmitriy Kruglov (dkruglov)]

Verified on MOS 9.0, build 9.0-mos-412.
The issue is fixed.