[OSTF] Sometimes instance fails to be deleted

[Tatyanka]

Sometimes instance deletion fails in tests volume.
More often it is happens during system tests execution on CI
Next error in the nova

api send next message to the rabbit
http://paste.openstack.org/show/69799/

and then
http://paste.openstack.org/show/69798/

http://paste.openstack.org/show/69796/

OSTf make some retries to delete instance, and when it does not help, call instance power-off that lead to next exception

http://paste.openstack.org/show/69795/

There is no 100% steps to reproduce it, but at the last 3 runs of system tests on CI it is reproduced on deploying of deploy_simple_cinder.deploy_simple_cinder on Centos

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/79995

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/79995
Committed: https://git.openstack.org/cgit/stackforge/fuel-ostf/commit/?id=12aec4d6669b04353ee4b9caa0c429be823a488c
Submitter: Jenkins
Branch: master

commit 12aec4d6669b04353ee4b9caa0c429be823a488c
Author: Tatyana Leontovich <email address hidden>
Date: Wed Mar 12 18:37:51 2014 +0000

    Remove instance power-off in delete function

    In case if instance deleteion fails we try
    to reset instance state, nova power-off action
    was invokes, that leads to the raise of
    UnexpectedTaskStateError_Remote

    In this patch invocation of power-off was deleted
    Now, we do several retries for deleteion and
    if instance fails to be deleted - fail the test

    Change-Id: Ic059d976a6a312fa32a90fa24b439e133031780e
    Closes-bug: #1285094

[Tatyanka (tatyana-leontovich)]

need to be back-ported in 4.1.1

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/4.1
Review: https://review.openstack.org/83091

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/83091
Committed: https://git.openstack.org/cgit/stackforge/fuel-ostf/commit/?id=65c875f62fa55657b875c09236f1dd8a40769816
Submitter: Jenkins
Branch: stable/4.1

commit 65c875f62fa55657b875c09236f1dd8a40769816
Author: Tatyana Leontovich <email address hidden>
Date: Wed Mar 12 18:37:51 2014 +0000

    4.1.1 Remove instance power-off in delete function

    In case if instance deleteion fails we try
    to reset instance state, nova power-off action
    was invokes, that leads to the raise of
    UnexpectedTaskStateError_Remote

    In this patch invocation of power-off was deleted
    Now, we do several retries for deleteion and
    if instance fails to be deleted - fail the test

    Change-Id: Ic059d976a6a312fa32a90fa24b439e133031780e
    Closes-bug: #1285094

[Tatyanka (tatyana-leontovich)]

verified 127 iso