negative "rescue" tempest tests fail, cannot pause/rescue while instance is in vm_state building

[Brant Knudson]

A tempest run failed several tests with errors like "Cannot 'pause' while instance is in vm_state building". The other things tempest was trying to do is 'rescue' and 'attach_volume', and they all failed with the same error.

Also, the error reported was "Conflict: An object with that identifier already exists" -- but there wasn't a conflict because an object with that identifier exists... it's a conflict with the state.

Here's the tests that failed, in tempest.api.compute.servers.test_server_rescue_negative :

.ServerRescueNegativeTestXML.test_rescue_paused_instance[gate,negative]
.ServerRescueNegativeTestXML.test_rescued_vm_attach_volume[gate,negative]
.ServerRescueNegativeTestXML.test_rescued_vm_detach_volume[gate,negative]

n-cpu:

2014-03-10 22:43:00.681 21160 INFO nova.virt.libvirt.driver [-] [instance: f2b64699-afc5-43f1-b3ef-868a92c08fd1] Instance spawned successfully.
2014-03-10 22:43:00.684 DEBUG nova.compute.manager [req-f546c7d0-c320-4519-b37a-68dcd3a87783 ServerRescueNegativeTestXML-500126247 ServerRescueNegativeTestXML-1828544031] [instance: f2b64699-afc5-43f1-b3ef-868a92c08fd1] Checking state _get_power_state /opt/stack/new/nova/nova/compute/manager.py:986

n-api:

2014-03-10 22:43:01.193 INFO nova.api.openstack.wsgi [req-9f3d2f24-44af-4e0c-8e44-3289944c19d3 ServerRescueNegativeTestXML-500126247 ServerRescueNegativeTestXML-1828544031] HTTP exception thrown: Cannot 'pause' while instance is in vm_state building

Looks like the request doesn't get from api to cpu, since api thinks it's not ready.

[Rossella Sblendido (rossella-o)]

An example here
http://logs.openstack.org/78/82178/1/check/check-tempest-dsvm-neutron-full/026c1b6/console.html.gz

[Joe Gordon (jogo)]

Sounds like a tempest bug not a nova bug.

[Masayuki Igawa (igawa)]

We don't get this bug recently. And I think there is not enough information to investigate this bug.
I'll set this bug to incomplete.

Followings are logstash query that can't find

message:"Cannot 'pause' while instance is in vm_state building"
http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiQ2Fubm90ICdwYXVzZScgd2hpbGUgaW5zdGFuY2UgaXMgaW4gdm1fc3RhdGUgYnVpbGRpbmdcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiYWxsIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQxMjY5MDQ0NTA2NH0=

message:"Cannot 'rescue' while instance is in vm_state building"
http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiQ2Fubm90ICdyZXNjdWUnIHdoaWxlIGluc3RhbmNlIGlzIGluIHZtX3N0YXRlIGJ1aWxkaW5nXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6ImFsbCIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjE0MTI2OTA1MDgzODZ9

[Launchpad Janitor (janitor)]

[Expired for tempest because there has been no activity for 60 days.]