"Server didn't become active" in Devstack Gate Exercises

[Julien Danjou]

Some tempest tests are failling because the instance didn't become active:

http://logs.openstack.org/19377/2/check/gate-tempest-devstack-vm-quantum/1585/console.html

[Andrew Laski (alaski)]

Can you provide some more information that would help to reproduce this issue? Is something taking too long, not set up correctly, an exception being thrown...? Are you seeing this on every run of a certain patchset?

[James E. Blair (corvus)]

For a recent example, see:

https://review.openstack.org/21382
http://logs.openstack.org/21382/3/check/gate-tempest-devstack-vm-full/2209/

You can see other examples at:

http://status.openstack.org/rechecks/

[Sean Dague (sdague)]

This happens periodically, often what I see when looking at the devstack logs is that the instance came up, but the network didn't

[Sean Dague (sdague)]

Never mind the last comment, the network issue is a different bug

[Russell Bryant (russellb)]

I'm going to move this to grizzly-rc-potential since it seems like something that should be on the "nice to have" list and shouldn't block grizzly-rc1.

[Thierry Carrez (ttx)]

Doesn't look like there is a clear way forward here... so probably not a good RC suggestion.

[Jian Wen (wenjianhn)]

Like bug 1101142, I think the reason is the poor performance of the devstack vm.

How many devstack vms were running on the host?
What was the load of the host machine?

[Clark Boylan (cboylan)]

We run all of our devstack gate host VMs on HPCloud currently (and have in the past also run them on Rackspace). For this reason it is not possible for us to know how many VMs were running on the hypervisor or to know what the load of that machine was at the time.

[Masayuki Igawa (igawa)]

This occurred 46 times in 7 days.

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiW0VSUk9SXSAvb3B0L3N0YWNrL25ldy9kZXZzdGFjay9leGVyY2lzZXMvXCIgQU5EIG1lc3NhZ2U6XCIgc2VydmVyIGRpZG4ndCBiZWNvbWUgYWN0aXZlIVwiIEFORCBmaWxlbmFtZTpcImNvbnNvbGUuaHRtbFwiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiI2MDQ4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsiZnJvbSI6IjIwMTQtMDEtMjNUMDI6MzQ6MTQrMDA6MDAiLCJ0byI6IjIwMTQtMDEtMjdUMDI6MzQ6MTQrMDA6MDAiLCJ1c2VyX2ludGVydmFsIjoiMCJ9LCJzdGFtcCI6MTM5MDc5MzM1MjkwNX0=

[Ray Chen (chenrano2002)]

should be dup with https://bugs.launchpad.net/nova/+bug/1295876

[Ray Chen (chenrano2002)]

nova bug, devstack test works well

[Joe Gordon (jogo)]

There are many reasons why this can happen, this bug itself is too vague.