BuildErrorException :Server failed to build in setUpClass | test_server_rescue | test_volumes_actions | test_server_addresses|test_create_specify_keypair|test_server_actions

[Hoisaleshwara Madan V S]

======================================================================
 FAIL: setUpClass (tempest.api.compute.servers.test_server_addresses.ServerAddressesTestXML)
 setUpClass (tempest.api.compute.servers.test_server_addresses.ServerAddressesTestXML)
 ----------------------------------------------------------------------
| _StringException: Traceback (most recent call last):
   File "tempest/api/compute/servers/test_server_addresses.py", line 31, in setUpClass
    resp, cls.server = cls.create_test_server(wait_until='ACTIVE')
| File "tempest/api/compute/base.py", line 118, in create_test_server
    server['id'], kwargs['wait_until'])
   File "tempest/services/compute/xml/servers_client.py", line 365, in wait_for_server_status
     extra_timeout=extra_timeout)
| File "tempest/common/waiters.py", line 73, in wait_for_server_status
     raise exceptions.BuildErrorException(server_id=server_id)
2013-11-18 14:36:50.088 | BuildErrorException: Server 81c040b6-cdd7-455e-a7a4-038db1e0420f failed to build and is in ERROR status

 ======================================================================
FAIL: setUpClass (tempest.api.volume.test_volumes_actions.VolumesActionsTest)
 setUpClass (tempest.api.volume.test_volumes_actions.VolumesActionsTest)
 ----------------------------------------------------------------------
| _StringException: Traceback (most recent call last):
  File "tempest/api/volume/test_volumes_actions.py", line 40, in setUpClass
    cls.servers_client.wait_for_server_status(cls.server['id'], 'ACTIVE')
   File "tempest/services/compute/json/servers_client.py", line 160, in wait_for_server_status
| extra_timeout=extra_timeout)
| File "tempest/common/waiters.py", line 73, in wait_for_server_status
     raise exceptions.BuildErrorException(server_id=server_id)
 BuildErrorException: Server b8a3acf4-a3ef-4475-b4b0-85ffe20a4914 failed to build and is in ERROR status
======================================================================
FAIL: setUpClass (tempest.api.compute.servers.test_server_rescue.ServerRescueTestJSON)
| setUpClass (tempest.api.compute.servers.test_server_rescue.ServerRescueTestJSON)
| ----------------------------------------------------------------------
_StringException: Traceback (most recent call last):
| File "tempest/api/compute/servers/test_server_rescue.py", line 63, in setUpClass
     resp, resc_server = cls.create_test_server(wait_until='ACTIVE')
| File "tempest/api/compute/base.py", line 118, in create_test_server
     server['id'], kwargs['wait_until'])
| File "tempest/services/compute/json/servers_client.py", line 160, in wait_for_server_status
| extra_timeout=extra_timeout)
| File "tempest/common/waiters.py", line 73, in wait_for_server_status
     raise exceptions.BuildErrorException(server_id=server_id)
 BuildErrorException: Server e9b20bf5-8f2c-4b66-bc78-e118f7fcd75b failed to build and is in ERROR status

[Matt Riedemann (mriedem)]

Needs a link to a log where this failed, because for all we know this could be a check queue failure due to the patch being tested.

[Subbu (subramanian-neelakantan)]

http://logs.openstack.org/31/61931/13/check/check-tempest-dsvm-full/bef0cfa/console.html

Relevant lines from the above:
2014-01-28 06:48:15.251 | ======================================================================
2014-01-28 06:48:15.251 | FAIL: setUpClass (tempest.api.compute.v3.servers.test_server_rescue.ServerRescueV3TestJSON)
2014-01-28 06:48:15.251 | setUpClass (tempest.api.compute.v3.servers.test_server_rescue.ServerRescueV3TestJSON)
2014-01-28 06:48:15.252 | ----------------------------------------------------------------------
2014-01-28 06:48:15.252 | _StringException: Traceback (most recent call last):
2014-01-28 06:48:15.252 | File "tempest/api/compute/v3/servers/test_server_rescue.py", line 47, in setUpClass
2014-01-28 06:48:15.252 | resp, resc_server = cls.create_test_server(wait_until='ACTIVE')
2014-01-28 06:48:15.252 | File "tempest/api/compute/base.py", line 141, in create_test_server
2014-01-28 06:48:15.252 | raise ex
2014-01-28 06:48:15.252 | BuildErrorException: Server 4e40fb95-27c8-4e99-856b-2812d88c8979 failed to build and is in ERROR status

[Subbu (subramanian-neelakantan)]

One more: http://logs.openstack.org/41/69541/2/check/check-grenade-dsvm/27ffb7a/console.html

2014-01-28 06:43:18.830 | ======================================================================
2014-01-28 06:43:18.830 | FAIL: setUpClass (tempest.api.compute.v3.servers.test_server_actions.ServerActionsV3TestJSON)
2014-01-28 06:43:18.831 | setUpClass (tempest.api.compute.v3.servers.test_server_actions.ServerActionsV3TestJSON)
2014-01-28 06:43:18.831 | ----------------------------------------------------------------------
2014-01-28 06:43:18.831 | _StringException: Traceback (most recent call last):
2014-01-28 06:43:18.832 | File "tempest/api/compute/v3/servers/test_server_actions.py", line 51, in setUpClass
2014-01-28 06:43:18.832 | cls.server_id = cls.rebuild_server(None)
2014-01-28 06:43:18.832 | File "tempest/api/compute/base.py", line 322, in rebuild_server
2014-01-28 06:43:18.833 | resp, server = cls.create_test_server(wait_until='ACTIVE', **kwargs)
2014-01-28 06:43:18.833 | File "tempest/api/compute/base.py", line 141, in create_test_server
2014-01-28 06:43:18.833 | raise ex
2014-01-28 06:43:18.834 | BuildErrorException: Server bad8534b-196f-457d-bf8e-337d98f26120 failed to build and is in ERROR status

[Kirill Izotov (enykeev)]

Pretty much the same happens with me: http://logs.openstack.org/53/69553/1/check/check-tempest-dsvm-full/29dccdc/console.html

2014-01-28 08:25:43.425 | ======================================================================
2014-01-28 08:25:43.425 | FAIL: setUpClass (tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON)
2014-01-28 08:25:43.425 | setUpClass (tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON)
2014-01-28 08:25:43.425 | ----------------------------------------------------------------------
2014-01-28 08:25:43.425 | _StringException: Traceback (most recent call last):
2014-01-28 08:25:43.426 | File "tempest/api/compute/servers/test_instance_actions.py", line 27, in setUpClass
2014-01-28 08:25:43.426 | resp, server = cls.create_test_server(wait_until='ACTIVE')
2014-01-28 08:25:43.426 | File "tempest/api/compute/base.py", line 141, in create_test_server
2014-01-28 08:25:43.426 | raise ex
2014-01-28 08:25:43.426 | BuildErrorException: Server 62ded76d-7a55-483c-9bef-6d50410ad000 failed to build and is in ERROR status

[Christian Schwede (cschwede)]

Happened to me too: http://logs.openstack.org/33/65533/2/gate/gate-tempest-dsvm-postgres-full/d704c76/console.html

2014-01-28 07:04:48.046 | ======================================================================
2014-01-28 07:04:48.078 | FAIL: setUpClass (tempest.api.compute.servers.test_server_rescue.ServerRescueTestJSON)
2014-01-28 07:04:48.079 | setUpClass (tempest.api.compute.servers.test_server_rescue.ServerRescueTestJSON)
2014-01-28 07:04:48.079 | ----------------------------------------------------------------------
2014-01-28 07:04:48.079 | _StringException: Traceback (most recent call last):
2014-01-28 07:04:48.079 | File "tempest/api/compute/servers/test_server_rescue.py", line 61, in setUpClass
2014-01-28 07:04:48.080 | resp, resc_server = cls.create_test_server(wait_until='ACTIVE')
2014-01-28 07:04:48.080 | File "tempest/api/compute/base.py", line 141, in create_test_server
2014-01-28 07:04:48.080 | raise ex
2014-01-28 07:04:48.080 | BuildErrorException: Server 3015551d-572b-4243-89a1-422ca069730f failed to build and is in ERROR status

[Steven Hardy (shardy)]

This appears to be the same issue?

https://review.openstack.org/#/c/67531/

2014-01-28 11:25:00.807 | FAIL: setUpClass (tempest.api.compute.admin.test_simple_tenant_usage.TenantUsagesTestXML)
2014-01-28 11:25:00.807 | setUpClass (tempest.api.compute.admin.test_simple_tenant_usage.TenantUsagesTestXML)
2014-01-28 11:25:00.807 | ----------------------------------------------------------------------
2014-01-28 11:25:00.808 | _StringException: Traceback (most recent call last):
2014-01-28 11:25:00.808 | File "tempest/api/compute/admin/test_simple_tenant_usage.py", line 39, in setUpClass
2014-01-28 11:25:00.808 | resp, server = cls.create_test_server(wait_until='ACTIVE')
2014-01-28 11:25:00.808 | File "tempest/api/compute/base.py", line 141, in create_test_server
2014-01-28 11:25:00.808 | raise ex
2014-01-28 11:25:00.808 | BuildErrorException: Server 4d364ae0-5d60-4750-8646-1fb2e130b5bb failed to build and is in ERROR status

Error in the nova compute logs:
http://logs.openstack.org/31/67531/3/check/check-tempest-dsvm-postgres-full/08ffad6/logs/screen-n-cpu.txt.gz?level=ERROR

2014-01-28 10:32:42.123 26912 ERROR nova.virt.driver [-] Exception dispatching event <nova.virt.event.LifecycleEvent object at 0x3b97bd0>: Info cache for instance 2718bef7-e5cb-4898-a5a2-b0de4914e5c3 could not be found.
Traceback (most recent call last):

  File "/opt/stack/new/nova/nova/conductor/manager.py", line 576, in _object_dispatch
    return getattr(target, method)(context, *args, **kwargs)

  File "/opt/stack/new/nova/nova/objects/base.py", line 152, in wrapper
    return fn(self, ctxt, *args, **kwargs)

  File "/opt/stack/new/nova/nova/objects/instance.py", line 486, in refresh
    self.info_cache.refresh()

  File "/opt/stack/new/nova/nova/objects/base.py", line 152, in wrapper
    return fn(self, ctxt, *args, **kwargs)

  File "/opt/stack/new/nova/nova/objects/instance_info_cache.py", line 103, in refresh
    self.instance_uuid)

  File "/opt/stack/new/nova/nova/objects/base.py", line 112, in wrapper
    result = fn(cls, context, *args, **kwargs)

  File "/opt/stack/new/nova/nova/objects/instance_info_cache.py", line 70, in get_by_instance_uuid
    instance_uuid=instance_uuid)

[Christian Schwede (cschwede)]

Another failure, this time in test_create_specify_keypair:

http://logs.openstack.org/33/65533/2/gate/gate-tempest-dsvm-postgres-full/b11939a/console.html

2014-01-28 17:10:53.936 | Traceback (most recent call last):
2014-01-28 17:10:53.936 | File "tempest/api/compute/servers/test_servers.py", line 70, in test_create_specify_keypair
2014-01-28 17:10:53.936 | self.client.wait_for_server_status(server['id'], 'ACTIVE')
2014-01-28 17:10:53.936 | File "tempest/services/compute/xml/servers_client.py", line 369, in wait_for_server_status
2014-01-28 17:10:53.936 | raise_on_error=raise_on_error)
2014-01-28 17:10:53.936 | File "tempest/common/waiters.py", line 74, in wait_for_server_status
2014-01-28 17:10:53.936 | raise exceptions.BuildErrorException(server_id=server_id)
2014-01-28 17:10:53.937 | BuildErrorException: Server c5068cfa-791e-45d4-91e0-68e0f0045908 failed to build and is in ERROR status

[Fawad Khaliq (fawadkhaliq)]

Same is happening here: http://logs.openstack.org/93/66393/3/gate/gate-tempest-dsvm-neutron-pg/073bd9f/console.html

2014-02-01 07:32:26.897 | tempest.thirdparty.boto.test_s3_objects.S3BucketsTest.test_create_get_delete_object[gate,smoke] ... ok
2014-02-01 07:32:27.059 |
2014-02-01 07:32:27.101 | process-returncode
2014-02-01 07:32:27.101 | process-returncode ... FAIL
2014-02-01 07:32:27.596 |
2014-02-01 07:32:27.596 | ======================================================================
2014-02-01 07:32:27.596 | FAIL: setUpClass (tempest.api.compute.servers.test_create_server.ServersTestJSON)
2014-02-01 07:32:27.596 | setUpClass (tempest.api.compute.servers.test_create_server.ServersTestJSON)
2014-02-01 07:32:27.596 | ----------------------------------------------------------------------
2014-02-01 07:32:27.596 | _StringException: Traceback (most recent call last):
2014-02-01 07:32:27.597 | File "tempest/api/compute/servers/test_create_server.py", line 54, in setUpClass
2014-02-01 07:32:27.597 | cls.client.wait_for_server_status(cls.server_initial['id'], 'ACTIVE')
2014-02-01 07:32:27.597 | File "tempest/services/compute/json/servers_client.py", line 163, in wait_for_server_status
2014-02-01 07:32:27.597 | raise_on_error=raise_on_error)
2014-02-01 07:32:27.597 | File "tempest/common/waiters.py", line 74, in wait_for_server_status
2014-02-01 07:32:27.597 | raise exceptions.BuildErrorException(server_id=server_id)
2014-02-01 07:32:27.597 | BuildErrorException: Server 7543c93a-06d3-4702-b786-23a097efbfb3 failed to build and is in ERROR status
2014-02-01 07:32:27.597 |
2014-02-01 07:32:27.597 |
2014-02-01 07:32:27.597 | ======================================================================
2014-02-01 07:32:27.597 | FAIL: setUpClass (tempest.api.compute.servers.test_create_server.ServersTestManualDisk)
2014-02-01 07:32:27.598 | setUpClass (tempest.api.compute.servers.test_create_server.ServersTestManualDisk)
2014-02-01 07:32:27.598 | ----------------------------------------------------------------------
2014-02-01 07:32:27.598 | _StringException: Traceback (most recent call last):
2014-02-01 07:32:27.598 | File "tempest/api/compute/servers/test_create_server.py", line 216, in setUpClass
2014-02-01 07:32:27.598 | super(ServersTestManualDisk, cls).setUpClass()
2014-02-01 07:32:27.598 | File "tempest/api/compute/servers/test_create_server.py", line 54, in setUpClass
2014-02-01 07:32:27.598 | cls.client.wait_for_server_status(cls.server_initial['id'], 'ACTIVE')
2014-02-01 07:32:27.598 | File "tempest/services/compute/json/servers_client.py", line 163, in wait_for_server_status
2014-02-01 07:32:27.598 | raise_on_error=raise_on_error)
2014-02-01 07:32:27.598 | File "tempest/common/waiters.py", line 74, in wait_for_server_status
2014-02-01 07:32:27.598 | raise exceptions.BuildErrorException(server_id=server_id)
2014-02-01 07:32:27.598 | BuildErrorException: Server b415b0a7-9440-44a6-8911-cc6e80999f22 failed to build and is in ERROR status
2014-02-01 07:32:27.599 |
2014-02-01 07:32:27.599 |
2014-02-01 07:32:27.599 | ======================================================================
2014-02-01 07:32:27.5...

[Fawad Khaliq (fawadkhaliq)]

This is consistently failing at Neutron master branch gates.

[Ben Nemec (bnemec)]

Moving back to confirmed because the requested log links were provided and a number of people are hitting this.