Multiple errors in test_server_rescue

[David Stanek]

http://logs.openstack.org/01/54201/1/gate/gate-tempest-devstack-vm-postgres-full/1adbe5d/

2013-10-29 18:58:37.307 | ======================================================================
2013-10-29 18:58:37.308 | FAIL: tempest.api.compute.servers.test_server_rescue.ServerRescueTestXML.test_rescued_vm_associate_dissociate_floating_ip[gate]
2013-10-29 18:58:37.308 | tempest.api.compute.servers.test_server_rescue.ServerRescueTestXML.test_rescued_vm_associate_dissociate_floating_ip[gate]
2013-10-29 18:58:37.308 | ----------------------------------------------------------------------
2013-10-29 18:58:37.309 | _StringException: Empty attachments:
2013-10-29 18:58:37.309 | stderr
2013-10-29 18:58:37.309 | stdout
2013-10-29 18:58:37.309 |
2013-10-29 18:58:37.309 | pythonlogging:'': {{{
2013-10-29 18:58:37.310 | 2013-10-29 18:43:42,185 Request: POST http://127.0.0.1:8774/v2/9bb4845e97d94f91bc8686be6b3ff161/servers/2f61cd27-53ef-4d0a-af26-93a6e8018db0/action
2013-10-29 18:58:37.310 | 2013-10-29 18:43:42,185 Request Headers: {'Content-Type': 'application/xml', 'Accept': 'application/xml', 'X-Auth-Token': '<Token omitted>'}
2013-10-29 18:58:37.310 | 2013-10-29 18:43:42,185 Request Body: <?xml version="1.0" encoding="UTF-8"?>
2013-10-29 18:58:37.310 | <rescue xmlns="http://docs.openstack.org/compute/api/v1.1" adminPass="6c3kj9AQUngX"/>
2013-10-29 18:58:37.310 | 2013-10-29 18:43:42,358 Response Status: 500
2013-10-29 18:58:37.310 | 2013-10-29 18:43:42,358 Nova request id: req-ddfd2cff-0e17-4e23-bb5c-b6d8a89846df
2013-10-29 18:58:37.310 | 2013-10-29 18:43:42,358 Response Headers: {'content-length': '192', 'date': 'Tue, 29 Oct 2013 18:43:42 GMT', 'content-type': 'application/xml; charset=UTF-8', 'connection': 'close'}
2013-10-29 18:58:37.311 | 2013-10-29 18:43:42,359 Response Body: <computeFault code="500" xmlns="http://docs.openstack.org/compute/api/v1.1"><message>The server has either erred or is incapable of performing the requested operation.</message></computeFault>
2013-10-29 18:58:37.311 | }}}
2013-10-29 18:58:37.311 |
2013-10-29 18:58:37.311 | Traceback (most recent call last):
2013-10-29 18:58:37.311 | File "tempest/api/compute/servers/test_server_rescue.py", line 200, in test_rescued_vm_associate_dissociate_floating_ip
2013-10-29 18:58:37.311 | self.server_id, self.password)
2013-10-29 18:58:37.312 | File "tempest/services/compute/xml/servers_client.py", line 563, in rescue_server
2013-10-29 18:58:37.312 | return self.action(server_id, 'rescue', None, adminPass=adminPass)
2013-10-29 18:58:37.312 | File "tempest/services/compute/xml/servers_client.py", line 409, in action
2013-10-29 18:58:37.312 | str(doc), self.headers)
2013-10-29 18:58:37.312 | File "tempest/common/rest_client.py", line 302, in post
2013-10-29 18:58:37.312 | return self.request('POST', url, headers, body)
2013-10-29 18:58:37.312 | File "tempest/common/rest_client.py", line 436, in request
2013-10-29 18:58:37.313 | resp, resp_body)
2013-10-29 18:58:37.313 | File "tempest/common/rest_client.py", line 522, in _error_checker
2013-10-29 18:58:37.313 | raise exceptions.ServerFault(message)
2013-10-29 18:58:37.313 | ServerFault: Got server fault
2013-10-29 18:58:37.313 | Details: The server has either erred or is incapable of performing the requested operation.
2013-10-29 18:58:37.313 |
2013-10-29 18:58:37.314 |
2013-10-29 18:58:37.314 | ======================================================================
2013-10-29 18:58:37.315 | FAIL: tempest.api.compute.servers.test_server_rescue.ServerRescueTestXML.test_rescued_vm_attach_volume[gate,negative]
2013-10-29 18:58:37.315 | tempest.api.compute.servers.test_server_rescue.ServerRescueTestXML.test_rescued_vm_attach_volume[gate,negative]
2013-10-29 18:58:37.315 | ----------------------------------------------------------------------
2013-10-29 18:58:37.316 | _StringException: Empty attachments:
2013-10-29 18:58:37.316 | stderr
2013-10-29 18:58:37.316 | stdout
2013-10-29 18:58:37.316 |
2013-10-29 18:58:37.316 | pythonlogging:'': {{{
2013-10-29 18:58:37.316 | 2013-10-29 18:43:42,366 Request: POST http://127.0.0.1:8774/v2/9bb4845e97d94f91bc8686be6b3ff161/servers/2f61cd27-53ef-4d0a-af26-93a6e8018db0/action
2013-10-29 18:58:37.317 | 2013-10-29 18:43:42,366 Request Headers: {'Content-Type': 'application/xml', 'Accept': 'application/xml', 'X-Auth-Token': '<Token omitted>'}
2013-10-29 18:58:37.317 | 2013-10-29 18:43:42,367 Request Body: <?xml version="1.0" encoding="UTF-8"?>
2013-10-29 18:58:37.317 | <rescue xmlns="http://docs.openstack.org/compute/api/v1.1" adminPass="6c3kj9AQUngX"/>
2013-10-29 18:58:37.317 | 2013-10-29 18:43:42,507 Response Status: 409
2013-10-29 18:58:37.317 | 2013-10-29 18:43:42,508 Nova request id: req-26c51f4c-bf63-4537-8caf-3eb821d29714
2013-10-29 18:58:37.317 | 2013-10-29 18:43:42,508 Response Headers: {'content-length': '182', 'date': 'Tue, 29 Oct 2013 18:43:42 GMT', 'content-type': 'application/xml; charset=UTF-8', 'connection': 'close'}
2013-10-29 18:58:37.318 | 2013-10-29 18:43:42,508 Response Body: <conflictingRequest code="409" xmlns="http://docs.openstack.org/compute/api/v1.1"><message>Cannot 'rescue' while instance is in task_state powering-off</message></conflictingRequest>
2013-10-29 18:58:37.318 | }}}
2013-10-29 18:58:37.318 |
2013-10-29 18:58:37.318 | Traceback (most recent call last):
2013-10-29 18:58:37.318 | File "tempest/api/compute/servers/test_server_rescue.py", line 162, in test_rescued_vm_attach_volume
2013-10-29 18:58:37.318 | self.servers_client.rescue_server(self.server_id, self.password)
2013-10-29 18:58:37.318 | File "tempest/services/compute/xml/servers_client.py", line 563, in rescue_server
2013-10-29 18:58:37.319 | return self.action(server_id, 'rescue', None, adminPass=adminPass)
2013-10-29 18:58:37.319 | File "tempest/services/compute/xml/servers_client.py", line 409, in action
2013-10-29 18:58:37.319 | str(doc), self.headers)
2013-10-29 18:58:37.319 | File "tempest/common/rest_client.py", line 302, in post
2013-10-29 18:58:37.319 | return self.request('POST', url, headers, body)
2013-10-29 18:58:37.319 | File "tempest/common/rest_client.py", line 436, in request
2013-10-29 18:58:37.319 | resp, resp_body)
2013-10-29 18:58:37.320 | File "tempest/common/rest_client.py", line 491, in _error_checker
2013-10-29 18:58:37.320 | raise exceptions.Conflict(resp_body)
2013-10-29 18:58:37.320 | Conflict: An object with that identifier already exists
2013-10-29 18:58:37.320 | Details: {'message': "Cannot 'rescue' while instance is in task_state powering-off", 'code': '409'}

[Matt Riedemann (mriedem)]

Failed here:

http://logs.openstack.org/28/53528/1/gate/gate-tempest-devstack-vm-full/66f3ffb/console.html

2013-11-17 11:52:28.150 | Traceback (most recent call last):
2013-11-17 11:52:28.151 | File "tempest/api/compute/servers/test_server_rescue.py", line 201, in test_rescued_vm_associate_dissociate_floating_ip
2013-11-17 11:52:28.151 | self.servers_client.wait_for_server_status(self.server_id, 'RESCUE')
2013-11-17 11:52:28.151 | File "tempest/services/compute/xml/servers_client.py", line 352, in wait_for_server_status
2013-11-17 11:52:28.151 | return waiters.wait_for_server_status(self, server_id, status)
2013-11-17 11:52:28.151 | File "tempest/common/waiters.py", line 80, in wait_for_server_status
2013-11-17 11:52:28.151 | raise exceptions.TimeoutException(message)
2013-11-17 11:52:28.151 | TimeoutException: Request timed out
2013-11-17 11:52:28.152 | Details: Server 15dbabd2-a961-46b5-9e2b-10f9e290d6dd failed to reach RESCUE status within the required time (400 s). Current status: SHUTOFF.

See this in the n-cpu log:

2013-11-17 11:51:56.294 24960 ERROR nova.virt.libvirt.driver [-] [instance: 26e62ece-100b-4f60-90b9-79e3c62b5d80] During wait destroy, instance disappeared.