tempest.api.compute.v3.servers.test_server_rescue.ServerRescueV3TestXML.test_rescued_vm_detach_volume fails gate job sporadically

[Peter Portante]

See: http://logs.openstack.org/06/61906/1/check/check-tempest-dsvm-full/81e2893/console.html

If the log becomes archived, you might have to add a ".gz" to the above URL.

2013-12-13 02:40:08.447 | ======================================================================
2013-12-13 02:40:08.447 | FAIL: tempest.api.compute.v3.servers.test_server_rescue.ServerRescueV3TestXML.test_rescued_vm_detach_volume[gate,negative]
2013-12-13 02:40:08.447 | tempest.api.compute.v3.servers.test_server_rescue.ServerRescueV3TestXML.test_rescued_vm_detach_volume[gate,negative]
2013-12-13 02:40:08.447 | ----------------------------------------------------------------------
2013-12-13 02:40:08.448 | _StringException: Empty attachments:
2013-12-13 02:40:08.448 | stderr
2013-12-13 02:40:08.448 | stdout
2013-12-13 02:40:08.449 |
2013-12-13 02:40:08.449 | pythonlogging:'': {{{
2013-12-13 02:40:08.449 | 2013-12-13 02:27:53,777 Request: POST http://127.0.0.1:8774/v3/servers/996af184-3abe-4f9e-98ce-001b236f0be3/action
2013-12-13 02:40:08.449 | 2013-12-13 02:27:53,777 Request Headers: {'Content-Type': 'application/xml', 'Accept': 'application/xml', 'X-Auth-Token': '<Token omitted>'}
2013-12-13 02:40:08.449 | 2013-12-13 02:27:53,777 Request Body: <?xml version="1.0" encoding="UTF-8"?>
2013-12-13 02:40:08.449 | <attach device="/dev/vdf" xmlns="http://docs.openstack.org/compute/api/v1.1" volume_id="7d7dc13f-99f3-4d0b-a3f7-66d1e96674d2"/>
2013-12-13 02:40:08.450 | 2013-12-13 02:27:54,398 Response Status: 202
2013-12-13 02:40:08.450 | 2013-12-13 02:27:54,398 Nova request id: req-c74f2ee3-0606-44c3-bb5a-47d1b9ae9d4c
2013-12-13 02:40:08.450 | 2013-12-13 02:27:54,399 Response Headers: {'content-length': '0', 'date': 'Fri, 13 Dec 2013 02:27:54 GMT', 'content-type': 'application/xml', 'connection': 'close'}
2013-12-13 02:40:08.450 | 2013-12-13 02:27:54,399 Request: GET http://127.0.0.1:8776/v1/e571f615fc6141808e95a5c3717a1208/volumes/7d7dc13f-99f3-4d0b-a3f7-66d1e96674d2
2013-12-13 02:40:08.450 | 2013-12-13 02:27:54,399 Request Headers: {'Content-Type': 'application/xml', 'Accept': 'application/xml', 'X-Auth-Token': '<Token omitted>'}
2013-12-13 02:40:08.451 | 2013-12-13 02:27:54,506 Response Status: 200
2013-12-13 02:40:08.451 | 2013-12-13 02:27:54,507 Nova request id: req-366446b3-ae44-4ce6-b13d-726033efdb93
2013-12-13 02:40:08.451 | 2013-12-13 02:27:54,507 Response Headers: {'content-length': '519', 'content-location': u'http://127.0.0.1:8776/v1/e571f615fc6141808e95a5c3717a1208/volumes/7d7dc13f-99f3-4d0b-a3f7-66d1e96674d2', 'date': 'Fri, 13 Dec 2013 02:27:54 GMT', 'content-type': 'application/xml', 'connection': 'close'}
2013-12-13 02:40:08.451 | 2013-12-13 02:27:54,507 Response Body: <?xml version='1.0' encoding='UTF-8'?>
2013-12-13 02:40:08.452 | <volume xmlns:os-vol-image-meta="http://docs.openstack.org/volume/ext/volume_image_metadata/api/v1" xmlns:atom="http://www.w3.org/2005/Atom" xmlns="http://docs.openstack.org/volume/api/v1" status="attaching" display_name="test_detach" availability_zone="nova" bootable="false" created_at="2013-12-13 02:27:12" display_description="None" volume_type="None" snapshot_id="None" source_volid="None" id="7d7dc13f-99f3-4d0b-a3f7-66d1e96674d2" size="1"><attachments/><metadata/></volume>

.
.
.

2013-12-13 02:40:09.194 | 2013-12-13 02:31:31,751 Request: GET http://127.0.0.1:8776/v1/e571f615fc6141808e95a5c3717a1208/volumes/7d7dc13f-99f3-4d0b-a3f7-66d1e96674d2
2013-12-13 02:40:09.194 | 2013-12-13 02:31:31,752 Request Headers: {'Content-Type': 'application/xml', 'Accept': 'application/xml', 'X-Auth-Token': '<Token omitted>'}
2013-12-13 02:40:09.194 | 2013-12-13 02:31:31,845 Response Status: 200
2013-12-13 02:40:09.194 | 2013-12-13 02:31:31,845 Nova request id: req-988fbe56-5c2c-42b9-8b61-bac560f73653
2013-12-13 02:40:09.194 | 2013-12-13 02:31:31,845 Response Headers: {'content-length': '798', 'content-location': u'http://127.0.0.1:8776/v1/e571f615fc6141808e95a5c3717a1208/volumes/7d7dc13f-99f3-4d0b-a3f7-66d1e96674d2', 'date': 'Fri, 13 Dec 2013 02:31:31 GMT', 'content-type': 'application/xml', 'connection': 'close'}
2013-12-13 02:40:09.194 | 2013-12-13 02:31:31,845 Response Body: <?xml version='1.0' encoding='UTF-8'?>
2013-12-13 02:40:09.194 | <volume xmlns:os-vol-image-meta="http://docs.openstack.org/volume/ext/volume_image_metadata/api/v1" xmlns:atom="http://www.w3.org/2005/Atom" xmlns="http://docs.openstack.org/volume/api/v1" status="detaching" display_name="test_detach" availability_zone="nova" bootable="false" created_at="2013-12-13 02:27:12" display_description="None" volume_type="None" snapshot_id="None" source_volid="None" id="7d7dc13f-99f3-4d0b-a3f7-66d1e96674d2" size="1"><attachments><attachment device="/dev/vdf" server_id="996af184-3abe-4f9e-98ce-001b236f0be3" volume_id="7d7dc13f-99f3-4d0b-a3f7-66d1e96674d2" id="7d7dc13f-99f3-4d0b-a3f7-66d1e96674d2" host_name="None"/></attachments><metadata><meta key="readonly">False</meta><meta key="attached_mode">rw</meta></metadata></volume>
2013-12-13 02:40:09.195 | }}}
2013-12-13 02:40:09.195 |
2013-12-13 02:40:09.195 | Traceback (most recent call last):
2013-12-13 02:40:09.195 | File "tempest/api/compute/v3/servers/test_server_rescue.py", line 78, in _detach
2013-12-13 02:40:09.196 | 'available')
2013-12-13 02:40:09.196 | File "tempest/services/volume/xml/volumes_client.py", line 191, in wait_for_volume_status
2013-12-13 02:40:09.196 | raise exceptions.TimeoutException(message)
2013-12-13 02:40:09.196 | TimeoutException: Request timed out
2013-12-13 02:40:09.197 | Details: Volume 7d7dc13f-99f3-4d0b-a3f7-66d1e96674d2 failed to reach available status within the required time (196 s).

[Peter Portante (peter-a-portante)]

tempest.api.compute.servers.test_server_rescue.ServerRescueTestJSON.test_rescued_vm_detach_volume failed in a similar way here: http://logs.openstack.org/19/64319/1/check/check-tempest-dsvm-full/7e4a0df/console.html.gz

[Nilesh Bhosale (nilesh-bhosale)]

Similar failure with TimeoutException: Request timed out
http://logs.openstack.org/90/64290/7/check/check-tempest-dsvm-full/c3df706/console.html