intermittent revert-to-snapshot error in tempest

Bug #1809113 reported by Tom Barron on 2018-12-19
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Manila
Undecided
Unassigned

Bug Description

In gate with dummy driver job we sometimes get a failure in tempest testing revert to previous snapshot. The dummy driver has no actual back end and the error appears to be in the tempest resource clean up.

2018-12-19 01:56:57.998930 | controller | 2018-12-19 01:56:57.998 | {12} manila_tempest_tests.tests.api.test_revert_to_snapshot.RevertToSnapshotTest.test_revert_to_previous_snapshot_1_2_27 [23.020069s] ... FAILED
2018-12-19 01:56:58.002214 | controller | 2018-12-19 01:56:58.001 |
2018-12-19 01:56:58.005795 | controller | 2018-12-19 01:56:58.005 | Captured traceback:
2018-12-19 01:56:58.009460 | controller | 2018-12-19 01:56:58.008 | ~~~~~~~~~~~~~~~~~~~
2018-12-19 01:56:58.012357 | controller | 2018-12-19 01:56:58.011 | Traceback (most recent call last):
2018-12-19 01:56:58.015734 | controller | 2018-12-19 01:56:58.015 | File "/opt/stack/new/manila-tempest-plugin/manila_tempest_tests/tests/api/base.py", line 914, in clear_resources
2018-12-19 01:56:58.018497 | controller | 2018-12-19 01:56:58.017 | client.delete_snapshot(res_id)
2018-12-19 01:56:58.021149 | controller | 2018-12-19 01:56:58.020 | File "/opt/stack/new/manila-tempest-plugin/manila_tempest_tests/services/share/v2/json/shares_client.py", line 518, in delete_snapshot
2018-12-19 01:56:58.024448 | controller | 2018-12-19 01:56:58.023 | resp, body = self.delete("snapshots/%s" % snap_id, version=version)
2018-12-19 01:56:58.027847 | controller | 2018-12-19 01:56:58.027 | File "/opt/stack/new/manila-tempest-plugin/manila_tempest_tests/services/share/v2/json/shares_client.py", line 75, in delete
2018-12-19 01:56:58.030066 | controller | 2018-12-19 01:56:58.029 | body=body)
2018-12-19 01:56:58.033689 | controller | 2018-12-19 01:56:58.033 | File "tempest/lib/common/rest_client.py", line 311, in delete
2018-12-19 01:56:58.037006 | controller | 2018-12-19 01:56:58.036 | return self.request('DELETE', url, extra_headers, headers, body)
2018-12-19 01:56:58.039733 | controller | 2018-12-19 01:56:58.039 | File "tempest/lib/common/rest_client.py", line 676, in request
2018-12-19 01:56:58.042530 | controller | 2018-12-19 01:56:58.041 | self._error_checker(resp, resp_body)
2018-12-19 01:56:58.046172 | controller | 2018-12-19 01:56:58.045 | File "tempest/lib/common/rest_client.py", line 787, in _error_checker
2018-12-19 01:56:58.049614 | controller | 2018-12-19 01:56:58.049 | raise exceptions.BadRequest(resp_body, resp=resp)
2018-12-19 01:56:58.053203 | controller | 2018-12-19 01:56:58.052 | tempest.lib.exceptions.BadRequest: Bad request
2018-12-19 01:56:58.056566 | controller | 2018-12-19 01:56:58.055 | Details: {u'message': u"Invalid share snapshot: Share Snapshot status must be one of ('available', 'error').", u'code': 400}
2018-12-19 01:56:58.059323 | controller | 2018-12-19 01:56:58.058 |
2018-12-19 01:56:58.062469 | controller | 2018-12-19 01:56:58.061 |
2018-12-19 01:56:58.065386 | controller | 2018-12-19 01:56:58.064 | Captured pythonlogging:
2018-12-19 01:56:58.068425 | controller | 2018-12-19 01:56:58.067 | ~~~~~~~~~~~~~~~~~~~~~~~
2018-12-19 01:56:58.071625 | controller | 2018-12-19 01:56:58.070 | 2018-12-19 01:56:37,240 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 202 POST http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots 2.328s
2018-12-19 01:56:58.073853 | controller | 2018-12-19 01:56:58.073 | 2018-12-19 01:56:37,241 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.076915 | controller | 2018-12-19 01:56:58.075 | Body: {"snapshot": {"share_id": "133b0f35-7708-4f74-9eff-29b49b92de97", "force": false, "name": "tempest-tempest-created-share-snap-1459288840", "description": "Tempest's snapshot"}}
2018-12-19 01:56:58.079260 | controller | 2018-12-19 01:56:58.078 | Response - Headers: {'status': '202', u'content-length': '705', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots', u'x-compute-request-id': 'req-81965484-dada-4b17-a907-fac555527ed7', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:37 GMT', u'content-type': 'application/json'}
2018-12-19 01:56:58.082700 | controller | 2018-12-19 01:56:58.081 | Body: {"snapshot": {"status": "creating", "share_id": "133b0f35-7708-4f74-9eff-29b49b92de97", "description": "Tempest's snapshot", "links": [{"href": "http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86", "rel": "self"}, {"href": "http://158.69.68.107:8786/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86", "rel": "bookmark"}], "id": "89c3a4d8-4416-41df-bcd9-452b88c48a86", "size": 1, "user_id": "2644d4f3a0d844e49d2ff93e122cb48c", "name": "tempest-tempest-created-share-snap-1459288840", "created_at": "2018-12-19T01:56:36.536507", "share_proto": "NFS", "project_id": "61339ae6b9214382a77c8bab80aa5177", "share_size": 1}}
2018-12-19 01:56:58.085192 | controller | 2018-12-19 01:56:58.084 | 2018-12-19 01:56:38,304 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 200 GET http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86 1.062s
2018-12-19 01:56:58.087823 | controller | 2018-12-19 01:56:58.087 | 2018-12-19 01:56:38,304 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.089901 | controller | 2018-12-19 01:56:58.089 | Body: None
2018-12-19 01:56:58.092584 | controller | 2018-12-19 01:56:58.091 | Response - Headers: {'status': '200', u'content-length': '705', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86', u'x-compute-request-id': 'req-fd458ba3-d997-49af-85ef-00620a5fb142', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:38 GMT', u'content-type': 'application/json'}
2018-12-19 01:56:58.096079 | controller | 2018-12-19 01:56:58.095 | Body: {"snapshot": {"status": "creating", "share_id": "133b0f35-7708-4f74-9eff-29b49b92de97", "description": "Tempest's snapshot", "links": [{"href": "http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86", "rel": "self"}, {"href": "http://158.69.68.107:8786/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86", "rel": "bookmark"}], "id": "89c3a4d8-4416-41df-bcd9-452b88c48a86", "size": 1, "user_id": "2644d4f3a0d844e49d2ff93e122cb48c", "name": "tempest-tempest-created-share-snap-1459288840", "created_at": "2018-12-19T01:56:37.000000", "share_proto": "NFS", "project_id": "61339ae6b9214382a77c8bab80aa5177", "share_size": 1}}
2018-12-19 01:56:58.099155 | controller | 2018-12-19 01:56:58.098 | 2018-12-19 01:56:41,763 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 200 GET http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86 0.453s
2018-12-19 01:56:58.101585 | controller | 2018-12-19 01:56:58.101 | 2018-12-19 01:56:41,764 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.104246 | controller | 2018-12-19 01:56:58.103 | Body: None
2018-12-19 01:56:58.106995 | controller | 2018-12-19 01:56:58.106 | Response - Headers: {'status': '200', u'content-length': '706', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86', u'x-compute-request-id': 'req-62eda977-a29b-4cec-9f16-77ca513b09ad', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:41 GMT', u'content-type': 'application/json'}
2018-12-19 01:56:58.110064 | controller | 2018-12-19 01:56:58.109 | Body: {"snapshot": {"status": "available", "share_id": "133b0f35-7708-4f74-9eff-29b49b92de97", "description": "Tempest's snapshot", "links": [{"href": "http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86", "rel": "self"}, {"href": "http://158.69.68.107:8786/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86", "rel": "bookmark"}], "id": "89c3a4d8-4416-41df-bcd9-452b88c48a86", "size": 1, "user_id": "2644d4f3a0d844e49d2ff93e122cb48c", "name": "tempest-tempest-created-share-snap-1459288840", "created_at": "2018-12-19T01:56:37.000000", "share_proto": "NFS", "project_id": "61339ae6b9214382a77c8bab80aa5177", "share_size": 1}}
2018-12-19 01:56:58.113426 | controller | 2018-12-19 01:56:58.111 | 2018-12-19 01:56:43,434 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 202 POST http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots 1.667s
2018-12-19 01:56:58.116361 | controller | 2018-12-19 01:56:58.115 | 2018-12-19 01:56:43,434 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.119432 | controller | 2018-12-19 01:56:58.118 | Body: {"snapshot": {"share_id": "133b0f35-7708-4f74-9eff-29b49b92de97", "force": false, "name": "tempest-tempest-created-share-snap-958291404", "description": "Tempest's snapshot"}}
2018-12-19 01:56:58.122862 | controller | 2018-12-19 01:56:58.121 | Response - Headers: {'status': '202', u'content-length': '704', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots', u'x-compute-request-id': 'req-301b6659-6602-44b3-b484-b273f021ece6', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:43 GMT', u'content-type': 'application/json'}
2018-12-19 01:56:58.126454 | controller | 2018-12-19 01:56:58.125 | Body: {"snapshot": {"status": "creating", "share_id": "133b0f35-7708-4f74-9eff-29b49b92de97", "description": "Tempest's snapshot", "links": [{"href": "http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466", "rel": "self"}, {"href": "http://158.69.68.107:8786/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466", "rel": "bookmark"}], "id": "6c9b69fe-607f-4c29-bc6e-367556bc6466", "size": 1, "user_id": "2644d4f3a0d844e49d2ff93e122cb48c", "name": "tempest-tempest-created-share-snap-958291404", "created_at": "2018-12-19T01:56:42.798141", "share_proto": "NFS", "project_id": "61339ae6b9214382a77c8bab80aa5177", "share_size": 1}}
2018-12-19 01:56:58.129915 | controller | 2018-12-19 01:56:58.128 | 2018-12-19 01:56:43,855 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 200 GET http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466 0.420s
2018-12-19 01:56:58.132555 | controller | 2018-12-19 01:56:58.131 | 2018-12-19 01:56:43,856 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.135505 | controller | 2018-12-19 01:56:58.134 | Body: None
2018-12-19 01:56:58.138633 | controller | 2018-12-19 01:56:58.137 | Response - Headers: {'status': '200', u'content-length': '704', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466', u'x-compute-request-id': 'req-2c624557-ef30-4590-a99e-87b71d6137b6', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:43 GMT', u'content-type': 'application/json'}
2018-12-19 01:56:58.141594 | controller | 2018-12-19 01:56:58.140 | Body: {"snapshot": {"status": "creating", "share_id": "133b0f35-7708-4f74-9eff-29b49b92de97", "description": "Tempest's snapshot", "links": [{"href": "http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466", "rel": "self"}, {"href": "http://158.69.68.107:8786/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466", "rel": "bookmark"}], "id": "6c9b69fe-607f-4c29-bc6e-367556bc6466", "size": 1, "user_id": "2644d4f3a0d844e49d2ff93e122cb48c", "name": "tempest-tempest-created-share-snap-958291404", "created_at": "2018-12-19T01:56:43.000000", "share_proto": "NFS", "project_id": "61339ae6b9214382a77c8bab80aa5177", "share_size": 1}}
2018-12-19 01:56:58.144062 | controller | 2018-12-19 01:56:58.143 | 2018-12-19 01:56:47,404 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 200 GET http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466 0.544s
2018-12-19 01:56:58.146260 | controller | 2018-12-19 01:56:58.145 | 2018-12-19 01:56:47,404 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.149741 | controller | 2018-12-19 01:56:58.148 | Body: None
2018-12-19 01:56:58.152544 | controller | 2018-12-19 01:56:58.151 | Response - Headers: {'status': '200', u'content-length': '705', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466', u'x-compute-request-id': 'req-8b2a4982-dc55-4bc2-a318-937a7a27a6f1', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:47 GMT', u'content-type': 'application/json'}
2018-12-19 01:56:58.155534 | controller | 2018-12-19 01:56:58.154 | Body: {"snapshot": {"status": "available", "share_id": "133b0f35-7708-4f74-9eff-29b49b92de97", "description": "Tempest's snapshot", "links": [{"href": "http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466", "rel": "self"}, {"href": "http://158.69.68.107:8786/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466", "rel": "bookmark"}], "id": "6c9b69fe-607f-4c29-bc6e-367556bc6466", "size": 1, "user_id": "2644d4f3a0d844e49d2ff93e122cb48c", "name": "tempest-tempest-created-share-snap-958291404", "created_at": "2018-12-19T01:56:43.000000", "share_proto": "NFS", "project_id": "61339ae6b9214382a77c8bab80aa5177", "share_size": 1}}
2018-12-19 01:56:58.157209 | controller | 2018-12-19 01:56:58.156 | 2018-12-19 01:56:48,929 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 202 DELETE http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466 1.523s
2018-12-19 01:56:58.160011 | controller | 2018-12-19 01:56:58.159 | 2018-12-19 01:56:48,929 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.162964 | controller | 2018-12-19 01:56:58.162 | Body: None
2018-12-19 01:56:58.166164 | controller | 2018-12-19 01:56:58.165 | Response - Headers: {'status': '202', u'content-length': '0', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466', u'vary': 'X-OpenStack-Manila-API-Version', u'connection': 'close', u'x-openstack-manila-api-version': '2.46', u'date': 'Wed, 19 Dec 2018 01:56:48 GMT', u'content-type': 'text/html; charset=UTF-8'}
2018-12-19 01:56:58.168867 | controller | 2018-12-19 01:56:58.168 | Body:
2018-12-19 01:56:58.170861 | controller | 2018-12-19 01:56:58.170 | 2018-12-19 01:56:49,716 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 200 GET http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466 0.787s
2018-12-19 01:56:58.174276 | controller | 2018-12-19 01:56:58.173 | 2018-12-19 01:56:49,717 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.176546 | controller | 2018-12-19 01:56:58.175 | Body: None
2018-12-19 01:56:58.179862 | controller | 2018-12-19 01:56:58.178 | Response - Headers: {'status': '200', u'content-length': '704', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466', u'x-compute-request-id': 'req-c8076590-b7f4-4111-bbeb-119a31ad49e4', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:49 GMT', u'content-type': 'application/json'}
2018-12-19 01:56:58.184622 | controller | 2018-12-19 01:56:58.182 | Body: {"snapshot": {"status": "deleting", "share_id": "133b0f35-7708-4f74-9eff-29b49b92de97", "description": "Tempest's snapshot", "links": [{"href": "http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466", "rel": "self"}, {"href": "http://158.69.68.107:8786/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466", "rel": "bookmark"}], "id": "6c9b69fe-607f-4c29-bc6e-367556bc6466", "size": 1, "user_id": "2644d4f3a0d844e49d2ff93e122cb48c", "name": "tempest-tempest-created-share-snap-958291404", "created_at": "2018-12-19T01:56:43.000000", "share_proto": "NFS", "project_id": "61339ae6b9214382a77c8bab80aa5177", "share_size": 1}}
2018-12-19 01:56:58.187133 | controller | 2018-12-19 01:56:58.185 | 2018-12-19 01:56:52,813 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 404 GET http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466 0.092s
2018-12-19 01:56:58.190079 | controller | 2018-12-19 01:56:58.189 | 2018-12-19 01:56:52,814 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.192564 | controller | 2018-12-19 01:56:58.191 | Body: None
2018-12-19 01:56:58.196279 | controller | 2018-12-19 01:56:58.194 | Response - Headers: {'status': '404', u'content-length': '78', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466', u'x-compute-request-id': 'req-850c543a-01dc-4563-b18e-a7982bb9cdb8', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:52 GMT', u'content-type': 'application/json'}
2018-12-19 01:56:58.198800 | controller | 2018-12-19 01:56:58.198 | Body: {"itemNotFound": {"message": "The resource could not be found.", "code": 404}}
2018-12-19 01:56:58.202042 | controller | 2018-12-19 01:56:58.201 | 2018-12-19 01:56:54,338 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 202 POST http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/shares/133b0f35-7708-4f74-9eff-29b49b92de97/action 1.523s
2018-12-19 01:56:58.205247 | controller | 2018-12-19 01:56:58.204 | 2018-12-19 01:56:54,339 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.27', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.208316 | controller | 2018-12-19 01:56:58.207 | Body: {"revert": {"snapshot_id": "89c3a4d8-4416-41df-bcd9-452b88c48a86"}}
2018-12-19 01:56:58.211767 | controller | 2018-12-19 01:56:58.210 | Response - Headers: {'status': '202', u'content-length': '0', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/shares/133b0f35-7708-4f74-9eff-29b49b92de97/action', u'vary': 'X-OpenStack-Manila-API-Version', u'connection': 'close', u'x-openstack-manila-api-version': '2.27', u'date': 'Wed, 19 Dec 2018 01:56:54 GMT', u'content-type': 'text/html; charset=UTF-8'}
2018-12-19 01:56:58.213940 | controller | 2018-12-19 01:56:58.213 | Body:
2018-12-19 01:56:58.217081 | controller | 2018-12-19 01:56:58.216 | 2018-12-19 01:56:54,747 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 200 GET http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/shares/133b0f35-7708-4f74-9eff-29b49b92de97 0.406s
2018-12-19 01:56:58.220095 | controller | 2018-12-19 01:56:58.219 | 2018-12-19 01:56:54,747 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.223008 | controller | 2018-12-19 01:56:58.222 | Body: None
2018-12-19 01:56:58.226580 | controller | 2018-12-19 01:56:58.225 | Response - Headers: {'status': '200', u'content-length': '1229', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/shares/133b0f35-7708-4f74-9eff-29b49b92de97', u'x-compute-request-id': 'req-d387ba65-2542-4a97-8e0a-c6f793568060', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:54 GMT', u'content-type': 'application/json'}
2018-12-19 01:56:58.230854 | controller | 2018-12-19 01:56:58.228 | Body: {"share": {"status": "reverting", "share_type_name": "tempest-share-type-720971903", "description": "Tempest's share", "links": [{"href": "http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/shares/133b0f35-7708-4f74-9eff-29b49b92de97", "rel": "self"}, {"href": "http://158.69.68.107:8786/61339ae6b9214382a77c8bab80aa5177/shares/133b0f35-7708-4f74-9eff-29b49b92de97", "rel": "bookmark"}], "availability_zone": "nova", "share_network_id": "7e045699-eaed-47a4-a29f-88fe728fc0c0", "share_group_id": null, "revert_to_snapshot_support": true, "access_rules_status": "active", "snapshot_id": null, "create_share_from_snapshot_support": true, "is_public": false, "task_state": null, "snapshot_support": true, "id": "133b0f35-7708-4f74-9eff-29b49b92de97", "size": 1, "source_share_group_snapshot_member_id": null, "user_id": "2644d4f3a0d844e49d2ff93e122cb48c", "name": "tempest-tempest-created-share-497849080", "share_type": "b8225358-9d2f-40c6-8e0a-d58f8f7ae57b", "has_replicas": false, "replication_type": null, "created_at": "2018-12-19T01:55:43.000000", "share_proto": "NFS", "volume_type": "tempest-share-type-720971903", "mount_snapshot_support": false, "project_id": "61339ae6b9214382a77c8bab80aa5177", "metadata": {}}}
2018-12-19 01:56:58.234580 | controller | 2018-12-19 01:56:58.233 | 2018-12-19 01:56:57,829 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:test_revert_to_previous_snapshot): 200 GET http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/shares/133b0f35-7708-4f74-9eff-29b49b92de97 0.077s
2018-12-19 01:56:58.238096 | controller | 2018-12-19 01:56:58.237 | 2018-12-19 01:56:57,830 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:56:58.243557 | controller | 2018-12-19 01:56:58.241 | Body: None
2018-12-19 01:56:58.247706 | controller | 2018-12-19 01:56:58.246 | Response - Headers: {'status': '200', u'content-length': '1229', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/shares/133b0f35-7708-4f74-9eff-29b49b92de97', u'x-compute-request-id': 'req-1358339e-3420-46a1-bef7-8486f77fbc45', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:57 GMT', u'content-type': 'application/json'}
2018-12-19 01:56:58.252094 | controller | 2018-12-19 01:56:58.250 | Body: {"share": {"status": "available", "share_type_name": "tempest-share-type-720971903", "description": "Tempest's share", "links": [{"href": "http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/shares/133b0f35-7708-4f74-9eff-29b49b92de97", "rel": "self"}, {"href": "http://158.69.68.107:8786/61339ae6b9214382a77c8bab80aa5177/shares/133b0f35-7708-4f74-9eff-29b49b92de97", "rel": "bookmark"}], "availability_zone": "nova", "share_network_id": "7e045699-eaed-47a4-a29f-88fe728fc0c0", "share_group_id": null, "revert_to_snapshot_support": true, "access_rules_status": "active", "snapshot_id": null, "create_share_from_snapshot_support": true, "is_public": false, "task_state": null, "snapshot_support": true, "id": "133b0f35-7708-4f74-9eff-29b49b92de97", "size": 1, "source_share_group_snapshot_member_id": null, "user_id": "2644d4f3a0d844e49d2ff93e122cb48c", "name": "tempest-tempest-created-share-497849080", "share_type": "b8225358-9d2f-40c6-8e0a-d58f8f7ae57b", "has_replicas": false, "replication_type": null, "created_at": "2018-12-19T01:55:43.000000", "share_proto": "NFS", "volume_type": "tempest-share-type-720971903", "mount_snapshot_support": false, "project_id": "61339ae6b9214382a77c8bab80aa5177", "metadata": {}}}
2018-12-19 01:57:00.669528 | controller | 2018-12-19 01:57:00.668 | 2018-12-19 01:56:57,863 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:_run_cleanups): 404 DELETE http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466 0.031s
2018-12-19 01:57:00.672522 | controller | 2018-12-19 01:57:00.671 | 2018-12-19 01:56:57,863 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:57:00.676231 | controller | 2018-12-19 01:57:00.674 | Body: None
2018-12-19 01:57:00.679760 | controller | 2018-12-19 01:57:00.678 | Response - Headers: {'status': '404', u'content-length': '78', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/6c9b69fe-607f-4c29-bc6e-367556bc6466', u'x-compute-request-id': 'req-2650ee95-4570-480d-b865-ca78d0ee0df9', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:57 GMT', u'content-type': 'application/json'}
2018-12-19 01:57:00.686285 | controller | 2018-12-19 01:57:00.681 | Body: {"itemNotFound": {"message": "The resource could not be found.", "code": 404}}
2018-12-19 01:57:00.692642 | controller | 2018-12-19 01:57:00.691 | 2018-12-19 01:56:57,866 24151 ERROR [manila_tempest_tests.tests.api.base] Suppressed cleanup error in Manila:
2018-12-19 01:57:00.696130 | controller | 2018-12-19 01:57:00.695 | Traceback (most recent call last):
2018-12-19 01:57:00.698980 | controller | 2018-12-19 01:57:00.698 | File "/opt/stack/new/manila-tempest-plugin/manila_tempest_tests/tests/api/base.py", line 914, in clear_resources
2018-12-19 01:57:00.701810 | controller | 2018-12-19 01:57:00.700 | client.delete_snapshot(res_id)
2018-12-19 01:57:00.704644 | controller | 2018-12-19 01:57:00.703 | File "/opt/stack/new/manila-tempest-plugin/manila_tempest_tests/services/share/v2/json/shares_client.py", line 518, in delete_snapshot
2018-12-19 01:57:00.707880 | controller | 2018-12-19 01:57:00.707 | resp, body = self.delete("snapshots/%s" % snap_id, version=version)
2018-12-19 01:57:00.710868 | controller | 2018-12-19 01:57:00.710 | File "/opt/stack/new/manila-tempest-plugin/manila_tempest_tests/services/share/v2/json/shares_client.py", line 75, in delete
2018-12-19 01:57:00.713345 | controller | 2018-12-19 01:57:00.712 | body=body)
2018-12-19 01:57:00.715734 | controller | 2018-12-19 01:57:00.715 | File "tempest/lib/common/rest_client.py", line 311, in delete
2018-12-19 01:57:00.718088 | controller | 2018-12-19 01:57:00.717 | return self.request('DELETE', url, extra_headers, headers, body)
2018-12-19 01:57:00.720907 | controller | 2018-12-19 01:57:00.720 | File "tempest/lib/common/rest_client.py", line 676, in request
2018-12-19 01:57:00.723643 | controller | 2018-12-19 01:57:00.722 | self._error_checker(resp, resp_body)
2018-12-19 01:57:00.727131 | controller | 2018-12-19 01:57:00.726 | File "tempest/lib/common/rest_client.py", line 782, in _error_checker
2018-12-19 01:57:00.729454 | controller | 2018-12-19 01:57:00.728 | raise exceptions.NotFound(resp_body, resp=resp)
2018-12-19 01:57:00.733579 | controller | 2018-12-19 01:57:00.731 | NotFound: Object not found
2018-12-19 01:57:00.733972 | controller | 2018-12-19 01:57:00.733 | Details: {u'message': u'The resource could not be found.', u'code': 404}
2018-12-19 01:57:00.736146 | controller | 2018-12-19 01:57:00.735 |
2018-12-19 01:57:00.739027 | controller | 2018-12-19 01:57:00.738 | 2018-12-19 01:56:57,927 24151 INFO [tempest.lib.common.rest_client] Request (RevertToSnapshotTest:_run_cleanups): 400 DELETE http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86 0.060s
2018-12-19 01:57:00.741770 | controller | 2018-12-19 01:57:00.740 | 2018-12-19 01:56:57,927 24151 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'x-openstack-manila-api-version': '2.46', 'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
2018-12-19 01:57:00.743244 | controller | 2018-12-19 01:57:00.742 | Body: None
2018-12-19 01:57:00.747220 | controller | 2018-12-19 01:57:00.745 | Response - Headers: {'status': '400', u'content-length': '128', 'content-location': 'http://158.69.68.107:8786/v2/61339ae6b9214382a77c8bab80aa5177/snapshots/89c3a4d8-4416-41df-bcd9-452b88c48a86', u'x-compute-request-id': 'req-e13f7e15-37c9-4e9d-a0e9-339924573c58', u'vary': 'X-OpenStack-Manila-API-Version', u'x-openstack-manila-api-version': '2.46', u'connection': 'close', u'date': 'Wed, 19 Dec 2018 01:56:57 GMT', u'content-type': 'application/json'}
2018-12-19 01:57:00.748085 | controller | 2018-12-19 01:57:00.747 | Body: {"badRequest": {"message": "Invalid share snapshot: Share Snapshot status must be one of ('available', 'error').", "code": 400}}

Tom Barron (tpb) wrote :

api log

Tom Barron (tpb) wrote :

data service log

Tom Barron (tpb) wrote :

scheduler service log

Tom Barron (tpb) wrote :

share service log

tags: added: tempest tests
tags: added: races
Jason Grosso (jgrosso) wrote :

Tom or Goutham are either of you taking this bug?

Tom Barron (tpb) wrote :

I'm not going to work on this one immediately and would rather leave it in backlog rather than assigned until someone is ready to pick it up and actually begin working on it.

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers