OpenStack Shared File Systems Service (Manila)

tempest test test_soft_delete_share_has_been_soft_deleted fails

Bug #2035562 reported by Goutham Pacha Ravi on 2023-09-14

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	OpenStack Shared File Systems Service (Manila)	Triaged	Low	Saravanan Manickam	OpenStack Shared File Systems Service (Manila) dalmatian-1

Bug Description

This bug records a test failure that's sporadically occurring in the container driver job:

The tempest test:

manila_tempest_tests.tests.api.test_shares_actions_negative.SharesActionsNegativeTest.
test_soft_delete_share_has_been_soft_deleted[api_with_backend,id-36cbe23b-08d2-49d9-bb42-f9eb2a804cb1,negative]

fails with:

Traceback (most recent call last):
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/tests/api/test_shares_actions_negative.py", line 307, in test_soft_delete_share_has_been_soft_deleted
    self.shares_v2_client.soft_delete_share(share['id'])
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/services/share/v2/json/shares_client.py", line 362, in soft_delete_share
    resp, body = self.post(
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/services/share/v2/json/shares_client.py", line 68, in post
    resp, body = super(SharesV2Client, self).post(url, body,
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 300, in post
    return self.request('POST', url, extra_headers, headers, body, chunked)
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 742, in request
    self._error_checker(resp, resp_body)
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 847, in _error_checker
    raise exceptions.Forbidden(resp_body, resp=resp)
tempest.lib.exceptions.Forbidden: Forbidden
Details: {'code': 403, 'message': "Policy doesn't allow share:soft_delete to be performed."}

---

the test in question creates the share with "shares_v2_client" and attempts to perform "soft-delete" with seemingly the same client: https://github.com/openstack/manila-tempest-plugin/blob/d6a4d27f49cc1d94df5ff5f4b240c1b0143f5328/manila_tempest_tests/tests/api/test_shares_actions_negative.py#L302-L307 but receives a "HTTP 403/Forbidden" response.

In the manila-api service, here's the failure:

Sep 13 22:37:15.350031 np0035244306 <email address hidden>[79815]: INFO manila.api.openstack.wsgi [None req-ceb646b4-2a36-43ef-97f7-668f71d5b106 tempest-test_creds-1192596402 tempest-test_creds-1192596402-project-reader] POST https://10.209.129.77/share/v2/7b25c1fbcc474492ba6a7205102312ba/shares/c20a0c4b-b7ac-43d5-a035-a45790d587ca/action
Sep 13 22:37:15.350629 np0035244306 <email address hidden>[79815]: DEBUG manila.api.openstack.wsgi [None req-ceb646b4-2a36-43ef-97f7-668f71d5b106 tempest-test_creds-1192596402 tempest-test_creds-1192596402-project-reader] Action body: b'{"soft_delete": null}' {{(pid=79815) get_method /opt/stack/manila/manila/api/openstack/wsgi.py:912}}
Sep 13 22:37:15.350935 np0035244306 <email address hidden>[79815]: DEBUG manila.api.openstack.wsgi [None req-ceb646b4-2a36-43ef-97f7-668f71d5b106 tempest-test_creds-1192596402 tempest-test_creds-1192596402-project-reader] Action: 'action', calling method: ShareController.share_soft_delete, body: {"soft_delete": null} {{(pid=79815) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:796}}
Sep 13 22:37:15.351406 np0035244306 <email address hidden>[79815]: DEBUG manila.api.v2.shares [None req-ceb646b4-2a36-43ef-97f7-668f71d5b106 tempest-test_creds-1192596402 tempest-test_creds-1192596402-project-reader] Soft delete share with id: c20a0c4b-b7ac-43d5-a035-a45790d587ca {{(pid=79815) share_soft_delete /opt/stack/manila/manila/api/v2/shares.py:273}}
Sep 13 22:37:15.374811 np0035244306 <email address hidden>[79815]: DEBUG manila.policy [None req-ceb646b4-2a36-43ef-97f7-668f71d5b106 tempest-test_creds-1192596402 tempest-test_creds-1192596402-project-reader] Policy check for share:soft_delete failed with credentials {'is_admin': False, 'user_id': 'f3253d33ef4347269f209c8a917b53af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b25c1fbcc474492ba6a7205102312ba', 'project_domain_id': 'default', 'roles': ['reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) authorize /opt/stack/manila/manila/policy.py:208}}
Sep 13 22:37:15.375298 np0035244306 <email address hidden>[79815]: INFO manila.api.openstack.wsgi [None req-ceb646b4-2a36-43ef-97f7-668f71d5b106 tempest-test_creds-1192596402 tempest-test_creds-1192596402-project-reader] https://10.209.129.77/share/v2/7b25c1fbcc474492ba6a7205102312ba/shares/c20a0c4b-b7ac-43d5-a035-a45790d587ca/action returned with HTTP 403

Log from the share creation request:

Sep 13 22:37:06.166428 np0035244306 <email address hidden>[79816]: INFO manila.api.openstack.wsgi [None req-1c491903-e4a5-4eec-a3e9-7b6d23e89165 tempest-test_creds-1192596402 tempest-test_creds-1192596402-project-reader] GET https://10.209.129.77/share/v2/7b25c1fbcc474492ba6a7205102312ba/shares/c20a0c4b-b7ac-43d5-a035-a45790d587ca
Sep 13 22:37:06.166843 np0035244306 <email address hidden>[79816]: DEBUG manila.api.openstack.wsgi [None req-1c491903-e4a5-4eec-a3e9-7b6d23e89165 tempest-test_creds-1192596402 tempest-test_creds-1192596402-project-reader] Empty body provided in request {{(pid=79816) get_body /opt/stack/manila/manila/api/openstack/wsgi.py:652}}
Sep 13 22:37:06.167390 np0035244306 <email address hidden>[79816]: DEBUG manila.api.openstack.wsgi [None req-1c491903-e4a5-4eec-a3e9-7b6d23e89165 tempest-test_creds-1192596402 tempest-test_creds-1192596402-project-reader] Calling method 'ShareMixin.show' {{(pid=79816) _process_stack /opt/stack/manila/manila/api/openstack/wsgi.py:798}}
Sep 13 22:37:06.193392 np0035244306 <email address hidden>[79816]: INFO manila.api.openstack.wsgi [None req-1c491903-e4a5-4eec-a3e9-7b6d23e89165 tempest-test_creds-1192596402 tempest-test_creds-1192596402-project-reader] https://10.209.129.77/share/v2/7b25c1fbcc474492ba6a7205102312ba/shares/c20a0c4b-b7ac-43d5-a035-a45790d587ca returned with HTTP 200

Tags:

Revision history for this message

Goutham Pacha Ravi (gouthamr) wrote on 2023-09-14 (last edit on 2023-09-14):

Tha failure has also been observed in the NetApp CI: https://netappopenstacklogserver.s3.us-west-1.amazonaws.com/index.html#logs/68/894168/4/upstream-check/manila-tempest-plugin-ontap-dhss/5eff904/controller/logs/

Vida Haririan (vhariria) on 2023-09-14

tags:

added: tempest

Vida Haririan (vhariria) on 2023-10-05

Changed in manila:
status:	New → Triaged

Vida Haririan (vhariria) on 2023-10-05

Changed in manila:
importance:	Undecided → Low
milestone:	none → caracal-2
milestone:	caracal-2 → caracal-1

Saravanan Manickam (msaravan) on 2023-10-05

Changed in manila:
assignee:	nobody → Saravanan Manickam (msaravan)

Revision history for this message

Vida Haririan (vhariria) wrote on 2023-10-05:

See additional related discussions at https://meetings.opendev.org/meetings/manila/2023/manila.2023-10-05-15.00

Goutham Pacha Ravi (gouthamr) on 2023-11-16

Changed in manila:
milestone:	caracal-1 → caracal-2

Carlos Eduardo (silvacarlose) on 2024-01-23

Changed in manila:
milestone:	caracal-2 → caracal-rc1

Revision history for this message

Saravanan Manickam (msaravan) wrote on 2024-03-08:

Download full text (28.1 KiB)

Al the 3 tests are failing most of the time with permission error:

1. test_restore_share_with_wrong_id[api,id-87345725-f187-4d7d-86b1-62284e8c75ae,negative] :

ft1.12: manila_tempest_tests.tests.api.test_shares_actions_negative.SharesActionsNegativeTest.test_restore_share_with_wrong_id[api,id-87345725-f187-4d7d-86b1-62284e8c75ae,negative]testtools.testresult.real._StringException: pythonlogging:'': {{{
2024-03-08 08:22:12,996 91591 INFO [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:test_restore_share_with_wrong_id): 403 POST https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/wrong_share_id/action 0.027s
2024-03-08 08:22:12,996 91591 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: {"restore": null}
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:22:12 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'content-length': '78', 'content-type': 'application/json', 'x-compute-request-id': 'req-3e94a28c-8e21-4b1d-ac08-6f30d26e147d', 'connection': 'close', 'status': '403', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/wrong_share_id/action'}
        Body: b'{"forbidden": {"code": 403, "message": "Access was denied to this resource."}}'
}}}

Al the 3 tests are failing most of the time with permission error:

1. test_restore_share_with_wrong_id[api,id-87345725-f187-4d7d-86b1-62284e8c75ae,negative] :

ft1.12: manila_tempest_tests.tests.api.test_shares_actions_negative.SharesActionsNegativeTest.test_restore_share_with_wrong_id[api,id-87345725-f187-4d7d-86b1-62284e8c75ae,negative]testtools.testresult.real._StringException: pythonlogging:'': {{{
2024-03-08 08:22:12,996 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:test_restore_share_with_wrong_id): 403 POST https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/wrong_share_id/action 0.027s
2024-03-08 08:22:12,996 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: {"restore": null}
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:22:12 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'content-length': '78', 'content-type': 'application/json', 'x-compute-request-id': 'req-3e94a28c-8e21-4b1d-ac08-6f30d26e147d', 'connection': 'close', 'status': '403', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/wrong_share_id/action'}
        Body: b'{"forbidden": {"code": 403, "message": "Access was denied to this resource."}}'
}}}

Traceback (most recent call last):
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/tests/api/test_shares_actions_negative.py", line 362, in test_restore_share_with_wrong_id
    self.assertRaises(lib_exc.NotFound,
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/testcase.py", line 469, in assertRaises
    self.assertThat(our_callable, matcher)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/testcase.py", line 480, in assertThat
    mismatch_error = self._matchHelper(matchee, matcher, message, verbose)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/testcase.py", line 532, in _matchHelper
    mismatch = matcher.match(matchee)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/matchers/_exception.py", line 104, in match
    mismatch = self.exception_matcher.match(exc_info)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/matchers/_higherorder.py", line 62, in match
    mismatch = matcher.match(matchee)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/testcase.py", line 459, in match
    reraise(*matchee)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/compat.py", line 26, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/matchers/_exception.py", line 97, in match
    result = matchee()
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/testcase.py", line 1041, in __call__
    return self._callable_object(*self._args, **self._kwargs)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/services/share/v2/json/shares_client.py", line 370, in restore_share
    resp, body = self.post(
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/services/share/v2/json/shares_client.py", line 68, in post
    resp, body = super(SharesV2Client, self).post(url, body,
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 300, in post
    return self.request('POST', url, extra_headers, headers, body, chunked)
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 742, in request
    self._error_checker(resp, resp_body)
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 847, in _error_checker
    raise exceptions.Forbidden(resp_body, resp=resp)
tempest.lib.exceptions.Forbidden: Forbidden
Details: {'code': 403, 'message': 'Access was denied to this resource.'}

2. test_soft_delete_share_has_been_soft_deleted[api_with_backend,id-36cbe23b-08d2-49d9-bb42-f9eb2a804cb1,negative] :

ft1.22: manila_tempest_tests.tests.api.test_shares_actions_negative.SharesActionsNegativeTest.test_soft_delete_share_has_been_soft_deleted[api_with_backend,id-36cbe23b-08d2-49d9-bb42-f9eb2a804cb1,negative]testtools.testresult.real._StringException: pythonlogging:'': {{{
2024-03-08 08:22:52,700 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:test_soft_delete_share_has_been_soft_deleted): 200 POST https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares 0.294s
2024-03-08 08:22:52,701 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: {"share": {"share_proto": "nfs", "description": "Tempest's share", "snapshot_id": null, "name": "tempest-tempest-created-share-1508639927", "size": 1, "metadata": {}, "is_public": false, "share_network_id": "8ecef2f8-e5dd-482e-9bc2-e2277cb42318", "share_type": "a72750c5-d1fd-43bb-912e-ec65069531a6"}}
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:22:52 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'content-type': 'application/json', 'content-length': '1351', 'x-compute-request-id': 'req-5bea833d-5a2b-4713-813b-25c47f3a08cc', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'connection': 'close', 'status': '200', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares'}
        Body: b'{"share": {"id": "9692f2a7-d393-444a-abc0-2b83e2513da2", "size": 1, "availability_zone": null, "created_at": "2024-03-08T08:22:52.580131", "status": "creating", "name": "tempest-tempest-created-share-1508639927", "description": "Tempest\'s share", "project_id": "2807aa1ed1134e818c1137d3ab48d590", "snapshot_id": null, "share_network_id": "8ecef2f8-e5dd-482e-9bc2-e2277cb42318", "share_proto": "NFS", "metadata": {}, "share_type": "a72750c5-d1fd-43bb-912e-ec65069531a6", "volume_type": "tempest-typeshare-type-1785583195", "links": [{"rel": "self", "href": "https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}, {"rel": "bookmark", "href": "https://***.***.***.***/share/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}], "is_public": false, "snapshot_support": true, "task_state": null, "share_type_name": "tempest-typeshare-type-1785583195", "access_rules_status": "active", "replication_type": null, "has_replicas": false, "user_id": "93e634fb1e6d44b4a9c7843ddea74359", "create_share_from_snapshot_support": false, "revert_to_snapshot_support": false, "share_group_id": null, "source_share_group_snapshot_member_id": null, "mount_snapshot_support": false, "progress": null, "is_soft_deleted": false, "scheduled_to_be_deleted_at": null, "source_backup_id": null}}'
2024-03-08 08:22:52,766 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:test_soft_delete_share_has_been_soft_deleted): 200 GET https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2 0.065s
2024-03-08 08:22:52,766 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:22:52 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'content-type': 'application/json', 'content-length': '1351', 'x-compute-request-id': 'req-72fd6138-38a3-43c7-bf77-e40cef47e203', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'connection': 'close', 'status': '200', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2'}
        Body: b'{"share": {"id": "9692f2a7-d393-444a-abc0-2b83e2513da2", "size": 1, "availability_zone": null, "created_at": "2024-03-08T08:22:52.580131", "status": "creating", "name": "tempest-tempest-created-share-1508639927", "description": "Tempest\'s share", "project_id": "2807aa1ed1134e818c1137d3ab48d590", "snapshot_id": null, "share_network_id": "8ecef2f8-e5dd-482e-9bc2-e2277cb42318", "share_proto": "NFS", "metadata": {}, "share_type": "a72750c5-d1fd-43bb-912e-ec65069531a6", "volume_type": "tempest-typeshare-type-1785583195", "links": [{"rel": "self", "href": "https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}, {"rel": "bookmark", "href": "https://***.***.***.***/share/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}], "is_public": false, "snapshot_support": true, "task_state": null, "share_type_name": "tempest-typeshare-type-1785583195", "access_rules_status": "active", "replication_type": null, "has_replicas": false, "user_id": "93e634fb1e6d44b4a9c7843ddea74359", "create_share_from_snapshot_support": false, "revert_to_snapshot_support": false, "share_group_id": null, "source_share_group_snapshot_member_id": null, "mount_snapshot_support": false, "progress": null, "is_soft_deleted": false, "scheduled_to_be_deleted_at": null, "source_backup_id": null}}'
2024-03-08 08:22:55,816 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:test_soft_delete_share_has_been_soft_deleted): 200 GET https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2 0.046s
2024-03-08 08:22:55,817 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:22:55 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'content-type': 'application/json', 'content-length': '1362', 'x-compute-request-id': 'req-5ae1253c-0473-4c1f-988f-d24ce908dfe1', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'connection': 'close', 'status': '200', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2'}
        Body: b'{"share": {"id": "9692f2a7-d393-444a-abc0-2b83e2513da2", "size": 1, "availability_zone": "manila-zone-1", "created_at": "2024-03-08T08:22:52.580131", "status": "creating", "name": "tempest-tempest-created-share-1508639927", "description": "Tempest\'s share", "project_id": "2807aa1ed1134e818c1137d3ab48d590", "snapshot_id": null, "share_network_id": "8ecef2f8-e5dd-482e-9bc2-e2277cb42318", "share_proto": "NFS", "metadata": {}, "share_type": "a72750c5-d1fd-43bb-912e-ec65069531a6", "volume_type": "tempest-typeshare-type-1785583195", "links": [{"rel": "self", "href": "https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}, {"rel": "bookmark", "href": "https://***.***.***.***/share/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}], "is_public": false, "snapshot_support": true, "task_state": null, "share_type_name": "tempest-typeshare-type-1785583195", "access_rules_status": "active", "replication_type": null, "has_replicas": false, "user_id": "93e634fb1e6d44b4a9c7843ddea74359", "create_share_from_snapshot_support": false, "revert_to_snapshot_support": false, "share_group_id": null, "source_share_group_snapshot_member_id": null, "mount_snapshot_support": false, "progress": null, "is_soft_deleted": false, "scheduled_to_be_deleted_at": null, "source_backup_id": null}}'
2024-03-08 08:22:58,881 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:test_soft_delete_share_has_been_soft_deleted): 200 GET https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2 0.060s
2024-03-08 08:22:58,881 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:22:58 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'content-type': 'application/json', 'content-length': '1365', 'x-compute-request-id': 'req-5e607ee9-70c3-405b-99fe-9111d39cb4cf', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'connection': 'close', 'status': '200', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2'}
        Body: b'{"share": {"id": "9692f2a7-d393-444a-abc0-2b83e2513da2", "size": 1, "availability_zone": "manila-zone-1", "created_at": "2024-03-08T08:22:52.580131", "status": "available", "name": "tempest-tempest-created-share-1508639927", "description": "Tempest\'s share", "project_id": "2807aa1ed1134e818c1137d3ab48d590", "snapshot_id": null, "share_network_id": "8ecef2f8-e5dd-482e-9bc2-e2277cb42318", "share_proto": "NFS", "metadata": {}, "share_type": "a72750c5-d1fd-43bb-912e-ec65069531a6", "volume_type": "tempest-typeshare-type-1785583195", "links": [{"rel": "self", "href": "https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}, {"rel": "bookmark", "href": "https://***.***.***.***/share/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}], "is_public": false, "snapshot_support": true, "task_state": null, "share_type_name": "tempest-typeshare-type-1785583195", "access_rules_status": "active", "replication_type": null, "has_replicas": false, "user_id": "93e634fb1e6d44b4a9c7843ddea74359", "create_share_from_snapshot_support": false, "revert_to_snapshot_support": false, "share_group_id": null, "source_share_group_snapshot_member_id": null, "mount_snapshot_support": false, "progress": "100%", "is_soft_deleted": false, "scheduled_to_be_deleted_at": null, "source_backup_id": null}}'
2024-03-08 08:22:58,914 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:test_soft_delete_share_has_been_soft_deleted): 403 POST https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2/action 0.032s
2024-03-08 08:22:58,915 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: {"soft_delete": null}
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:22:58 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'content-length': '78', 'content-type': 'application/json', 'x-compute-request-id': 'req-cb6ef7ed-6bad-4309-8e62-d2a67e7c1b70', 'connection': 'close', 'status': '403', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2/action'}
        Body: b'{"forbidden": {"code": 403, "message": "Access was denied to this resource."}}'
2024-03-08 08:22:58,960 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:_run_cleanups): 200 GET https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/share-replicas/detail?share_id=9692f2a7-d393-444a-abc0-2b83e2513da2 0.042s
2024-03-08 08:22:58,960 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:22:58 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'content-type': 'application/json', 'content-length': '22', 'x-compute-request-id': 'req-cfc2d92f-bbab-4044-bc89-120aed05ab76', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'connection': 'close', 'status': '200', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/share-replicas/detail?share_id=9692f2a7-d393-444a-abc0-2b83e2513da2'}
        Body: b'{"share_replicas": []}'
2024-03-08 08:22:59,167 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:_run_cleanups): 202 DELETE https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2 0.204s
2024-03-08 08:22:59,168 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:22:58 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'content-length': '0', 'content-type': 'text/html; charset=UTF-8', 'x-compute-request-id': 'req-786af6b8-d486-42ce-bfe2-ae0c840ef725', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'connection': 'close', 'status': '202', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2'}
        Body: b''
2024-03-08 08:22:59,215 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:_run_cleanups): 200 GET https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2 0.046s
2024-03-08 08:22:59,216 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:22:59 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'content-type': 'application/json', 'content-length': '1364', 'x-compute-request-id': 'req-56d74ed6-21b0-4a10-a745-0f9c608637a5', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'connection': 'close', 'status': '200', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2'}
        Body: b'{"share": {"id": "9692f2a7-d393-444a-abc0-2b83e2513da2", "size": 1, "availability_zone": "manila-zone-1", "created_at": "2024-03-08T08:22:52.580131", "status": "deleting", "name": "tempest-tempest-created-share-1508639927", "description": "Tempest\'s share", "project_id": "2807aa1ed1134e818c1137d3ab48d590", "snapshot_id": null, "share_network_id": "8ecef2f8-e5dd-482e-9bc2-e2277cb42318", "share_proto": "NFS", "metadata": {}, "share_type": "a72750c5-d1fd-43bb-912e-ec65069531a6", "volume_type": "tempest-typeshare-type-1785583195", "links": [{"rel": "self", "href": "https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}, {"rel": "bookmark", "href": "https://***.***.***.***/share/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}], "is_public": false, "snapshot_support": true, "task_state": null, "share_type_name": "tempest-typeshare-type-1785583195", "access_rules_status": "active", "replication_type": null, "has_replicas": false, "user_id": "93e634fb1e6d44b4a9c7843ddea74359", "create_share_from_snapshot_support": false, "revert_to_snapshot_support": false, "share_group_id": null, "source_share_group_snapshot_member_id": null, "mount_snapshot_support": false, "progress": "100%", "is_soft_deleted": false, "scheduled_to_be_deleted_at": null, "source_backup_id": null}}'
2024-03-08 08:23:02,275 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:_run_cleanups): 200 GET https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2 0.057s
2024-03-08 08:23:02,276 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:23:02 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'content-type': 'application/json', 'content-length': '1364', 'x-compute-request-id': 'req-13cb8648-78f0-473f-8d39-ebe157c0efbc', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'connection': 'close', 'status': '200', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2'}
        Body: b'{"share": {"id": "9692f2a7-d393-444a-abc0-2b83e2513da2", "size": 1, "availability_zone": "manila-zone-1", "created_at": "2024-03-08T08:22:52.580131", "status": "deleting", "name": "tempest-tempest-created-share-1508639927", "description": "Tempest\'s share", "project_id": "2807aa1ed1134e818c1137d3ab48d590", "snapshot_id": null, "share_network_id": "8ecef2f8-e5dd-482e-9bc2-e2277cb42318", "share_proto": "NFS", "metadata": {}, "share_type": "a72750c5-d1fd-43bb-912e-ec65069531a6", "volume_type": "tempest-typeshare-type-1785583195", "links": [{"rel": "self", "href": "https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}, {"rel": "bookmark", "href": "https://***.***.***.***/share/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2"}], "is_public": false, "snapshot_support": true, "task_state": null, "share_type_name": "tempest-typeshare-type-1785583195", "access_rules_status": "active", "replication_type": null, "has_replicas": false, "user_id": "93e634fb1e6d44b4a9c7843ddea74359", "create_share_from_snapshot_support": false, "revert_to_snapshot_support": false, "share_group_id": null, "source_share_group_snapshot_member_id": null, "mount_snapshot_support": false, "progress": "100%", "is_soft_deleted": false, "scheduled_to_be_deleted_at": null, "source_backup_id": null}}'
2024-03-08 08:23:05,349 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:_run_cleanups): 404 GET https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2 0.068s
2024-03-08 08:23:05,350 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:23:05 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'content-length': '78', 'content-type': 'application/json', 'x-compute-request-id': 'req-3243ce3b-c222-4bff-87c9-9ec69ee4200b', 'connection': 'close', 'status': '404', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/9692f2a7-d393-444a-abc0-2b83e2513da2'}
        Body: b'{"itemNotFound": {"code": 404, "message": "The resource could not be found."}}'
}}}

Traceback (most recent call last):
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/tests/api/test_shares_actions_negative.py", line 306, in test_soft_delete_share_has_been_soft_deleted
    self.shares_v2_client.soft_delete_share(share['id'])
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/services/share/v2/json/shares_client.py", line 362, in soft_delete_share
    resp, body = self.post(
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/services/share/v2/json/shares_client.py", line 68, in post
    resp, body = super(SharesV2Client, self).post(url, body,
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 300, in post
    return self.request('POST', url, extra_headers, headers, body, chunked)
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 742, in request
    self._error_checker(resp, resp_body)
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 847, in _error_checker
    raise exceptions.Forbidden(resp_body, resp=resp)
tempest.lib.exceptions.Forbidden: Forbidden
Details: {'code': 403, 'message': 'Access was denied to this resource.'}

3. test_soft_delete_share_with_wrong_id[api,id-0ccd44dd-2fda-403e-bc23-7ce428550f36,negative]:

ft1.24: manila_tempest_tests.tests.api.test_shares_actions_negative.SharesActionsNegativeTest.test_soft_delete_share_with_wrong_id[api,id-0ccd44dd-2fda-403e-bc23-7ce428550f36,negative]testtools.testresult.real._StringException: pythonlogging:'': {{{
2024-03-08 08:23:18,567 91591 INFO     [tempest.lib.common.rest_client] Request (SharesActionsNegativeTest:test_soft_delete_share_with_wrong_id): 403 POST https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/wrong_share_id/action 0.028s
2024-03-08 08:23:18,568 91591 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'x-openstack-manila-api-version': '2.81', 'X-Auth-Token': '<omitted>'}
        Body: {"soft_delete": null}
    Response - Headers: {'date': 'Fri, 08 Mar 2024 08:23:18 GMT', 'server': 'Apache/2.4.52 (Ubuntu)', 'x-openstack-manila-api-version': '2.81', 'vary': 'X-OpenStack-Manila-API-Version', 'content-length': '78', 'content-type': 'application/json', 'x-compute-request-id': 'req-2777ec32-a9e4-4d11-bec0-f7760d88c0fe', 'connection': 'close', 'status': '403', 'content-location': 'https://***.***.***.***/share/v2/2807aa1ed1134e818c1137d3ab48d590/shares/wrong_share_id/action'}
        Body: b'{"forbidden": {"code": 403, "message": "Access was denied to this resource."}}'
}}}

Traceback (most recent call last):
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/tests/api/test_shares_actions_negative.py", line 354, in test_soft_delete_share_with_wrong_id
    self.assertRaises(lib_exc.NotFound,
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/testcase.py", line 469, in assertRaises
    self.assertThat(our_callable, matcher)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/testcase.py", line 480, in assertThat
    mismatch_error = self._matchHelper(matchee, matcher, message, verbose)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/testcase.py", line 532, in _matchHelper
    mismatch = matcher.match(matchee)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/matchers/_exception.py", line 104, in match
    mismatch = self.exception_matcher.match(exc_info)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/matchers/_higherorder.py", line 62, in match
    mismatch = matcher.match(matchee)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/testcase.py", line 459, in match
    reraise(*matchee)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/compat.py", line 26, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/matchers/_exception.py", line 97, in match
    result = matchee()
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/testtools/testcase.py", line 1041, in __call__
    return self._callable_object(*self._args, **self._kwargs)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/services/share/v2/json/shares_client.py", line 362, in soft_delete_share
    resp, body = self.post(
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/manila_tempest_tests/services/share/v2/json/shares_client.py", line 68, in post
    resp, body = super(SharesV2Client, self).post(url, body,
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 300, in post
    return self.request('POST', url, extra_headers, headers, body, chunked)
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 742, in request
    self._error_checker(resp, resp_body)
  File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 847, in _error_checker
    raise exceptions.Forbidden(resp_body, resp=resp)
tempest.lib.exceptions.Forbidden: Forbidden
Details: {'code': 403, 'message': 'Access was denied to this resource.'}

Revision history for this message

Saravanan Manickam (msaravan) wrote on 2024-03-13:

Need to include this bug also, in case if it is continuoulsy failing. Expecting, it'll not, Just adding
it to not to miss the tracking.

test_manage_share_server_1_True

Goutham Pacha Ravi (gouthamr) on 2024-04-16

Changed in manila:
milestone:	caracal-rc1 → dalmation-1

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.