When running Tempest against a juju deployed cloud, the octavia testing fails during the setupClass of octavia_tempest_plugin.tests.scenario.v2.test_traffic_ops.TrafficOperationsScenarioTest when it attempts to get the list of role assignments with dynamically created users.
[Test Case]
git clone https://github.com/openstack-charmers/charmed-openstack-tester
cd charmed-openstack-tester
tox -e func-target -- focal-xena
2022-03-03 19:26:31.221 20767 INFO tempest.lib.common.rest_client [req-9175ea33-e270-48d0-ab28-1caf93f30263 ] Request (TrafficOperationsScenarioTest:setUpClass): 201 POST https://10.5.2.69:5000/v3/auth/tokens 0.628s
2022-03-03 19:26:31.221 20767 DEBUG tempest.lib.common.rest_client [req-9175ea33-e270-48d0-ab28-1caf93f30263 ] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json'}
Body: <omitted>
Response - Headers: {'date': 'Thu, 03 Mar 2022 19:26:30 GMT', 'server': 'Apache/2.4.41 (Ubuntu)', 'content-length': '10009', 'x-subject-token': '<omitted>', 'vary': 'X-Auth-Token', 'x-openstack-request-id': 'req-9175ea33-e270-48d0-ab28-1caf93f30263', 'content-type': 'application/json', 'connection': 'close', 'status': '201', 'content-location': 'https://10.5.2.69:5000/v3/auth/tokens'}
Body: b'{"token": {"methods": ["password"], "user": {"domain": {"id": "c3cc5dc7f4364ea7a1fa1740aad8b85f", "name": "admin_domain"}, "id": "2acc17da5a39459abd8a879e028c52f1", "name": "tempest-TrafficOperationsScenarioTest-1307197676-project-load-balancer_member", "password_expires_at": null}, "audit_ids": ["juQURj6FSyGm3CqbvtQNzA"], "expires_at": "2022-03-03T20:26:31.000000Z", "issued_at": "2022-03-03T19:26:31.000000Z", "project": {"domain": {"id": "c3cc5dc7f4364ea7a1fa1740aad8b85f", "name": "admin_domain"}, "id": "214e73c9934c490c95a7d82d25aa0f8e", "name": "tempest-TrafficOperationsScenarioTest-1307197676"}, "is_domain": false, "roles": [{"id": "e1fa6ee1a2ef41aead97ccbd9fae0960", "name": "load-balancer_member"}], "is_admin_project": false, "catalog": [{"endpoints": [{"id": "5b61f1ea9c9749dab2ac14105e330fe0", "interface": "internal", "region_id": "RegionOne", "url": "https://10.5.3.130:8080", "region": "RegionOne"}, {"id": "5e2749bd83a5422f94b67994e3c1c198", "interface": "admin", "region_id": "RegionOne", "url": "https://10.5.3.130:8080", "region": "RegionOne"}, {"id": "ba7c9e2871fb467aa52789050c78a9ac", "interface": "public", "region_id": "RegionOne", "url": "https://10.5.3.130:8080", "region": "RegionOne"}], "id": "2873e17f7b2e46d0bd71500b8c81639f", "type": "s3", "name": "s3"}, {"endpoints": [{"id": "42024441bab1444c846b0a0cd255d45a", "interface": "internal", "region_id": "RegionOne", "url": "https://10.5.3.168:8000/v1", "region": "RegionOne"}, {"id": "c22afdc16d7349f4ae9508a5d75d46f7", "interface": "admin", "region_id": "RegionOne", "url": "https://10.5.3.168:8000/v1", "region": "RegionOne"}, {"id": "f698bb51670e4efaa9993c81f74469d4", "interface": "public", "region_id": "RegionOne", "url": "https://10.5.3.168:8000/v1", "region": "RegionOne"}], "id": "32878215ed93477ca709e3ca2c7cf6e5", "type": "cloudformation", "name": "heat-cfn"}, {"endpoints": [{"id": "2d33a3f5252c4976a02d7a0ad239bcb9", "interface": "admin", "region_id": "RegionOne", "url": "https://10.5.2.247:9876", "region": "RegionOne"}, {"id": "3276792010014737a7342cfa0380c364", "interface": "internal", "region_id": "RegionOne", "url": "https://10.5.2.247:9876", "region": "RegionOne"}, {"id": "6b2c8291fcca4b6c93a4e3db204cf529", "interface": "public", "region_id": "RegionOne", "url": "https://10.5.2.247:9876", "region": "RegionOne"}], "id": "4bc41ecbfb3a4d0fbc0069de09de9782", "type": "load-balancer", "name": "octavia"}, {"endpoints": [{"id": "1d3d101417144cd4b928a90ae6bc18bd", "interface": "admin", "region_id": "RegionOne", "url": "https://10.5.3.63:9312", "region": "RegionOne"}, {"id": "90bf6076d4494a1a946fa8d81b888a9b", "interface": "public", "region_id": "RegionOne", "url": "https://10.5.3.63:9311", "region": "RegionOne"}, {"id": "c8b9a0910a284c1ea2f03a68e6fc6eaa", "interface": "internal", "region_id": "RegionOne", "url": "https://10.5.3.63:9311", "region": "RegionOne"}], "id": "4fd1b5d008c44a57b6fa66ac39914801", "type": "key-manager", "name": "barbican"}, {"endpoints": [{"id": "12bc6d2985f7417080bd61376fc8028d", "interface": "admin", "region_id": "RegionOne", "url": "https://10.5.3.130:8080/simplestreams/data/", "region": "RegionOne"}, {"id": "4c61773612ea4472b115ce3ae638a021", "interface": "internal", "region_id": "RegionOne", "url": "https://10.5.3.130:8080/v1/AUTH_4ea5904a477e4b98a4a4280119fa1bd7/simplestreams/data/", "region": "RegionOne"}, {"id": "dbf54c0067ee453e9d4e65ad94019968", "interface": "public", "region_id": "RegionOne", "url": "https://10.5.3.130:8080/v1/AUTH_4ea5904a477e4b98a4a4280119fa1bd7/simplestreams/data/", "region": "RegionOne"}], "id": "5a61023ebac0415cad5b09f75d47aa43", "type": "product-streams", "name": "image-stream"}, {"endpoints": [{"id": "333971172573444d95e2c30d794d4a4e", "interface": "internal", "region_id": "RegionOne", "url": "https://10.5.3.168:8004/v1/214e73c9934c490c95a7d82d25aa0f8e", "region": "RegionOne"}, {"id": "4bd8b1367a3040b6b3cdc8fd36aabf96", "interface": "admin", "region_id": "RegionOne", "url": "https://10.5.3.168:8004/v1/214e73c9934c490c95a7d82d25aa0f8e", "region": "RegionOne"}, {"id": "75b1e6c9438746cf96cb22c7d4794aa1", _log_request_full /home/ubuntu/git/charmed-openstack-tester/.tox/func-target/lib/python3.6/site-packages/tempest/lib/common/rest_client.py:456
2022-03-03 19:26:31.372 20767 INFO tempest.lib.common.rest_client [req-f7e30cc3-f01c-4131-b30b-70a649fd3fa8 ] Request (TrafficOperationsScenarioTest:setUpClass): 403 GET https://10.5.2.69:35357/v3/role_assignments?user.id=e2705ac2e28044089be934acdb88cef1&project.id=bacfe18b08fe400d84e2b9b042f44fbe 0.149s
2022-03-03 19:26:31.372 20767 DEBUG tempest.lib.common.rest_client [req-f7e30cc3-f01c-4131-b30b-70a649fd3fa8 ] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
Body: None
Response - Headers: {'date': 'Thu, 03 Mar 2022 19:26:31 GMT', 'server': 'Apache/2.4.41 (Ubuntu)', 'content-length': '143', 'vary': 'X-Auth-Token', 'x-openstack-request-id': 'req-f7e30cc3-f01c-4131-b30b-70a649fd3fa8', 'content-type': 'application/json', 'connection': 'close', 'status': '403', 'content-location': 'https://10.5.2.69:35357/v3/role_assignments?user.id=e2705ac2e28044089be934acdb88cef1&project.id=bacfe18b08fe400d84e2b9b042f44fbe'}
Body: b'{"error":{"code":403,"message":"You are not authorized to perform the requested action: identity:list_role_assignments.","title":"Forbidden"}}\n' _log_request_full /home/ubuntu/git/charmed-openstack-tester/.tox/func-target/lib/python3.6/site-packages/tempest/lib/common/rest_client.py:456
I'm adding a task for charm-keystone because it owns the policy.json that could be breaking the assumptions of tempest when creating the users.