tempest cleanup fails after removing keystone v2

[wes hayutin]

gnocchi.tempest.scenario.GnocchiGabbiTest.test_search_resource

https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-master/6c565fd/undercloud/home/jenkins/tempest_output.log.txt.gz#_2017-10-18_09_23_34

https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset006-master/8a1792a/undercloud/home/jenkins/tempest_output.log.txt.gz#_2017-10-18_09_26_50

gnocchi.tempest.scenario.GnocchiGabbiTest.test_search_resource
2017-10-18 09:23:29 | + /usr/bin/tempest list-plugins
2017-10-18 09:23:31 | +------------------+---------------------------------------------------------+
2017-10-18 09:23:31 | | Name | EntryPoint |
2017-10-18 09:23:31 | +------------------+---------------------------------------------------------+
2017-10-18 09:23:31 | | panko_tests | panko.tests.tempest.plugin:PankoTempestPlugin |
2017-10-18 09:23:31 | | gnocchi_tests | gnocchi.tempest.plugin:GnocchiTempestPlugin |
2017-10-18 09:23:31 | | ceilometer_tests | ceilometer.tests.tempest.plugin:CeilometerTempestPlugin |
2017-10-18 09:23:31 | | aodh_tests | aodh.tests.tempest.plugin:AodhTempestPlugin |
2017-10-18 09:23:31 | +------------------+---------------------------------------------------------+
2017-10-18 09:23:31 | + /usr/bin/tempest cleanup --init-saved-state
2017-10-18 09:23:34 | Traceback (most recent call last):
2017-10-18 09:23:34 | File "/usr/lib/python2.7/site-packages/tempest/cmd/cleanup.py", line 95, in take_action
2017-10-18 09:23:34 | self.init(parsed_args)
2017-10-18 09:23:34 | File "/usr/lib/python2.7/site-packages/tempest/cmd/cleanup.py", line 104, in init
2017-10-18 09:23:34 | cleanup_service.init_conf()
2017-10-18 09:23:34 | File "/usr/lib/python2.7/site-packages/tempest/cmd/cleanup_service.py", line 76, in init_conf
2017-10-18 09:23:34 | CONF.auth.admin_project_name)
2017-10-18 09:23:34 | File "/usr/lib/python2.7/site-packages/tempest/cmd/cleanup_service.py", line 87, in _get_network_id
2017-10-18 09:23:34 | tenant = identity.get_tenant_by_name(tn_cl, project_name)
2017-10-18 09:23:34 | File "/usr/lib/python2.7/site-packages/tempest/common/identity.py", line 24, in get_tenant_by_name
2017-10-18 09:23:34 | tenants = client.list_tenants()['tenants']
2017-10-18 09:23:34 | File "/usr/lib/python2.7/site-packages/tempest/lib/services/identity/v2/tenants_client.py", line 70, in list_tenants
2017-10-18 09:23:34 | resp, body = self.get(url)
2017-10-18 09:23:34 | File "/usr/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 294, in get
2017-10-18 09:23:34 | return self.request('GET', url, extra_headers, headers)
2017-10-18 09:23:34 | File "/usr/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 668, in request
2017-10-18 09:23:34 | self._error_checker(resp, resp_body)
2017-10-18 09:23:34 | File "/usr/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 774, in _error_checker
2017-10-18 09:23:34 | raise exceptions.NotFound(resp_body, resp=resp)
2017-10-18 09:23:34 | NotFound: Object not found
2017-10-18 09:23:34 | Details: {u'message': u'(http://192.168.24.15:35357/v2.0/tenants): The resource could not be found.', u'code': 404, u'title': u'Not Found'}

[Arx Cruz (arxcruz)]

It seems that the cleanup command in this particular version of tempest (openstack-tempest-17.0.1-0.20171018071546.09801f9.el7.centos.noarch) is still using v2 to list tenants.

[wes hayutin (weshayutin)]

related bug https://bugs.launchpad.net/tempest/+bug/1659065

[wes hayutin (weshayutin)]

related change https://review.openstack.org/#/c/506751/

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/513145

[wes hayutin (weshayutin)]

possible fix https://review.openstack.org/#/c/513145/

[Alfredo Moralejo (amoralej)]

This is a bug in tempest, "tempest cleanup --init-saved-state" doesn't work with keystone api v3 even if we enforce auth_version=3 and disable tempest api_v2 in tempest configuration. It seems to need someone familiar with tempest to fix it.

As workaround in TripleO, i think we can temporarily remove tempest cleanup commands in the tempest validation tests.

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/513431

[Alex Schultz (alex-schultz)]

Alfredo, the original error is different than that. There's another bug for the tempest cleanup

[OpenStack Infra (hudson-openstack)]

Change abandoned by Alex Schultz (<email address hidden>) on branch: master
Review: https://review.openstack.org/513145
Reason: I don't think we need this for the referenced bug.

[OpenStack Infra (hudson-openstack)]

Change abandoned by Alfredo Moralejo (<email address hidden>) on branch: master
Review: https://review.openstack.org/513431

[chandan kumar (chkumar246)]

Here is the WIP review https://review.openstack.org/#/c/513672/

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/513672
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=05fe4bcb35c4c7b3933b016a710fb3a0627e9b43
Submitter: Zuul
Branch: master

commit 05fe4bcb35c4c7b3933b016a710fb3a0627e9b43
Author: Arx Cruz <email address hidden>
Date: Fri Oct 20 10:48:28 2017 +0200

    Remove v2 identity from tempest cleanup command

    This patch remove the calls for v2 identity in the tempest
    cleanup command.

    Change-Id: I74d171b65d036ed3f665b1a8dec17dc5ed73eb07
    Closes-Bug: 1659065
    Closes-Bug: 1724599

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tempest 17.2.0 release.