Add tempest functional test coverage to OpenStack charms

Bug #1881140 reported by Corey Bryant on 2020-05-28
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack AODH Charm
Wishlist
Unassigned
OpenStack Barbican Charm
Wishlist
Unassigned
OpenStack Designate Charm
Wishlist
Unassigned
OpenStack Keystone LDAP integration
Wishlist
Unassigned
OpenStack Manila Charm
Wishlist
Unassigned
OpenStack Manila Generic Backend Charm
Wishlist
Unassigned
OpenStack Manila-Ganesha Charm
Wishlist
Unassigned
OpenStack Masakari Charm
Wishlist
Unassigned
OpenStack Masakari Monitors Charm
Wishlist
Unassigned
OpenStack Nova Cell Controller Charm
Wishlist
Unassigned
OpenStack Octavia Charm
Wishlist
Unassigned
OpenStack Placement Charm
Wishlist
Unassigned
OpenStack ceilometer charm
Wishlist
Unassigned
OpenStack ceilometer-agent charm
Wishlist
Unassigned
OpenStack cinder charm
Wishlist
Unassigned
OpenStack cinder-backup charm
Wishlist
Unassigned
OpenStack cinder-ceph charm
Wishlist
Unassigned
OpenStack glance charm
Wishlist
Unassigned
OpenStack heat charm
Wishlist
Unassigned
OpenStack keystone charm
Wishlist
Unassigned
OpenStack neutron-api charm
Wishlist
Unassigned
OpenStack neutron-gateway charm
Wishlist
Unassigned
OpenStack neutron-openvswitch charm
Wishlist
Unassigned
OpenStack nova-cloud-controller charm
Wishlist
Unassigned
OpenStack nova-compute charm
Wishlist
Unassigned
OpenStack swift-proxy charm
Wishlist
Unassigned
OpenStack swift-storage charm
Wishlist
Unassigned
charm-keystone-kerberos
Wishlist
Unassigned
charm-keystone-saml-mellon
Wishlist
Unassigned
charm-neutron-api-plugin-arista
Wishlist
Unassigned
charm-neutron-api-plugin-ovn
Wishlist
Unassigned
charm-neutron-dynamic-routing
Wishlist
Unassigned
charm-ovn-central
Wishlist
Unassigned
charm-ovn-chassis
Wishlist
Unassigned
charm-ovn-dedicated-chassis
Wishlist
Unassigned
Ubuntu
Undecided
Unassigned

Bug Description

A subset of tempest tests can be added via zaza to get better functional test coverage for the payload deployed by the charms. This should be something that can be added for all of the openstack charms, whether it's a single tempest test or many.

Example for cinder:

diff --git a/tests/tests.yaml b/tests/tests.yaml
index 50aff23..8aaf0d6 100644
--- a/tests/tests.yaml
+++ b/tests/tests.yaml
@@ -19,10 +19,21 @@ configure:
 - zaza.openstack.charm_tests.neutron.setup.basic_overcloud_network
 - zaza.openstack.charm_tests.nova.setup.create_flavors
 - zaza.openstack.charm_tests.nova.setup.manage_ssh_key
+- zaza.openstack.charm_tests.tempest.setup.add_cirros_alt_image
+- zaza.openstack.charm_tests.tempest.setup.add_tempest_flavors
+- zaza.openstack.charm_tests.tempest.setup.add_tempest_roles
+- zaza.openstack.charm_tests.tempest.setup.render_tempest_config_keystone_v3
 tests:
 - zaza.openstack.charm_tests.cinder.tests.CinderTests
 - zaza.openstack.charm_tests.cinder.tests.SecurityTests
 - zaza.openstack.charm_tests.policyd.tests.CinderTests
+- zaza.openstack.charm_tests.tempest.tests.TempestTest
 tests_options:
   policyd:
     service: cinder
+ tempest:
+ default:
+ regex:
+ - "cinder_tempest_plugin"
+ - "tempest.api.volume"
+ - "tempest.scenario.test_volume_*"

This assumes zaza-openstack-tests has the following in requirements.txt:

git+https://opendev.org/openstack/tempest.git#egg=tempest
git+https://opendev.org/openstack/cinder-tempest-plugin.git#egg=cinder-tempest-plugin

Changed in charm-glance:
status: New → Triaged
importance: Undecided → Wishlist
description: updated
description: updated
description: updated
Changed in charm-glance:
status: In Progress → Won't Fix
status: Won't Fix → In Progress
Changed in charm-aodh:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-barbican:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-ceilometer:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-ceilometer-agent:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-cinder:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-cinder-backup:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-cinder-ceph:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-designate:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-heat:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-keystone:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-keystone-kerberos:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-keystone-ldap:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-keystone-saml-mellon:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-manila:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-manila-ganesha:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-manila-generic:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-masakari:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-masakari-monitors:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-api:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-api-plugin-arista:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-api-plugin-ovn:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-dynamic-routing:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-gateway:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-openvswitch:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-nova-cell-controller:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-nova-cloud-controller:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-nova-compute:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-octavia:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-ovn-central:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-ovn-chassis:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-ovn-dedicated-chassis:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-placement:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-swift-proxy:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-swift-storage:
importance: Undecided → Wishlist
status: New → Triaged
no longer affects: cloud-archive
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to charm-glance (master)

Reviewed: https://review.opendev.org/735315
Committed: https://git.openstack.org/cgit/openstack/charm-glance/commit/?id=1968c09af46765b77964e78327710583af03529c
Submitter: Zuul
Branch: master

commit 1968c09af46765b77964e78327710583af03529c
Author: Liam Young <email address hidden>
Date: Fri Jun 12 09:24:10 2020 +0000

    Run tempest smoke during charm smoke test

    Closes-Bug: #1881140
    Change-Id: Id380c052fbf7f23bd3b1c0826f953eeacd97b6fd

Changed in charm-glance:
status: In Progress → Fix Committed
Changed in charm-glance:
milestone: none → 20.10
Changed in charm-glance:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers