Add tempest functional test coverage to OpenStack charms

Bug #1881140 reported by Corey Bryant
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack AODH Charm
Triaged
Wishlist
Unassigned
OpenStack Barbican Charm
Triaged
Wishlist
Unassigned
OpenStack Ceilometer Agent Charm
Triaged
Wishlist
Unassigned
OpenStack Ceilometer Charm
Triaged
Wishlist
Unassigned
OpenStack Cinder Charm
Triaged
Wishlist
Unassigned
OpenStack Cinder-Ceph charm
Triaged
Wishlist
Unassigned
OpenStack Cinder-backup Charm
Triaged
Wishlist
Unassigned
OpenStack Designate Charm
Triaged
Wishlist
Unassigned
OpenStack Glance Charm
Fix Released
Wishlist
Unassigned
OpenStack Heat Charm
Triaged
Wishlist
Unassigned
OpenStack Keystone Charm
Triaged
Wishlist
Unassigned
OpenStack Keystone Kerberos Charm
Triaged
Wishlist
Unassigned
OpenStack Keystone LDAP integration
Triaged
Wishlist
Unassigned
OpenStack Keystone SAML Mellon Charm
Triaged
Wishlist
Unassigned
OpenStack Manila Charm
Triaged
Wishlist
Unassigned
OpenStack Manila Generic Backend Charm
Triaged
Wishlist
Unassigned
OpenStack Manila-Ganesha Charm
Triaged
Wishlist
Unassigned
OpenStack Masakari Charm
Triaged
Wishlist
Unassigned
OpenStack Masakari Monitors Charm
Triaged
Wishlist
Unassigned
OpenStack Neutron API Arista Plugin Charm
Triaged
Wishlist
Unassigned
OpenStack Neutron API Charm
Triaged
Wishlist
Unassigned
OpenStack Neutron API OVN Plugin Charm
Triaged
Wishlist
Unassigned
OpenStack Neutron Dynamic Routing charm
Triaged
Wishlist
Unassigned
OpenStack Neutron Gateway Charm
Triaged
Wishlist
Unassigned
OpenStack Neutron Open vSwitch Charm
Triaged
Wishlist
Unassigned
OpenStack Nova Cell Controller Charm
Triaged
Wishlist
Unassigned
OpenStack Nova Cloud Controller Charm
Triaged
Wishlist
Unassigned
OpenStack Nova Compute Charm
Triaged
Wishlist
Unassigned
OpenStack Octavia Charm
Triaged
Wishlist
Unassigned
OpenStack Placement Charm
Triaged
Wishlist
Unassigned
OpenStack Swift Proxy Charm
Triaged
Wishlist
Unassigned
OpenStack Swift Storage Charm
Triaged
Wishlist
Unassigned
charm-ovn-central
Triaged
Wishlist
Unassigned
charm-ovn-chassis
Triaged
Wishlist
Unassigned
charm-ovn-dedicated-chassis
Triaged
Wishlist
Unassigned
Ubuntu
New
Undecided
Unassigned

Bug Description

A subset of tempest tests can be added via zaza to get better functional test coverage for the payload deployed by the charms. This should be something that can be added for all of the openstack charms, whether it's a single tempest test or many.

Example for cinder:

diff --git a/tests/tests.yaml b/tests/tests.yaml
index 50aff23..8aaf0d6 100644
--- a/tests/tests.yaml
+++ b/tests/tests.yaml
@@ -19,10 +19,21 @@ configure:
 - zaza.openstack.charm_tests.neutron.setup.basic_overcloud_network
 - zaza.openstack.charm_tests.nova.setup.create_flavors
 - zaza.openstack.charm_tests.nova.setup.manage_ssh_key
+- zaza.openstack.charm_tests.tempest.setup.add_cirros_alt_image
+- zaza.openstack.charm_tests.tempest.setup.add_tempest_flavors
+- zaza.openstack.charm_tests.tempest.setup.add_tempest_roles
+- zaza.openstack.charm_tests.tempest.setup.render_tempest_config_keystone_v3
 tests:
 - zaza.openstack.charm_tests.cinder.tests.CinderTests
 - zaza.openstack.charm_tests.cinder.tests.SecurityTests
 - zaza.openstack.charm_tests.policyd.tests.CinderTests
+- zaza.openstack.charm_tests.tempest.tests.TempestTest
 tests_options:
   policyd:
     service: cinder
+ tempest:
+ default:
+ regex:
+ - "cinder_tempest_plugin"
+ - "tempest.api.volume"
+ - "tempest.scenario.test_volume_*"

This assumes zaza-openstack-tests has the following in requirements.txt:

git+https://opendev.org/openstack/tempest.git#egg=tempest
git+https://opendev.org/openstack/cinder-tempest-plugin.git#egg=cinder-tempest-plugin

Changed in charm-glance:
status: New → Triaged
importance: Undecided → Wishlist
description: updated
description: updated
description: updated
Changed in charm-glance:
status: In Progress → Won't Fix
status: Won't Fix → In Progress
Changed in charm-aodh:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-barbican:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-ceilometer:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-ceilometer-agent:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-cinder:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-cinder-backup:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-cinder-ceph:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-designate:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-heat:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-keystone:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-keystone-kerberos:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-keystone-ldap:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-keystone-saml-mellon:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-manila:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-manila-ganesha:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-manila-generic:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-masakari:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-masakari-monitors:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-api:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-api-plugin-arista:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-api-plugin-ovn:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-dynamic-routing:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-gateway:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-neutron-openvswitch:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-nova-cell-controller:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-nova-cloud-controller:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-nova-compute:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-octavia:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-ovn-central:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-ovn-chassis:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-ovn-dedicated-chassis:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-placement:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-swift-proxy:
importance: Undecided → Wishlist
status: New → Triaged
Changed in charm-swift-storage:
importance: Undecided → Wishlist
status: New → Triaged
no longer affects: cloud-archive
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to charm-glance (master)

Reviewed: https://review.opendev.org/735315
Committed: https://git.openstack.org/cgit/openstack/charm-glance/commit/?id=1968c09af46765b77964e78327710583af03529c
Submitter: Zuul
Branch: master

commit 1968c09af46765b77964e78327710583af03529c
Author: Liam Young <email address hidden>
Date: Fri Jun 12 09:24:10 2020 +0000

    Run tempest smoke during charm smoke test

    Closes-Bug: #1881140
    Change-Id: Id380c052fbf7f23bd3b1c0826f953eeacd97b6fd

Changed in charm-glance:
status: In Progress → Fix Committed
Changed in charm-glance:
milestone: none → 20.10
Changed in charm-glance:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.