Functional tests do not have tags that define need of backend involvement

Bug #1587874 reported by Valeriy Ponomaryov on 2016-06-01
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Shared File Systems Service (Manila)
Medium
Valeriy Ponomaryov

Bug Description

We have about 500 functional tests in manila plugin for tempest.
And we can separate them into following categories:

1) testing API not involving backend
2) testing API involving backend
3) testing backend involving API

It may be very useful to be able to run tests only from some category of these.
For example, if I, as driver maintainer, changed only share driver parts and want to run functional tests, I would want to run only those tests that cover possibly affected parts and do not cover definitely not affected ones.

For the moment we do not have possibility to filter these categories out from whole list of tests. It can be solved by addon of special tags, that will be used in test regex.

Changed in manila:
assignee: nobody → Valeriy Ponomaryov (vponomaryov)
description: updated
tags: added: tempest
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to manila (master)

Fix proposed to branch: master
Review: https://review.openstack.org/324006

Changed in manila:
status: New → In Progress
Changed in manila:
importance: Undecided → Medium
milestone: none → newton-2
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to manila (master)

Reviewed: https://review.openstack.org/324006
Committed: https://git.openstack.org/cgit/openstack/manila/commit/?id=797bbcb303f581dc032e8788af016c8158626efe
Submitter: Jenkins
Branch: master

commit 797bbcb303f581dc032e8788af016c8158626efe
Author: Valeriy Ponomaryov <email address hidden>
Date: Wed Jun 1 18:30:12 2016 +0300

    [Tempest] Add valuable tags to tests

    To be able to run tests based on following criteria:
    - Only API is required and tested.
    - API and share back-end required, API is tested.
    - API and share back-end required, back-end is tested

    Also, add doc with detailed description of running subset of tests.

    Change-Id: I9ae105eaa527621c85d5038bba15edf4b065eaa3
    Closes-Bug: #1587874

Changed in manila:
status: In Progress → Fix Released
Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/manila 3.0.0.0b2

This issue was fixed in the openstack/manila 3.0.0.0b2 development milestone.

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers