[osci] custom test groups in deploy tests can lead to false positives

Bug #1481742 reported by Aleksandra Fedorova
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
High
Fuel CI

Bug Description

number of tests for packages on OSCI jenkins (deploy-jobs) use custom test groups. They override the default smoke_neutron test group via integration tests config file.

The problem is that QA team has just started major refactoring of test groups in fuel-qa repo, so some of those custom groups can disappear. Proboscis framework used in fuel-qa tests mark empty tests as successful, thus we can get false positives for such tests.

We need to fail the test if test group is empty

Revision history for this message
Alexander Tsamutali (astsmtl) wrote :
Revision history for this message
Igor Shishkin (teran) wrote :

Moving to 8.0 since 7.0 is already released and couldn't be a target.

Changed in fuel:
milestone: 7.0 → 8.0
Revision history for this message
Igor Belikov (ibelikov) wrote :

This was fixed in fuel-qa master and stable/7.0 branches

Changed in fuel:
status: Confirmed → Fix Released
Dmitry Pyzhov (dpyzhov)
tags: added: area-ci
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.