[osci] custom test groups in deploy tests can lead to false positives
Bug #1481742 reported by
Aleksandra Fedorova
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Fix Released
|
High
|
Fuel CI |
Bug Description
number of tests for packages on OSCI jenkins (deploy-jobs) use custom test groups. They override the default smoke_neutron test group via integration tests config file.
The problem is that QA team has just started major refactoring of test groups in fuel-qa repo, so some of those custom groups can disappear. Proboscis framework used in fuel-qa tests mark empty tests as successful, thus we can get false positives for such tests.
We need to fail the test if test group is empty
tags: | added: area-ci |
To post a comment you must log in.
https:/ /bugs.launchpad .net/fuel/ +bug/1417662