Docker Container Test scripts infrastructure needs a option to select few test cases from the complete suite

Bug #1604836 reported by Srikanth Joshi
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
New
Medium
Unassigned
OpenContrail
New
Medium
Unassigned

Bug Description

It is seen that when DCTS scripts when executed in CI/CD or Systest labs in AT&T, we encounter a scenario where few tests fails & few tests pass. To debug better, it would be handy to address following scenario's

1. Incase to execute only failed tests, we need to run docker image in debug mode & execute the unit tests by setting the few environment variables. Instead of this it would be better if an option is provided to select and run particular unit test cases or say execute only the failed test cases. This way we could execute only the failed tests only when we observe few test cases fail.

2. The failures can be related to the stability of the cluster, or script failures. So, it would be easier if we have the provision to execute only the failed scripts. This way we could reduce the run-time of the script execution.

3. With current architecture, we have to execute all the scripts again & we are not sure if all the scripts pass/fail in next execution. The execution times can be higher & we cannot guarantee all the scripts will pass in one-go. As scripts get added it would be advantages to execute few tests based on requirements.

Srikanth Joshi (joshi)
Changed in opencontrail:
status: New → Confirmed
status: Confirmed → New
Changed in juniperopenstack:
importance: Undecided → Medium
Changed in opencontrail:
importance: Undecided → Medium
Changed in juniperopenstack:
assignee: nobody → Harish Kumar (hkumarmk)
Changed in opencontrail:
assignee: nobody → Harish Kumar (hkumarmk)
tags: added: automation
removed: contrail scripts
Harish Kumar (hkumarmk)
Changed in juniperopenstack:
assignee: Harish Kumar (hkumarmk) → nobody
Changed in opencontrail:
assignee: Harish Kumar (hkumarmk) → nobody
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.