Docker Container Test scripts infrastructure needs a option to select few test cases from the complete suite
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Juniper Openstack |
New
|
Medium
|
Unassigned | ||
OpenContrail |
New
|
Medium
|
Unassigned |
Bug Description
It is seen that when DCTS scripts when executed in CI/CD or Systest labs in AT&T, we encounter a scenario where few tests fails & few tests pass. To debug better, it would be handy to address following scenario's
1. Incase to execute only failed tests, we need to run docker image in debug mode & execute the unit tests by setting the few environment variables. Instead of this it would be better if an option is provided to select and run particular unit test cases or say execute only the failed test cases. This way we could execute only the failed tests only when we observe few test cases fail.
2. The failures can be related to the stability of the cluster, or script failures. So, it would be easier if we have the provision to execute only the failed scripts. This way we could reduce the run-time of the script execution.
3. With current architecture, we have to execute all the scripts again & we are not sure if all the scripts pass/fail in next execution. The execution times can be higher & we cannot guarantee all the scripts will pass in one-go. As scripts get added it would be advantages to execute few tests based on requirements.
Changed in opencontrail: | |
status: | New → Confirmed |
status: | Confirmed → New |
Changed in juniperopenstack: | |
importance: | Undecided → Medium |
Changed in opencontrail: | |
importance: | Undecided → Medium |
Changed in juniperopenstack: | |
assignee: | nobody → Harish Kumar (hkumarmk) |
Changed in opencontrail: | |
assignee: | nobody → Harish Kumar (hkumarmk) |
tags: |
added: automation removed: contrail scripts |
Changed in juniperopenstack: | |
assignee: | Harish Kumar (hkumarmk) → nobody |
Changed in opencontrail: | |
assignee: | Harish Kumar (hkumarmk) → nobody |