Functional tests are unstable
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
charm-cloudsupport |
Won't Fix
|
Medium
|
Unassigned |
Bug Description
The functional tests for this charm are highly unstable. The test runs fail about 70-80% of the time.
There are 4 test bundles that we're deploying:
- jammy-yoga
- focal-yoga
- jammy-yoga-ovn
- focal-yoga-ovn
The failures don't look related to any of the bundles, because sometimes the tests pass in all the bundles, and sometimes they fail in any of the bundles.
The failures are seen mostly in the following functions (see file https:/
- test_20_
- test_25_
Sometimes, the failures can be avoided by retrying these tests for a few minutes, but sometimes even after retrying for upto 6 minutes, test_25_
Failures in test_20_
Some failures are on add_test_image (https:/
We need to create more robust tests that pass most of the time, by finding the root causes of the failures, especially on test_25_
Detailed logs on failures - https:/
tags: | added: bseng-453 |
Changed in charm-cloudsupport: | |
importance: | Undecided → Medium |
status: | New → Triaged |
Changed in charm-cloudsupport: | |
status: | Triaged → Won't Fix |