Test that have been skipped because of a failed dependency cannot be re-run afterwards
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Next Generation Checkbox (CLI) |
Confirmed
|
Undecided
|
Unassigned |
Bug Description
With Plainbox 0.21, we now have the possibility to re-run failed tests at the end of a session (before submitting it).
There is a problem with tests skipped because of a failed dependency.
Example:
1. Run a test plan that includes the three following tests:
- usb/insert
- usb/storage-
- usb/remove
2. During `usb/insert`, fail to insert a USB stick within the given time (30 seconds).
→ the test will be marked as "failed", and `usb/storage-
3. Finish running the session
→ A re-run window shows up, but only `usb/insert` is proposed to be re-run (not `usb/storage-
It would be better if tests that depend on the failed test (and therefore were skipped) are proposed to be re-run as well.
Other examples of such tests include:
- mediacard/
- mediacard/
- mediacard/
- mediacard/sd-insert
- mediacard/
- mediacard/sd-remove
- mediacard/
- mediacard/
- mediacard/
- usb3/insert
- usb3/storage-
- usb3/remove
- ...
Changed in checkbox-ng: | |
status: | New → Confirmed |
tags: | added: ce-qa-concern |