Tests with invalid category attributes should be more visible
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
NUnit V2 |
Fix Released
|
Medium
|
Charlie Poole | ||
nunit-console |
Won't Fix
|
High
|
Unassigned |
Bug Description
When a test is marked with an invalid category attribute, like aaa-bbb, that test is marked as not-runnable and shows up as an error in both the gui and console if we try to run it. However, if we make the mistake of asking nunit to run category aaa-bbb, then the test in question is not run (because aaa-bbb is a valid category expression) and no error appears. From the point of view of the user, the test seems to have just disappeared.
The following changes are needed, at a minimum, to make it clearer to the user just what is happening:
1. Not runnable tests should show as red in the gui as soon as the tests are loaded, without waiting for a test run. They should remain red even after a test run that does not include them.
2. Invalid categories should not be listed for selection by the gui at all.
3. The console runner output should use wording that indicates aaa-bbb is a category expression rather than a simple category.
See bug #881357 for more info on the motivation for this change.
Related branches
Changed in nunitv2: | |
importance: | Undecided → Medium |
assignee: | nobody → Charlie Poole (charlie.poole) |
status: | New → In Progress |
milestone: | none → 2.6.0 |
Changed in nunitv2: | |
status: | In Progress → Fix Committed |
Changed in nunitv2: | |
status: | Fix Committed → Fix Released |
Changed in nunit-3.0: | |
status: | New → Opinion |
status: | Opinion → Triaged |
importance: | Undecided → High |
assignee: | nobody → Charlie Poole (charlie.poole) |
milestone: | none → 2.9.6 |
affects: | nunit-3.0 → nunit-console |
Fixed this by implementing the three points above. Also made ignored tests show up as yellow in the gui before they are run.