subunit-filter ability to change fail to xfail based on external list
Bug #755241 reported by
Jelmer Vernooij
This bug affects 1 person
| Affects | Status | Importance | Assigned to | Milestone | |
|---|---|---|---|---|---|
| subunit |
Fix Released
|
Medium
|
Jelmer Vernooij | ||
Bug Description
it would be useful if subunit-filter had a way to change some failures/errors in a subunit stream to xfail based on an external list of test ids.
Samba uses this heavily for protocol tests that run against multiple servers, not all of which properly implement the protocol (yet).
Similarly, I'd like to use this for bzr-git testing, where I run all of the generic per_repository tests from bzr but not all of them pass yet. If I can filter out all failures I'm aware of it's easier to find regressions.
Related branches
lp:~jelmer/subunit/external-known-failures
- Robert Collins: Approve
-
Diff: 218 lines (+83/-10)6 files modifiedNEWS (+3/-0)
filters/subunit-filter (+10/-2)
python/subunit/__init__.py (+13/-0)
python/subunit/test_results.py (+28/-7)
python/subunit/tests/test_details.py (+0/-1)
python/subunit/tests/test_subunit_filter.py (+29/-0)
Revision history for this message
| Jelmer Vernooij (jelmer) wrote | #1 |
| Changed in subunit: | |
| status: | New → Triaged |
| importance: | Undecided → Medium |
| status: | Triaged → In Progress |
| assignee: | nobody → Jelmer Vernooij (jelmer) |
Revision history for this message
| Robert Collins (lifeless) wrote | #2 |
| Changed in subunit: | |
| milestone: | none → next |
| Changed in subunit: | |
| status: | In Progress → Fix Committed |
| Changed in subunit: | |
| status: | Fix Committed → Fix Released |
To post a comment you must log in.
(samba currently has its own thing that implements this)