jtdiff on xenial and bionic should accept an include file list

Bug #1904072 reported by Tiago Stürmer Daitx
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
jtreg (Ubuntu)
New
Undecided
Unassigned

Bug Description

[Impact]
jtreg version 5.0 or later added a '-match' option that is basically the reverse of '-exclude': it allows the user to set a file containing the tests that should be run - files not on the list are 'excluded'.

As an OpenJDK maintainer I would like to have the option to set a 'include' list of tests to be run, so I can easily separate tests between 'stable' and 'flaky' tests by defining a list of tests that are known to always pass (and where we actually care for regressions).

[Test Case]
1) Create an inclusion list with a single line
$ echo "compiler/aot/RecompilationTest.java" > /tmp/include-list
2) Run the openjdk-lts hotspot test with -watch
$ jtreg -workDir:"/tmp/work" -reportDir:"/tmp/report" -jdk:/usr/lib/jvm/default-java -match:/tmp/include-list -dir:/tmp/openjdk-lts/test/hotspot/jtreg -listtests :hotspot_compiler
Testsuite: /tmp/openjdk-lts/test/hotspot/jtreg
compiler/aot/RecompilationTest.java
Tests found: 1

jtreg from xenial and bionic currently fail as they have no support for '-match'.

[Where problems could occur]
This adds code that has been highly tested on jtreg 5.0+ to previous versions, so it could possibly trigger different code paths and regress in some corner cases. This would probably show up as previously excluded tests no longer being excluded, since exclusion is now defined as "!match".
Any tool that directly calls 'jtreg -match' - instead of looking for its version - might consider this is a newer version of jtreg and assume it can also user other newer features, which would fail.

[Other Info]

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.