Excluding several tests with --test produce unexpected result

[Jonathan Ballet]

Say that you have the following tests available:

  test_foo
  test_bar

And you try to run zope.testrunner with the following options:

  --test="!foo" --test="!bar"

You will get the following tests executed:

  test_foo
  test_bar

The culprit is the way tests patterns are matched with test names:

* "!foo" builds a pattern which says "return True if it doesn't contain foo"
* same for "!bar"

Then, in https://github.com/zopefoundation/zope.testrunner/blob/master/src/zope/testrunner/find.py#L422, it goes as follow:

* is "foo" not in "test_foo" -> False
* is "bar" not in "test_foo" -> True, yield it
...
* is "foo" not in "test_bar" -> True, yield it

I'm not sure how to fix the algorithm to fix the problem.

[Jonathan Ballet (multani)]

I posted a fix at https://github.com/zopefoundation/zope.testrunner/pull/2

[Jonathan Ballet (multani)]

Merged in master as of https://github.com/zopefoundation/zope.testrunner/commit/0add4047259ecebf285e59f92998e975ffc60e19

[Marius Gedminas (mgedmin)]

Fixed in zope.testrunner 4.4.0.