zope.testrunner's buildout makes failing tests

[Tres Seaver]

On [the trunk of zope.testrunner::

  $ cd /tmp
  $ svn co $ZSVN/zope.testrunner/trunk testrunner
  ...

I can run the tests fine from a virtualenv::

  $ /opt/Python-2.6.5/bin/virtualenv --no-site-packages /tmp/xxx
  ...
  $ /tmp/xxx/bin/python setup.py develop
  ...
  $ /tmp/xxx/bin/easy_install zope.testing
  ...
  $ /tmp/xxx/bin/python setup.py test
  ...
  running build_ext
  Running zope.testrunner.layer.UnitTests tests:
    Set up zope.testrunner.layer.UnitTests in 0.000 seconds.
    Ran 27 tests with 0 failures and 0 errors in 22.256 seconds.
  Tearing down left over layers:
    Tear down zope.testrunner.layer.UnitTests in 0.000 seconds.

but not via zc.buildout:

  $ /opt/Python-2.6.5/bin/python bootstrap.py
  ...
  $ bin/buildout
  ...
  $ bin/test
  <doctest spew>
  (pdb)

[Tres Seaver (tseaver)]

Having the buildout's own tests fail makes it impossible to do "normal"
development in this project.

[Marius Gedminas (mgedmin)]

FWIW 'python setup.py test' works (and leaves two zipped egg files in the current working directory).

[Marius Gedminas (mgedmin)]

Looking at bin/test as generated by buildout I see

    zope.testrunner.run([
        '--test-path', '/home/mg/src/zope.testrunner/src',
        '--test-path', '/home/mg/.buildout/eggs/zope.testing-3.9.5-py2.6.egg',
        ])

which means it's trying to run zope.testing's test suite too, which fails.

My fault: I added zope.testing to buildout.cfg:

  [test]
  recipe = zc.recipe.testrunner
  eggs = zope.testrunner
         zope.testing

because zope.testrunner itself doesn't depend on zope.testing and thus bin/test used to fail with an import error.

What's the right buildout incantation of enabling extra test dependencies without running their tests?

[Marius Gedminas (mgedmin)]

I couldn't find a cleaner way, so ended up adding extras_require to setup.py with a 'test' extra depending on zope.testing. and changing the buildout recipe to

  [test]
  recipe = zc.recipe.testrunner
  eggs = zope.testrunner[test]

It works.

[Tres Seaver (tseaver)]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Marius Gedminas wrote:

> What's the right buildout incantation of enabling extra test
> dependencies without running their tests?

Should be something like:

 [test]
 recipe = zc.recipe.testrunner
 eggs = zope.testrunner [test]

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkwYxgQACgkQ+gerLs4ltQ6jWwCeKm7GgJK/Xtch/yjAMJ6azPii
ohoAn2jcs6Xr5IoPiuoYG5Tirs4Adwfg
=EGj5
-----END PGP SIGNATURE-----

[Tres Seaver (tseaver)]

Fix released with 4.0.0b3:

 http://pypi.python.org/pypi/zope.testrunner/4.0.0b3