verbose flag causes spurious test failures

Bug #588922 reported by Tres Seaver
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
zope.testing
Won't Fix
Undecided
Unassigned
zope.testrunner
Invalid
Undecided
Unassigned

Bug Description

The tests run fine on the trunk without any '-v' flag::

  $ svn co $ZSVN/zope.testing/trunk zope.testing
  $ cd zope.testing
  $ /opt/Python-2.6.5/bin/python bootstrap.py
  ...
  $ bin/buildout
  ...
  $ bin/test --all
  bin/test:16: DeprecationWarning: zope.testing.testrunner is deprecated in favour of zope.testrunner.
  /home/tseaver/projects/Zope/Z3/zope.testing/src/zope/testing/testrunner/formatter.py:28: DeprecationWarning: zope.testing.exceptions is deprecated in favour of zope.testrunner.exceptions
    from zope.testing.exceptions import DocTestFailureException
  Running zope.testing.testrunner.layer.UnitTests tests:
    Set up zope.testing.testrunner.layer.UnitTests in 0.000 seconds.
    Ran 261 tests with 0 failures and 0 errors in 22.661 seconds.
  Tearing down left over layers:
    Tear down zope.testing.testrunner.layer.UnitTests in 0.000 seconds.

but one fails when run with '-v'::

  $ bin/test --all -v
  bin/test:16: DeprecationWarning: zope.testing.testrunner is deprecated in favour of zope.testrunner.
  /home/tseaver/projects/Zope/Z3/zope.testing/src/zope/testing/testrunner/formatter.py:28: DeprecationWarning: zope.testing.exceptions is deprecated in favour of zope.testrunner.exceptions
    from zope.testing.exceptions import DocTestFailureException
  Running tests at all levels
  Running zope.testing.testrunner.layer.UnitTests tests:
    Set up zope.testing.testrunner.layer.UnitTests in 0.000 seconds.
    Running:
  ..........................

  Failure in test /home/tseaver/projects/Zope/Z3/zope.testing/src/zope/testing/doctest.txt
  Failed doctest test for doctest.txt
    File "/home/tseaver/projects/Zope/Z3/zope.testing/src/zope/testing/doctest.txt", line 0

  ----------------------------------------------------------------------
  File "/home/tseaver/projects/Zope/Z3/zope.testing/src/zope/testing/doctest.txt", line 24, in doctest.txt
  Failed example:
      doctest.testfile(fn, False)
  Expected:
      (0, 1)
  Got:
      Trying:
          x = 1 + 1
      Expecting nothing
      ok
      1 items passed all tests:
         1 tests in tmpquMzTs
      1 tests in 1 items.
      1 passed and 0 failed.
      Test passed.
      (0, 1)

  ...........................................................................................................................................................................................................................................
    Ran 261 tests with 1 failures and 0 errors in 23.245 seconds.
  Tearing down left over layers:
    Tear down zope.testing.testrunner.layer.UnitTests in 0.000 seconds.

  Tests with failures:
     /home/tseaver/projects/Zope/Z3/zope.testing/src/zope/testing/doctest.txt

Revision history for this message
Marius Gedminas (mgedmin) wrote :

This needs to be fixed in zope.testrunner, not zope.testing.

Changed in zope.testing:
status: New → Won't Fix
Revision history for this message
Marius Gedminas (mgedmin) wrote :

I cannot reproduce this, most likely because zope.testing.doctest (and its tests) are long gone.

Changed in zope.testrunner:
status: New → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.