unit tests fail based on wall clock time
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Identity (keystone) |
Fix Released
|
Medium
|
Brant Knudson |
Bug Description
We've got a lot of tests that depend on how long the test takes to run. Tests can take a long time just because you have a slow or overloaded system, or maybe you're trying to step through it with the debugger.
The tests that fail generally don't care about the time and aren't attempting to verify performance, but still require that the test run quickly enough.
Tests shouldn't depend on the wall clock time, just like they shouldn't depend on any external factors.
Here's an example of a failing test:
keystone.
-------
Captured traceback:
~~~~~~~~~~~~~~~~~~~
Traceback (most recent call last):
File "keystone/
File "keystone/
File "keystone/
File "/home/
raise self.failureExc
AssertionError: False is not true : 2015-06-11 13:34:46+00:00 != 2015-06-11 13:34:50+00:00 within 3 delta
It took 4 seconds rather than 3.
tags: | added: test-improvement |
Changed in keystone: | |
importance: | Undecided → Medium |
Changed in keystone: | |
status: | In Progress → Fix Committed |
Changed in keystone: | |
milestone: | none → liberty-1 |
status: | Fix Committed → Fix Released |
Changed in keystone: | |
milestone: | liberty-1 → 8.0.0 |
Fix proposed to branch: master /review. openstack. org/190790
Review: https:/