Blackbox test suite for validation and QA
Bug #797671 reported by
Lars Butler
This bug affects 1 person
| Affects | Status | Importance | Assigned to | Milestone | |
|---|---|---|---|---|---|
| OpenQuake (deprecated) |
Invalid
|
Medium
|
Unassigned | ||
Bug Description
The smoke tests we have at present are too heavy in terms of run time and computation resources.
We need to have a fast and high-quality black box suite that runs in less than ten minutes and gives us the confidence that the system is intact if it passes.
The blackbox test suite should also be run automatically on our CI server.
Developers currently do not/cannot afford to run the smoke tests prior to committing change sets. This leads to unnoticed bugs that creep into the system.
| Changed in openquake: | |
| status: | New → Confirmed |
| importance: | Undecided → High |
| tags: | added: verification |
| Changed in openquake: | |
| milestone: | none → 0.4.1 |
| Changed in openquake: | |
| milestone: | 0.4.1 → none |
| tags: | added: current |
| tags: |
added: current-cycle removed: current |
| Changed in openquake: | |
| milestone: | none → 0.4.2 |
| tags: | removed: current-cycle |
| Changed in openquake: | |
| milestone: | 0.4.2 → 0.4.3 |
| Changed in openquake: | |
| milestone: | 0.4.3 → 0.4.4 |
| Changed in openquake: | |
| importance: | High → Medium |
Revision history for this message
| John Tarter (toh2) wrote | #1 |
| Changed in openquake: | |
| milestone: | 0.4.4 → 0.4.6 |
| Changed in openquake: | |
| status: | Confirmed → Invalid |
Revision history for this message
| John Tarter (toh2) wrote | #2 |
To post a comment you must log in.
I moved this out to 0.4.6 as we need to get some progress on this Bug.