Validation queue needs to test multiple build configurations

Bug #918149 reported by Chris Hillery
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Zorba
New
High
Chris Hillery

Bug Description

At a minimum, we wish to test with ZORBA_WITH_BIG_INTEGER set both on and off.

More generally, we should support multiple build configurations, each with potentially different sets of tests run. For example, we don't necessarily need to run XQTS with every configuration.

Tags: testsystem
Chris Hillery (ceejatec)
Changed in zorba:
milestone: none → 3.0
importance: Undecided → High
assignee: nobody → Chris Hillery (ceejatec)
status: New → Triaged
Revision history for this message
Chris Hillery (ceejatec) wrote :

Probably the validation queue should NOT short-circuit - if one build configuration fails to build, it should still try the rest. That way we get the most information per queue run. Probably any egregious build failures will cause all configurations to fail quickly, so there isn't much time penalty.

Revision history for this message
Chris Hillery (ceejatec) wrote :

It will be necessary for each build+test configuration to submit results as separate CDash builds, and the passing/failing tests for each build should be linked from the validation queue's log.html.

Changed in zorba:
status: Triaged → New
milestone: none → 2.7
Chris Hillery (ceejatec)
tags: added: task
Chris Hillery (ceejatec)
Changed in zorba:
milestone: 2.7 → none
Chris Hillery (ceejatec)
tags: removed: task
tags: added: testsystem
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.