checkbox should log what test plan it executed in the submission file.

Bug #1609999 reported by Jeff Lane 
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Next Generation Checkbox (CLI)
Fix Released
Low
Sylvain Pineau

Bug Description

It's possible to have an infinite number of test plans in a provider, which may be strikingly similar (e.g. you could have 3 plans that only vary by 5 items out of 50).

This can make it difficult to easily determine that a tester used the correct test plan.

So Checkbox should, somewhere, log what testplan it ran.

The best option would be for it to write this data to a test log that can be attached to the submission.xml, or perhaps exported as an environment var that can be read from a test inside the suite...

example:

export TEST_PLAN=$UNIT_CHOSEN_BY_TESTER

in test:

name: What_Test_Did_We_Run
command: echo $TEST_PLAN

Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

Should be possible indeed to store this metadata in the new json report

Changed in checkbox-ng:
importance: Undecided → Low
status: New → Triaged
Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

now available in the new html report (part of the submission archive)

Changed in checkbox-ng:
milestone: none → 0.36.0
assignee: nobody → Sylvain Pineau (sylvain-pineau)
status: Triaged → Fix Committed
Changed in checkbox-ng:
milestone: 0.36.0 → 1.0.0
Changed in checkbox-ng:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.