"Set previous test status to PASS" does not work for poweroff / reboot test

Bug #1406719 reported by Po-Hsu Lin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Checkbox GUI (Legacy)
Fix Released
High
Sylvain Pineau

Bug Description

Steps:
1. Run the poweroff / reboot test
2. Select "Set previous test status to PASS" after restart.

Expect result:
This test should be marked as passed, and move on to the next test case.

Actual result:
It acts like "Rerun last test".

ubuntu@201306-13867:~$ dpkg -l | grep -e checkbox -e plainbox -e canonical | awk '{print $2" "$3}'
canonical-certification-client 0.13+bzr3521+pkg44~ubuntu14.04.1
checkbox 0.17.10+bzr2829+pkg77+legacy1~ubuntu14.04.1
checkbox-certification 0.20+bzr653+201412250646~ubuntu14.04.1
checkbox-certification-client 0.20+bzr653+201412250646~ubuntu14.04.1
checkbox-certification-tools 0.20+bzr653+201412250646~ubuntu14.04.1
checkbox-gui 0.30+bzr3521+pkg14~ubuntu14.04.1
checkbox-ng 0.16+bzr3521+pkg23~ubuntu14.04.1
checkbox-ng-service 0.16+bzr3521+pkg23~ubuntu14.04.1
checkbox-qt 0.17.10+bzr2829+pkg77+legacy1~ubuntu14.04.1
plainbox-glmark2-es2-meta 0.13+bzr3521+pkg44~ubuntu14.04.1
plainbox-insecure-policy 0.18+bzr3521+pkg20~ubuntu14.04.1
plainbox-provider-certification-client 0.13+bzr3521+pkg44~ubuntu14.04.1
plainbox-provider-checkbox 0.17+bzr3521+pkg17~ubuntu14.04.1
plainbox-provider-resource-generic 0.15+bzr3521+pkg16~ubuntu14.04.1
python3-checkbox 0.17.10+bzr2829+pkg77+legacy1~ubuntu14.04.1
python3-checkbox-ng 0.16+bzr3521+pkg23~ubuntu14.04.1
python3-checkbox-support 0.16+bzr3521+pkg17~ubuntu14.04.1
python3-plainbox 0.18+bzr3521+pkg20~ubuntu14.04.1

Related branches

Changed in checkbox-gui:
assignee: nobody → Sylvain Pineau (sylvain-pineau)
importance: Undecided → High
status: New → In Progress
Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

My fault, the fix for https://bugs.launchpad.net/checkbox-gui/+bug/1362449 was incomplete. I have to increment the current job index when the tester decides to force the previous test outcome

Changed in checkbox-gui:
milestone: none → 0.30
Changed in checkbox-gui:
status: In Progress → Fix Committed
Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

After testing a second RC of checkbox-gui, the fix is still incomplete, incrementing the current index in checkbox-gui (+1) is not enough as I still see the same test after cliking pass on the resume screen.

The only good point is that the regression whitelist caught it.

I'm still debugging the problem.

Changed in checkbox-gui:
status: Fix Committed → In Progress
Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

it was a tag issue, the second RC for checkbox-gui didn't include the fix. A third one will fix the false alarm

Changed in checkbox-gui:
status: In Progress → Fix Committed
Changed in checkbox-gui:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.