Manual tests should show description/steps/verification at once

Bug #1470811 reported by Pierre Equoy on 2015-07-02
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
PlainBox (Toolkit)
High
Unassigned

Bug Description

Bug lp:1453067 was fixed, but now (plainbox v0.22) a tester has to press ENTER before being able to see a manual test steps and verification parts. Example with the docking tests using the new fields [1]

-------------[ Running job 21 / 114. Estimated time left: unknown ]-------------
-------------------------[ HDMI port test on the dock ]-------------------------
ID: 2013.com.canonical.certification::dock/monitor-hdmi
Category: 2013.com.canonical.plainbox::uncategorised
Purpose:
This test will check the HDMI port(s) on the dock.
Pick an action
    => press ENTER to continue
  c => add a comment
  s => skip this job
  q => save the session and quit
[csq]: <ENTER>
Steps:
Skip this test if the dock does not have a HDMI port.
1. Connect a display (if not already connected) to the HDMI port on the dock
2. Repeat step 1 for each additional HDMI port, if any
Verification:
Was the desktop displayed correctly on both screens?
Please decide what to do next:
  outcome: job needs verification
  comments: UNSET
Pick an action
  c => add a comment
  p => set outcome to pass
  f => set outcome to fail
  s => set outcome to skip
    => set suggested outcome [job failed]
[cpfs]:

It would be better if, for manual tests, the whole block was displayed at once, without having to press ENTER in order to see Steps/Verification, such as:

-------------[ Running job 21 / 114. Estimated time left: unknown ]-------------
-------------------------[ HDMI port test on the dock ]-------------------------
ID: 2013.com.canonical.certification::dock/monitor-hdmi
Category: 2013.com.canonical.plainbox::uncategorised
Purpose:
This test will check the HDMI port(s) on the dock.
Steps:
Skip this test if the dock does not have a HDMI port.
1. Connect a display (if not already connected) to the HDMI port on the dock
2. Repeat step 1 for each additional HDMI port, if any
Verification:
Was the desktop displayed correctly on both screens?
Please decide what to do next:
  outcome: job needs verification
  comments: UNSET
Pick an action
  c => add a comment
  p => set outcome to pass
  f => set outcome to fail
  s => set outcome to skip
    => set suggested outcome
[cpfs]:

[1]: http://plainbox.readthedocs.org/en/latest/manpages/plainbox-job-units.html

Pierre Equoy (pieq) on 2015-07-06
Changed in plainbox:
milestone: none → 0.22
Pierre Equoy (pieq) on 2015-07-08
Changed in plainbox:
status: Confirmed → Fix Committed
importance: Undecided → High
Pierre Equoy (pieq) wrote :

I re-run a subset of the docking test plan using boxer (`boxer run stella`, which creates its own CLI launcher) in order to check the behaviour with different kinds of plugins (manual, shell, user-interact and user-interact-verify):

dock/docking (manual)
dock/audio-playback-headphones (user-interact-verify)
dock/usb-HID (user-interact-verify)
dock/usb-insert (user-interact)
dock/usb-remove (user-interact)
dock/usb-storage-automated (shell)

The behaviour was correct for all of them (see attachement showing the screen output).

I also re-run another test plan and the behaviour is the same as with previous versions, so there is no regression.

→ Problem fixed!

Pierre Equoy (pieq) on 2015-07-08
tags: added: cqa-verified
Changed in plainbox:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers