Ok redoing the test. Turns out this can be run on a virtual machine (e.g. virtualbox), just make sure to "connect" a USB stick to the virtual machine.
With checkbox 0.13.7:
$ exitESC^H^Hdpkg --list checkbox{,-cli}
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Description
+++-==============-==============-============================================
ii checkbox 0.13.7 System testing application
ii checkbox-cli 0.13.7 Command line interface for checkbox
The storage-preinserted test fails:
Test case results report
a: USB tests
: Space when finished
Please choose (a/ ): a
USB tests
usb/insert [pass]
usb/storage-preinserted [failESC]
: Space when finished
Please choose ( ):
The submission.xml report shows the cause for the failure, as expected:
<question name="usb/storage-preinserted">
<answer type="multiple_choice">fail</answer>
<comment>mount: only root can do that
</comment>
With checkbox 0.13.9:
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Description
+++-==============-==============-============================================
ii checkbox 0.13.9 System testing application
ii checkbox-cli 0.13.9 Command line interface for checkbox
the test reports as passed from the CLI:
Test case results report
a: USB tests
: Space when finished
Please choose (a/ ): a
USB tests
usb/insert [pass]
usb/storage-preinserted [pass]
: Space when finished
Please choose ( ):
And the submission.xml shows the pass with details about the testing on the USB stick:
<question name="usb/storage-preinserted">
<answer type="multiple_choice">pass</answer>
<comment>--------------------
removable devices currently mounted:
None
removable devices currently not mounted:
/dev/sdb1
--------------------
Now mounting /dev/sdb1 on /tmp/tmptf7wwt
Found the following mounted ['usb'] partitions:
/dev/sdb1 : /tmp/tmptf7wwt
--------------------
Running ['usb'] file transfer test for 1 iterations
Creating Temp Data file
File name is :/tmp/tmpCFJFdH
File size is 1048576 bytes
Parent hash is: f3c46ef131688ed1aed9a9c91a248028
Copying /tmp/tmpCFJFdH to /tmp/tmptf7wwt
Hashing copy on /tmp/tmptf7wwt
Hash of /tmp/tmptf7wwt/tmpCFJFdH on /tmp/tmptf7wwt is f3c46ef131688ed1aed9a9c91a248028
Now umounting /dev/sdb1 on /tmp/tmptf7wwt
Successfully completed 1 ['usb'] file transfer test iterations
</comment>
Ok redoing the test. Turns out this can be run on a virtual machine (e.g. virtualbox), just make sure to "connect" a USB stick to the virtual machine.
With checkbox 0.13.7:
$ exitESC^H^Hdpkg --list checkbox{,-cli} Unknown/ Install/ Remove/ Purge/Hold Not/Inst/ Conf-files/ Unpacked/ halF-conf/ Half-inst/ trig-aWait/ Trig-pend /Reinst- required (Status,Err: uppercase=bad) ======= ====-== ======= =====-= ======= ======= ======= ======= ======= ======= =
Desired=
| Status=
|/ Err?=(none)
||/ Name Version Description
+++-===
ii checkbox 0.13.7 System testing application
ii checkbox-cli 0.13.7 Command line interface for checkbox
The storage-preinserted test fails:
Test case results report
a: USB tests
: Space when finished
Please choose (a/ ): a
USB tests
usb/insert [pass] storage- preinserted [failESC]
usb/
: Space when finished
Please choose ( ):
The submission.xml report shows the cause for the failure, as expected:
<question name="usb/ storage- preinserted" > choice" >fail</ answer>
<answer type="multiple_
<comment>mount: only root can do that
</comment>
With checkbox 0.13.9: Unknown/ Install/ Remove/ Purge/Hold Not/Inst/ Conf-files/ Unpacked/ halF-conf/ Half-inst/ trig-aWait/ Trig-pend /Reinst- required (Status,Err: uppercase=bad) ======= ====-== ======= =====-= ======= ======= ======= ======= ======= ======= =
Desired=
| Status=
|/ Err?=(none)
||/ Name Version Description
+++-===
ii checkbox 0.13.9 System testing application
ii checkbox-cli 0.13.9 Command line interface for checkbox
the test reports as passed from the CLI:
Test case results report
a: USB tests
: Space when finished
Please choose (a/ ): a
USB tests
usb/insert [pass] storage- preinserted [pass]
usb/
: Space when finished
Please choose ( ):
And the submission.xml shows the pass with details about the testing on the USB stick:
<question name="usb/ storage- preinserted" > choice" >pass</ answer> ------- ------- ------ ------- ------ ------- ------ 1aed9a9c91a2480 28 tmpCFJFdH on /tmp/tmptf7wwt is f3c46ef131688ed 1aed9a9c91a2480 28
<answer type="multiple_
<comment>
removable devices currently mounted:
None
removable devices currently not mounted:
/dev/sdb1
-------
Now mounting /dev/sdb1 on /tmp/tmptf7wwt
Found the following mounted ['usb'] partitions:
/dev/sdb1 : /tmp/tmptf7wwt
-------
Running ['usb'] file transfer test for 1 iterations
Creating Temp Data file
File name is :/tmp/tmpCFJFdH
File size is 1048576 bytes
Parent hash is: f3c46ef131688ed
Copying /tmp/tmpCFJFdH to /tmp/tmptf7wwt
Hashing copy on /tmp/tmptf7wwt
Hash of /tmp/tmptf7wwt/
Now umounting /dev/sdb1 on /tmp/tmptf7wwt
Successfully completed 1 ['usb'] file transfer test iterations
</comment>
I'll set this as verification done.