graphics/1_screen_resolution_xxx fail always

[Jerry Kao]

When running graphics/1_screen_resolution_xxx case on HP Z820-2, the display resolution is correct (1920x1080) but test case fail. This issue also can be reproduced on Z230-2 test. Please refer attached screenshot.

test result submission https://certification.canonical.com/hardware/201407-15335/submission/101033/

Test image stella-datong140729-trusty-amd64-20140925-3
BIOS J63 v03.69
kernel 3.13.0-34-generic
Plainbox version
ii plainbox 0.13.1~ppa~ubuntu14.04.1 all toolkit for software and hardware integration testing
ii plainbox-glmark2-es2-meta 0.8~ppa~ubuntu14.04.1 amd64 metapackage to selectively install glmark2-es2
ii plainbox-insecure-policy 0.13.1~ppa~ubuntu14.04.1 all policykit policy required to use plainbox (insecure version)
ii plainbox-provider-certification-client 0.8~ppa~ubuntu14.04.1 all Client Certification
ii plainbox-provider-checkbox 0.12~ppa2~ubuntu14.04.1 amd64 CheckBox provider for PlainBox
ii plainbox-provider-oem 0.1ubuntu28 all plainbox oem provider
ii plainbox-provider-oem-stella 0.1ubuntu28 all plainbox oem provider for stella
ii plainbox-provider-resource-generic 0.10~ppa~ubuntu14.04.1 amd64 CheckBox generic resource jobs provider
ii python3-plainbox 0.13.1~ppa~ubuntu14.04.1 all toolkit for software and hardware testing (python3 module)

[Jerry Kao (jerry.kao)]

screenshot

[Daniel Manrique (roadmr)]

Steps to reproduce:

timeout 5 qmlscene --transparent --fullscreen resolution_test.qml
echo $?

the return value should always be 0 (unless there was an actual error running qmlscene), but is instead 124.

This is the expected behavior of timeout:

       If the command times out, and --preserve-status is not set, then exit
       with status 124. Otherwise, exit with the status of COMMAND.

In this case, it always times out as there's no way to exit the qmlscene itself.

Even so, qmlscene exits with a weird status (143) if --preserve-status is used, so the best way I found to fix this is to wrap qmlscene and handle the weird return value there:

timeout 5 qmlscene --transparent --fullscreen resolution_test.qml
code=$?
if [ $code=124 ]; then
    exit 0
else
    exit $code
fi