[Timbuktu 18.04]Touchscreen cases are failed due to qmlscene call touch_*_test.qml error

[Alex Wen]

Image: pc-timbuktu-bionic-amd64-m3-20180412-29
Platforms: Storm3-1,Tata2AMD-2,Windu2-1

Steps:
1. Install pc-timbuktu-bionic-amd64-m3-20180412-29 image.
2. Use boxer to install sutton provider.
3. Execute checkbox by "sutton-cli"
4. Run touchscreen cases.

u@u-ThinkPad-T480:/usr/share/plainbox-provider-checkbox/data$ checkbox-cli -v
INFO:plainbox.config:Loading configuration from ['/etc/xdg/plainbox.conf', '/home/u/.config/plainbox.conf']
INFO:plainbox.secure.providers.v1:Provider initialized com.canonical.ce:oem, version 1.0
INFO:plainbox.secure.providers.v1:Provider initialized certification-client, version 0.33.0
INFO:plainbox.secure.providers.v1:Provider initialized plainbox-provider-checkbox, version 0.43.0
INFO:plainbox.secure.providers.v1:Provider initialized plainbox-provider-resource-generic, version 0.36.0
INFO:plainbox.secure.providers.v1:Provider initialized plainbox-provider-tpm2, version 1.7.0
INFO:plainbox.secure.providers.v1:Provider initialized com.canonical.plainbox:manifest, version 1.0
INFO:plainbox.secure.providers.v1:Provider initialized com.canonical.plainbox:exporters, version 1.0
INFO:plainbox.secure.providers.v1:Provider initialized com.canonical.plainbox:categories, version 1.0
=========================[ Resume Incomplete Session ]==========================

u@u-ThinkPad-T480:/usr/share/plainbox-provider-checkbox/data$ qmlscene -qt5 touch_rotate_test.qml
file:///usr/share/plainbox-provider-checkbox/data/touch_rotate_test.qml:19 module "QtQuick" is not installed

[Alex Wen (ronglu-wen)]

Run touchpad/palm-rejection are failed too.
The output log
-------------[ Running job 30 / 31. Estimated time left: unknown ]--------------
--------------------------[ touchpad/palm-rejection ]---------------------------
ID: com.canonical.certification::touchpad/palm-rejection
Category: com.canonical.plainbox::touchpad
... 8< -------------------------------------------------------------------------
"/tmp/cwd-q2dvwnh0.54a7fe09e4a3c5c912310465db561f891528771fdb75cfe90361933752bf7665/9" does not exist.
"/tmp/cwd-q2dvwnh0.54a7fe09e4a3c5c912310465db561f891528771fdb75cfe90361933752bf7665/10" does not exist.
"/usr/lib/python3/dist-packages/plainbox/data/qml-shell/plainbox_qml_shell.qml" does not exist.
Gtk-Message: 02:59:03.930: GtkDialog mapped without a transient parent. This is discouraged.
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:22 module "QtQuick.Controls" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:21 module "QtQuick.Layouts" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:23 module "Plainbox" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:20 module "QtQuick" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:22 module "QtQuick.Controls" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:21 module "QtQuick.Layouts" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:23 module "Plainbox" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:20 module "QtQuick" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:22 module "QtQuick.Controls" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:21 module "QtQuick.Layouts" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:23 module "Plainbox" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:20 module "QtQuick" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:22 module "QtQuick.Controls" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:21 module "QtQuick.Layouts" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:23 module "Plainbox" is not installed
file:///usr/share/plainbox-provider-checkbox/data/palm_rejection.qml:20 module "QtQuick" is not installed

------------------------------------------------------------------------- >8 ---
ERROR:plainbox.ctrl:QML job did not return a proper json object
Outcome: job failed

[Betty Lin (bettyl)]

Here is more information for running touchscreen test cases:

In plainbox-provider-checkbox/units/touchscreen/jobs.pxu:

It runs the command 'manage_compiz_plugin unityshell disable' first, and it will return error and exit

***Error***
No such schema “org.compiz.core”
Traceback (most recent call last):
  File "/tmp/nest-gt_qbs74.d6786afeeb642652d005f47de78e4516f46ccb5b5c3aa9d361bb9a35a736f083/manage_compiz_plugin", line 43, in <module>
    plugins = eval(subprocess.check_output(["gsettings", "get", PATH, KEY]))
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['gsettings', 'get', 'org.compiz.core:/org/compiz/profiles/unity/plugins/core/', 'active-plugins']' returned non-zero exit status 1.
No such schema “org.compiz.core”
Traceback (most recent call last):
  File "/tmp/nest-gt_qbs74.d6786afeeb642652d005f47de78e4516f46ccb5b5c3aa9d361bb9a35a736f083/manage_compiz_plugin", line 43, in <module>
    plugins = eval(subprocess.check_output(["gsettings", "get", PATH, KEY]))
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['gsettings', 'get', 'org.compiz.core:/org/compiz/profiles/unity/plugins/core/', 'active-plugins']' returned non-zero exit status 1.
***Error***

In 18.04, there is no unity anymore.

[Sylvain Pineau (sylvain-pineau)]

I had to transfer the qml dependencies to the plainbox-provider-certification-client to avoid pulling them when testing servers. That's why I've proposed (and landed) a packaging update for the oem-plainbox provider to now depend on it instead of plainbox-provider-checkbox: https://code.launchpad.net/~sylvain-pineau/oem-qa-checkbox/+git/oem-plainbox/+merge/344847

[Pierre Equoy (pieq)]

Tested with Checkbox stack from the Testing PPA:

- checkbox-ng 1.1.0rc1
- checkbox-support 0.38.0rc1
- plainbox-provider-resource 0.37.0rc1
- plainbox-provider-checkbox 0.45.0rc1
- plainbox-provider-sru 1.11.0rc1
- plainbox-provider-certification-client 0.34.0rc1
- plainbox-provider-certification-server 0.39.0rc1

using device 201708-25679.

The jobs can now be launched and appear on the screen.

Some of these jobs fail, though, and I opened another issue to track this problem: lp:1769082