screenshot_validation could not find external webcam correctly

[Taihsiang Ho]

Ubuntu 16.04.1
Dell Inspiron 3048 - Caspian AIO (CID 201401-14508)

[Description]

When manually checking the external webcam, we could play video with a external webcam. However checkbox reports "video source not found"

[Steps to Reproduce]

Run sru.pxu testplan

[Expected Results]
graphics/screenshot_opencv_validation should run and validate the picture.

[Actual Result]
Error message: ERROR: video source not found: /dev/external_webcam

[More Info]

- This issue is only found on Xenial so far.
- A submission result having this failure https://certification.canonical.com/hardware/201401-14508/submission/122689/

------------

ubuntu@immune-tuna-201401-14508:~$ dpkg -l '*checkbox*' '*plainbox*'
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-=============================================-===========================-===========================-===============================================================================================
un checkbox <none> <none> (no description available)
ii checkbox-converged 1.2.4-0ubuntu1 all testing tool for all Ubuntu devices
ii checkbox-gui 1.2.4-0ubuntu1 all QML based interface for checkbox (transitional package)
ii checkbox-ng 0.35.0~rc2+git201709011350+ all PlainBox based test runner
ii plainbox 0.37.0~rc2+git201709070710+ all toolkit for software and hardware integration testing
ii plainbox-insecure-policy 0.37.0~rc2+git201709070710+ all policykit policy required to use plainbox (insecure version)
ii plainbox-provider-checkbox 0.39.0+git201709130755+pkg6 amd64 CheckBox provider for PlainBox
ii plainbox-provider-resource-generic 0.33.0+git201708221713+pkg4 amd64 CheckBox generic resource jobs provider
ii plainbox-provider-sru 1.8.0+git201709081415+pkg16 all CheckBox SRU jobs provider
un plainbox-secure-policy <none> <none> (no description available)
ii python3-checkbox-ng 0.35.0~rc2+git201709011350+ all PlainBox based test runner (Python 3 library)
ii python3-checkbox-support 0.36.0~rc2+git201709111925+ all collection of Python modules used by PlainBox providers
ii python3-plainbox 0.37.0~rc2+git201709070710+ all toolkit for software and hardware testing (python3 module)

[Taihsiang Ho (tai271828)]

It is not reproducible with Trusty (Trusty 3.13 and Trusty 4.4).

[Taihsiang Ho (tai271828)]

graphics/screenshot_opencv_validation passed submission for Trusty 4.4 https://certification.canonical.com/hardware/201304-13197/submission/122517/test/58020/result/9136685/

[Gavin Lin (gavin.lin)]

Can reproduce on following systems with Trusty 4.4, the usb webcam device is /dev/video0 instead of /dev/external_webcam.

201612-25281:
Base image: dell-bto-trusty-berlinetta-p-X29-iso-20160115-1
Current kernel: 4.4.0-96-generic #119~14.04.1

201507-18778:
Base image: dell-bto-trusty-dino2-X29-iso-20160118-0
Current kernel: 4.4.0-96-generic #119~14.04.1

[Taihsiang Ho (tai271828)]

Thanks for spineau's comment. The default job comment use /dev/external_webcam which comes form checkbox-satellite preseed.

The preseed comes from checkbox-message hardcoded configuration as a part of the initial input parameters. In checkbox-message it is hardcoded two webcam models.

Conclusion:
If the system is not provisioned by checkbox-satellite, it wont has /dev/external_webcam. So this opencv test will failed.

[Sylvain Pineau (sylvain-pineau)]

We dropped this test from SRU test plan