Desktop ISO smoke testing coverage is not very good

[Iain Lane]

Take a look at

  http://bazaar.launchpad.net/~ubuntu-test-case-dev/ubuntu-test-cases/desktop/view/head:/runlists/default.run

You can see that most of the testcases in

  http://bazaar.launchpad.net/~ubuntu-test-case-dev/ubuntu-test-cases/desktop/files/head:/testsuites/usit/

aren't being run.

We had a bug (bug #1477051) which broke both live and installed desktops, yet smoke testing didn't catch this.

Could we enable more of the testcases which already exist, fix those which don't work, and add one to explicitly test that unity comes up?

Finally, the oem install mode test wasn't triggered like all of the others. We believe this would (or at least should) have failed. See

https://jenkins.qa.ubuntu.com/view/wily/view/Smoke%20Testing/job/wily-desktop-amd64-smoke-oem/

- there's no triggered job for 20150722 (last is #15 at the time of filing).

[Iain Lane (laney)]

Today we have bug #1484571 which broke booting of the live session, yet the image was still promoted to current.

[Iain Lane (laney)]

(jibel says this might be because UTAH uses PXE booting which did still work)