Desktop ISO smoke testing coverage is not very good

Bug #1477227 reported by Iain Lane on 2015-07-22
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Ubuntu Test Cases
Undecided
Unassigned

Bug Description

Take a look at

  http://bazaar.launchpad.net/~ubuntu-test-case-dev/ubuntu-test-cases/desktop/view/head:/runlists/default.run

You can see that most of the testcases in

  http://bazaar.launchpad.net/~ubuntu-test-case-dev/ubuntu-test-cases/desktop/files/head:/testsuites/usit/

aren't being run.

We had a bug (bug #1477051) which broke both live and installed desktops, yet smoke testing didn't catch this.

Could we enable more of the testcases which already exist, fix those which don't work, and add one to explicitly test that unity comes up?

Finally, the oem install mode test wasn't triggered like all of the others. We believe this would (or at least should) have failed. See

https://jenkins.qa.ubuntu.com/view/wily/view/Smoke%20Testing/job/wily-desktop-amd64-smoke-oem/

- there's no triggered job for 20150722 (last is #15 at the time of filing).

Iain Lane (laney) wrote :

Today we have bug #1484571 which broke booting of the live session, yet the image was still promoted to current.

Iain Lane (laney) wrote :

(jibel says this might be because UTAH uses PXE booting which did still work)

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers