Post-Installation testcases need to be reviewed

[Nicholas Skaggs]

The post-installation testcases need a proper review and removed or expanded upon, as makes sense for image testing. The current testcases exist solely for the purposes of confirming a working image and are not intended to test functionality of the desktop.

[Javier López (javier-lopez)]

Are you talking about adding an 'post-installation' section to image testcases?

  $ grep -r "*post-installation*" .

returns nothing at the root of the ubuntu-manual-tests repository

[Nicholas Skaggs (nskaggs)]

A couple flavors have post installation tests;

http://bazaar.launchpad.net/~ubuntu-testcase/ubuntu-manual-tests/trunk/view/head:/testcases/image/1455_Post-installation%20%28Ubuntu%20Studio%29
http://bazaar.launchpad.net/~ubuntu-testcase/ubuntu-manual-tests/trunk/view/head:/testcases/image/1433_Post-installation%20%28Xubuntu%29
bazaar.launchpad.net/~ubuntu-testcase/ubuntu-manual-tests/trunk/view/head:/testcases/image/1442_Mythbuntu%20Frontend
http://bazaar.launchpad.net/~ubuntu-testcase/ubuntu-manual-tests/trunk/view/head:/testcases/image/1444_Mythbuntu%20Backend%20%26%20Frontend

However, I'm referring to this testcase:
http://bazaar.launchpad.net/~ubuntu-testcase/ubuntu-manual-tests/trunk/view/head:/testcases/image/1436_Post-Installation%20Tests

It's utilized to confirm the installation of the image. In general, we want to avoid doing what is better done as package/application testing during image testing, however, some post-installation confirmation is useful.

So yes, to what extent should we do post-installation tests and ensure they are flavor agnostic. For example, the <dt>Launch 'firefox' and navigate to http://www.ubuntu.com</dt> step, not every flavor has/uses ubuntu, and this seems like duplication of effort in the firefox testcases (which go beyond just loading ubuntu.com ;-) ). The testcase should ideally be the minimum needed verification of a proper installation.

[Nicholas Skaggs (nskaggs)]

It seems post installation tests are done as flavor specific. Nothing wrong with the test from a ubuntu perspective.