run integration tests from autopkgtest

[Steve Langasek]

system-image is a critical piece of infrastructure that needs to be kept in working order; changes should not be allowed to land in the archive that break it, since that risks leaving users high and dry on a phone image that's not upgradable. The best way to guard against this is by having system-image run a full battery of integration tests (including real system-image updates using ubuntu-emulator) from autopkgtest.

This will prevent any direct dependencies of system-image from regressing system-image's functionality.

[Barry Warsaw (barry)]

See also LP: #1321795

[Barry Warsaw (barry)]

I'm having issues with the emulator, such as it consuming all cpu and freezing my cursor. I think more experimentation needs to be done, and I don't want to hold up s-i 2.3, so I'm postponing this.

[Barry Warsaw (barry)]

I'm marking this as won't fix due to the new policy prohibiting internet access from DEP-8 based pocket promotion tests. It is my opinion that DEP-8 format should be preserved for defining integration tests with external services (which include system-image.u.c) but which are not tied directly to pocket promotion. E.g. a separate CI based integration test system would use these to ensure integration tests are automated, but they would not be run at pocket promotion time.

When such a system is available, I'll reopen this bug, or open a new one to track such tests.