subunit file often missing attachments

[dobey]

When running my tests, very often the subunit file that is created, is missing images, logs, and other test data, which is vital to debugging issues with the tests.

For example, I've added several self.take_screenshot() calls to help debug my tests during each stage of the test interacting with the UI, but very often, these images are missing from the resulting subunit file after running the tests. Often, the stderr, stdout, etc… logs will also be missing from the tests data, especially for tests which are passing.

This makes it very time consuming to debug problems, as one must run the tests over and over ad nausea, until the necessary data eventually shows up in the subunit file.

[dobey (dobey)]

OK. This is resolved by upgrading to the latest testtools, which has many many fixes since the version currently available in debian/ubuntu.

Unfortunately, it requires updated unittest2 as well, and some other new dependencies which are not yet packaged. However, I've got some initial packaging for these, and the latest testtools, in ppa:dobey/testtools and it is working much more reliably for me now.

[Christopher Lee (veebers)]

Rodney, so I take it that it is safe to remove Autopilot as an "affects"? Seems like it's a purely testtools issue.

[dobey (dobey)]

I suppose that would be fine, but you might want to keep it on to track the issue?

[Christopher Lee (veebers)]

Good point :-) Thanks.