Comment 2 for bug 1087415

I've linked to a branch with modifications to execute the tests inside pbuilder. Some caveats:

1. A credential file with user/password is required to actually run them. Not an issue in PS Jenkins, can be downloaded using a hook.
2. Our CI infrastructure don't have direct connection to the Internet, we use a special VM for site tests. Non-issue in PS Jenkins, can use it as slave.
3. This tests are prone to temporary errors. The experience tell us that sites sometimes report failures, so we decided to get notifications of non-temporary failures (+3 hours). Jenkins may not be so patient. Opinions?
4. All site tests are executed (we may get failures from the unmodified sites).