Comment 0 for bug 1592632

Version tested: 1.3c2 from Testing PPA

1. Run the "16.04 Certification Tests" (from plainbox-provider-certification-client), and select USB Type-C and Thunderbolt related jobs (for instance, storage tests)
2. When the manifest job asks if this device has USB Type-C ports or Thunderbolt capabilities, answer "No"
3. Keep testing

Expected results:
All the USB Type-C or Thunderbolt related tests should be skipped.

Actual results:
The tests are still displayed and the tester has to "Start" them. Sometimes they are automatically marked as FAILED, but sometimes the tester has to select Pass/Fail.

Note that this problem does not happen with checkbox-cli: the same tests will be skipped automatically because the manifest information evaluates to "false".