Run more tests on fuel community ISO

[Daniele Pizzolli]

Most of the development of fuel core and plugins happens in the open.

But the fuel-qa (which also contain tests for plugins) does not run
the community ISO.

Please run fuel-qa on the community ISO since it will enable 3rd party
developers to gain an insight about the status of the project(s).

The discussion started at in IRC:
http://irclog.perlgeek.de/fuel-dev/2015-06-10#i_10728917

[Aleksandra Fedorova (bookwar)]

Let me clarify a bit:

fuel-qa/ is a framework to run system tests. There is a huge number of test groups in there and we run different subset of these test cases on different occasions.

We run tests for community iso: there are bvt_1 and bvt_2 test groups from fuel-qa/ repo which we trigger for every community build:
https://ci.fuel-infra.org/view/ISO/

These are full HA deployment scenarios exactly the same we run on internal iso builds.

We also run additional huge set of system tests not automatically triggered by timer, but managed by QA team. As it is huge duplicating the effort and copying it for community iso builds is just too much resources.

There are certain plans and discussion for 7.0 release cycle to make all our builds open and switch to common open workflow, including open test results. This won't be fast, so please watch the updates on openstack-dev mailing list.

//bookwar at IRC

[Ivan (iremizov)]

Mark as won't fix, because:
- requirements are unclear (which test to run, how often, etc)
- it's old bug withot activity
- since bug was filed we made a lot of work and now we have huge subset of tests which run on comunity ISO too..