CI should test upgrades of ceph-ansible-based deployments (e.g. pike > queens)

[John Fulton]

TripleO CI tests Ceph deployments via ceph-ansible but not upgrades.

We tried adding Ceph to the upgrade job but couldn't [1] because we can only use a single node in upstream CI and ceph-ansible does not support upgrading a cluster with a single mon [2]. As an alternative we can run an upgrade job, with Ceph, in RDO infra which is part of the RDO Third Party CI.

The first step to address this is to make featureset 24 [3], when it is run for pike, test ceph-ansible, not puppet-ceph. To do this we need to make THT have an environment file which will provide a virtual block device (ceph-ansible requires this) for featureset 24 to use. The next step after that will be to update the OVB 3 controller upgrade job to use Ceph with the block device. The 3 controllers will let us have 3 monitors which ceph-ansible will support for upgrades. Going forward we will then have ceph upgrades test as part of RDO Third Party CI.

[1] https://review.openstack.org/#/c/568229/
[2] https://bugzilla.redhat.com/show_bug.cgi?id=1576386
[3] https://github.com/openstack/tripleo-quickstart/blob/7fa967f57663216d67f6fbc062e8c99ed5b3256e/config/general_config/featureset024.yml

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/570469

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/pike
Review: https://review.openstack.org/570473

[OpenStack Infra (hudson-openstack)]

Change abandoned by John Fulton (<email address hidden>) on branch: stable/pike
Review: https://review.openstack.org/570473
Reason: don't need anymore as per https://review.rdoproject.org/r/#/c/15000/9

[Giulio Fidente (gfidente)]

We can only test Ceph upgrade in RDO infra because we need at least 3 controllers; we could probably enable Ceph in the HA job (colocating the OSDs on the compute, so we don't add more nodes) and have "upgrade" run on that config.