Installing overcloud with block/object storage node and ceph backend doesn't work.

[Sofer Athlan-Guyot]

... Or I may be missing something.

Hi,

This is done testing an upgrade from mitaka to newton. At mitaka
installation and at newton upgrade the ceph configuration is lacking
on the blockstorage node.

deploying the mitaka overcloud using:

openstack overcloud deploy --templates --libvirt-type qemu \
          --control-flavor baremetal \
          --compute-flavor baremetal \
          --block-storage-flavor baremetal \
          --ceph-storage-flavor baremetal \
          --swift-storage-flavor baremetal \
          --control-scale 3 \
          --compute-scale 1 \
          --neutron-network-type vxlan --neutron-tunnel-types vxlan \
          --ntp-server pool.ntp.org \
          --timeout 90 \
          -e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml \
          -e /usr/share/openstack-tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml \
          -e $HOME/network-environment.yaml \
          -e /usr/share/openstack-tripleo-heat-templates/environments/config-debug.yaml \
          -e /home/stack/deploy_env.yaml \
# important part:
            --block-storage-scale 1 \
            --swift-storage-scale 1 \
            --ceph-storage-scale 1 \
            -e /usr/share/openstack-tripleo-heat-templates/environments/storage-environment.yaml

configures cinder to use the rbd backend but the ceph configuration is
missing on the blockstorage nodes.

    [root@overcloud-blockstorage-0 ~]# ls -lrth /etc/ceph/
    total 4.0K
    -rwxr-xr-x. 1 root root 92 Aug 30 22:24 rbdmap

and on mitaka the cinder.conf on the blockstorage is missing any related rbd configuration altogether.

After an successful upgrade to newton the config has this:

    enabled_backends = tripleo_ceph,
    [tripleo_ceph]
    volume_driver=cinder.volume.drivers.rbd.RBDDriver
    rbd_pool=volumes
    backend_host=hostgroup
    rbd_secret_uuid=
    volume_backend_name=tripleo_ceph
    rbd_user=openstack
    rbd_ceph_conf=/etc/ceph/ceph.conf

still lacking the necessary bits: rbd_secret_uuid and ceph.conf,
ceph.client.openstack.keyring, ceph.client.admin.keyring files in
/etc/ceph

This make the creation of a instance with an attached volume fails.

[Giulio Fidente (gfidente)]

For mitaka, this is the expected behaviour. The blockstorage nodes only run the cinder/lvm driver.

The same should be true for newton, did you add some ceph service to the blockstorage role?

[Sofer Athlan-Guyot (sofer-athlan-guyot)]

As a workaround, you can add this environment file during the blockstorage and controller upgrade:

parameter_defaults:
  BlockStorageExtraConfig:
    tripleo::profile::base::cinder::volume::cinder_enable_iscsi_backend: true
    tripleo::profile::base::cinder::volume::cinder_enable_rbd_backend: false

which makes the blockstorge nodes working again.

also tracked there https://bugzilla.redhat.com/show_bug.cgi?id=1393800

[Emilien Macchi (emilienm)]

This bug was last updated over 180 days ago, as tripleo is a fast moving project and we'd like to get the tracker down to currently actionable bugs, this is getting marked as Invalid. If the issue still exists, please feel free to reopen it.