OpenStack on LXD guide bundles fail with ZFS store and ceph-osd with bluestore bundles

[Sadin Nurkic]

When following the instructions from: https://docs.openstack.org/charm-guide/latest/openstack-on-lxd.html - ceph-osd fails to initialise with the bionic-rocky bundle.

This bug is related to: https://bugs.launchpad.net/charm-ceph/+bug/1713099/

ceph-osd fails to initialize when the ZFS store is used on latest bionic-rocky bundle from https://github.com/openstack-charmers/openstack-on-lxd

bluestore storage backend is not compatible with zfs

Config from default bundles in the openstack-on-lxd repo has the following:

  ceph-osd:
    annotations:
      gui-x: '1000'
      gui-y: '500'
    charm: cs:~openstack-charmers-next/ceph-osd
    num_units: 3
    options:
      osd-devices: /srv/osd
      use-direct-io: False
      source: cloud:bionic-rocky

error summary:

2018-12-06 17:08:31 DEBUG mon-relation-changed 2018-12-06 17:08:31.614 7f87d2eb9240 -1 bdev(0x56086f242700 /srv/osd/block) open open got: (22) Invalid argument
2018-12-06 17:08:31 DEBUG mon-relation-changed 2018-12-06 17:08:31.614 7f87d2eb9240 -1 bluestore(/srv/osd) mkfs failed, (22) Invalid argument
2018-12-06 17:08:31 DEBUG mon-relation-changed 2018-12-06 17:08:31.614 7f87d2eb9240 -1 OSD::mkfs: ObjectStore::mkfs failed with error (22) Invalid argument
2018-12-06 17:08:31 DEBUG mon-relation-changed 2018-12-06 17:08:31.618 7f87d2eb9240 -1 ** ERROR: error creating empty object store in /srv/osd: (22) Invalid argument

system details:
4.15.0-42-generic #45-Ubuntu SMP Thu Nov 15 19:32:57 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

$ lxd version
3.7

[Sadin Nurkic (sadin999)]

Disabling bluestore with bluestore: False resolves the issue in the bundles.

  ceph-osd:
    annotations:
      gui-x: '1000'
      gui-y: '500'
    charm: cs:~openstack-charmers-next/ceph-osd
    num_units: 3
    options:
      bluestore: False
      osd-devices: /srv/osd
      use-direct-io: False
      source: cloud:bionic-rocky

[James Page (james-page)]

This should be raised against the openstack-on-lxd repo in github.