OSD data dir expected in /var/lib/ceph/osd

[Erno Kuvaja]

Ceph expects all OSDs to be in /var/lib/ceph/osd we currently overwrite this with /srv/data.

Ceph is able to deal with this by creating symbolic links to /var/lib/ceph/osd but there is really no reason to change the default. The current specified directory is also really generic by the name and does not give admin direct indication what it is used for.

As the symbolic links are created on the nodes, changing this to the default /var/lib/ceph/osd should not affect the upgrade.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/326376

[Giulio Fidente (gfidente)]

currently we have in /var/lib/ceph/osd a number of symlinks (eg /var/lib/ceph/osd/ceph-0) for each dir-based osd path

is this really an issue?

[Steven Hardy (shardy)]

There are questions around the upgrade impact of this change, deferring to n-3 and we can discuss either here or on the review.

[OpenStack Infra (hudson-openstack)]

Change abandoned by Erno Kuvaja (<email address hidden>) on branch: master
Review: https://review.openstack.org/326376
Reason: Too risky

[Giulio Fidente (gfidente)]

I think the only problem with this is the SELinux label applied on /srv/data.

In theory we want puppet-ceph to label the data path correctly as we don't know in advance which one it will be. This is tracked via https://bugs.launchpad.net/puppet-ceph/+bug/1611893 .

In addition to that, we're trying to add in ceph-selinux /srv/data as a default path so labeling won't be needed. Swift does the same with /srv/node path.

I think we can "close" this as soon as one the above is resolved.

[Emilien Macchi (emilienm)]

Fixed in puppet-ceph by https://github.com/openstack/puppet-ceph/commit/f13493abc38cb13eec94bf203f15ec1d26d7ad28