Ceph OSDs on compute/control fails to deploy

[Tim Rozet]

When deploying with stable/newton and including CephOSD on the control and compute roles, the deployment fails with:

Oct 13 10:59:49 localhost os-collect-config: #033[1;31mError: semanage fcontext -a -t ceph_var_lib_t '/srv/data(/.*)?' && restorecon -R /srv/data returned 1 instead of one of [0]#033[0m
Oct 13 10:59:49 localhost os-collect-config: #033[1;31mError: /Stage[main]/Ceph::Osds/Ceph::Osd[/srv/data]/Exec[fcontext_/srv/data]/returns: change from notrun to 0 failed: semanage fcontext -a -t ceph_var_lib_t '/srv/data(/.*)?' && restorecon -R /srv/data returned 1 instead of one of [0]#033[0m
Oct 13 10:59:49 localhost os-collect-config: #033[1;31mWarning: /Stage[main]/Ceph::Osds/Ceph::Osd[/srv/data]/Exec[ceph-osd-activate-/srv/data]: Skipping because of failed dependencies#033[0m

The error is from this part of osd.pp:
https://github.com/openstack/puppet-ceph/blob/master/manifests/osd.pp#L137

Manually executing the semanage command results in:
 ValueError: Type ceph_var_lib_t is invalid, must be a file or device type

According to this bz https://bugzilla.redhat.com/show_bug.cgi?id=1379797, it is no longer required to label the directories/files for ceph jewel. Should we remove this block?

I can attach my environment files if those help.

[Tim Rozet (trozet)]

Packages:
[root@overcloud-controller-0 ~]# rpm -qa | grep ceph
ceph-common-10.2.2-0.el7.x86_64
ceph-mds-10.2.2-0.el7.x86_64
centos-release-ceph-jewel-1.0-1.el7.centos.noarch
libcephfs1-10.2.2-0.el7.x86_64
ceph-selinux-10.2.2-0.el7.x86_64
ceph-osd-10.2.2-0.el7.x86_64
python-cephfs-10.2.2-0.el7.x86_64
ceph-base-10.2.2-0.el7.x86_64
ceph-10.2.2-0.el7.x86_64
puppet-ceph-2.2.0-0.20161006235119.a9818a2.el7.centos.noarch
ceph-mon-10.2.2-0.el7.x86_64

[Tim Rozet (trozet)]

Looks like the issue is because some missing post config is done by RDO:
/usr/sbin/semodule -i /usr/share/selinux/packages/ceph.pp
/usr/sbin/fixfiles -C /etc/selinux/targeted/contexts/files/file_contexts.pre restore
/usr/sbin/restorecon -R /var/run/ceph

Have opened to track this in RDO:
https://bugzilla.redhat.com/show_bug.cgi?id=1384677

[Emilien Macchi (emilienm)]

This bug was last updated over 180 days ago, as tripleo is a fast moving project and we'd like to get the tracker down to currently actionable bugs, this is getting marked as Invalid. If the issue still exists, please feel free to reopen it.