Ceph block device permission gets wrongly reverted by udev

[Ponnuvel Palaniyappan]

When creating OSD block devices, ceph-volume correctly sets the ownership to ceph:ceph. But when osd-encrypt is enabled before the cluster is deployed by Juju, udevadm reverts the permission back to root:disk.

A reproducer is:

Deploy a Mimic or Nautilus Ceph cluster using Juju (A bare-bones Ceph cluster using sts-bundles is sufficient). Then immediately after (before Juju completes the deployment), do

    juju config ceph-osd osd-encrypt=True

Then the OSD units end up in blocked with "No block devices detected using current configuration".

This is caused by [0]

    udevadm trigger --subsystem-match=block --action=add

executed by ceph-osd charm.

This looks ery similar issue that's been fixed in the past [1]. However, the fix proposed there doesn't work here.

[0] https://github.com/openstack/charms.ceph/blob/master/charms_ceph/utils.py#L984
[1] https://bugs.launchpad.net/charm-ceph-osd/+bug/1767087

[Ponnuvel Palaniyappan (pponnuvel)]

James' comment in [0] neatly describes the problem except it's not clear why the same fix isn't working in this situation.

[0] https://bugs.launchpad.net/charm-ceph-osd/+bug/1767087/comments/2

[Ponnuvel Palaniyappan (pponnuvel)]

Fix proposed: https://review.opendev.org/c/openstack/charm-ceph-osd/+/778497

[Ponnuvel Palaniyappan (pponnuvel)]

James Page suggested this might need to be done in the packaging as well.

Once the fix is finalized in charm-ceph-osd, I'll update the udev rules in debian/udev/95-ceph-osd-lvm.rules.

[OpenStack Infra (hudson-openstack)]

Change abandoned by "James Page <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/charm-ceph-osd/+/778497
Reason: This review is > 12 weeks without comment and currently blocked by a core reviewer with a -2. We are abandoning this for now. Feel free to reactivate the review by pressing the restore button and contacting the reviewer with the -2 on this review to ensure you address their concerns.