Side note, I was initially unable to manually recover because I was restarting the wrong ceph-volume service:
root@cephtest:~# systemctl -a| grep ceph-volume <email address hidden> loaded activating start start Ceph Volume activation: bbfc0235-f8fd-458b-9c3d-21803b72f4bc <email address hidden> loaded inactive dead Ceph Volume activation: lvm-2-bbfc0235-f8fd-458b-9c3d-21803b72f4bc
i.e. there are two and it is the lvm* one that needs restarting (i tried to restart the other which didnt work).
Side note, I was initially unable to manually recover because I was restarting the wrong ceph-volume service:
root@cephtest:~# systemctl -a| grep ceph-volume f8fd-458b- 9c3d-21803b72f4 bc f8fd-458b- 9c3d-21803b72f4 bc
<email address hidden>
loaded activating start start Ceph Volume activation: bbfc0235-
<email address hidden>
loaded inactive dead Ceph Volume activation: lvm-2-bbfc0235-
i.e. there are two and it is the lvm* one that needs restarting (i tried to restart the other which didnt work).