I was able to get this working, i think because i have manual provider and not reprovisioning the machines is what gave me issues.
my steps to get a clean build working were:
remove all LVs, VGs, and PGs from ceph apt purge all ceph packages rm -rf /var/lib/ceph dd if=/dev/null of=/dev/{osd-devices} bs=1M count=500
a bit extreme, but faster than reprovisioning.
I was able to get this working, i think because i have manual provider and not reprovisioning the machines is what gave me issues.
my steps to get a clean build working were:
remove all LVs, VGs, and PGs from ceph {osd-devices} bs=1M count=500
apt purge all ceph packages
rm -rf /var/lib/ceph
dd if=/dev/null of=/dev/
a bit extreme, but faster than reprovisioning.