Kolla ceph_osd bootstrap doesn't work with NVMe drives

Bug #1806896 reported by Marius L
34
This bug affects 5 people
Affects Status Importance Assigned to Milestone
kolla
Fix Released
Medium
Michal Nasiadka

Bug Description

In the linux systems, the NVMe drives are named like /dev/nvme0n1 and partitions are appended with "p", like /dev/nvme0n1p1.

After tagging the nvme devices with "KOLLA_CEPH_OSD_BOOTSTRAP_BS", the bootstrap_ceph_osd container create wrong partition names: "/dev/nvme0n11" instead of "/dev/nvme0n1p1", resulting the following error:

"Problem opening /dev/nvme0n11 for reading! Error is 2.
The specified file does not exist!
Problem opening '' for writing! Program will now terminate.
Warning! MBR not overwritten! Error is 2!"

Tags: kolla ceph
Revision history for this message
Eric Miller (erickmiller) wrote :

In case this helps someone, I modified the current master files to clean up a few things and allow for nvme drives to be used. Not much has changed over the past year or so, so the master version was plenty good. We use Rocky currently and these changes work fine. I have only tested a bluestore deployment, where we have both SATA SSDs and HDDs, and now NVMe SSDs (all assigned to their respective Ceph device classes).

Note that we tried to get LVM working, but too many changes were required, so these changes only allow a single OSD to use an NVMe device.

Maybe someone can review and merge the changes into master?

The two files that need adjustment are:
/usr/share/kolla/docker/ceph/ceph-osd/extend_start.sh
/usr/share/kolla/docker/kolla-toolbox/find_disks.py

See the attached files.

Eric

Changed in kolla:
status: New → Triaged
assignee: nobody → Michal Nasiadka (mnasiadka)
milestone: none → 9.0.0
Mark Goddard (mgoddard)
Changed in kolla:
importance: Undecided → Medium
Revision history for this message
Michal Nasiadka (mnasiadka) wrote :
Changed in kolla:
status: Triaged → Fix Committed
Marcin Juszkiewicz (hrw)
Changed in kolla:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.