cephadm does not work with zfs root
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
zfs-linux (Arch Linux) |
New
|
Undecided
|
Unassigned | ||
zfs-linux (Ubuntu) |
In Progress
|
Undecided
|
Andrea Righi |
Bug Description
When trying to install ceph on ubuntu 20.04 with zfs as root file system the OSD's do not come up.
The OSD's give an error of:
May 29 16:51:11 ip-10-0-0-148 systemd[1]: <email address hidden>: Main process exited, code=exited, status=1/FAILURE
May 29 16:51:12 ip-10-0-0-148 systemd[1]: <email address hidden>: Failed with result 'exit-code'.
May 29 16:51:22 ip-10-0-0-148 systemd[1]: <email address hidden>: Scheduled restart job, restart counter is at 4.
May 29 16:51:22 ip-10-0-0-148 systemd[1]: Stopped Ceph osd.0 for a3ed1cb2-
May 29 16:51:22 ip-10-0-0-148 systemd[1]: Starting Ceph osd.0 for a3ed1cb2-
May 29 16:51:22 ip-10-0-0-148 docker[114525]: Error: No such container: ceph-a3ed1cb2-
May 29 16:51:22 ip-10-0-0-148 systemd[1]: Started Ceph osd.0 for a3ed1cb2-
May 29 16:51:23 ip-10-0-0-148 bash[114543]: Running command: /usr/bin/mount -t tmpfs tmpfs /var/lib/
May 29 16:51:23 ip-10-0-0-148 bash[114543]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/
May 29 16:51:23 ip-10-0-0-148 bash[114543]: Running command: /usr/bin/
May 29 16:51:23 ip-10-0-0-148 bash[114543]: Running command: /usr/bin/ln -snf /dev/ceph-
May 29 16:51:23 ip-10-0-0-148 bash[114543]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/
May 29 16:51:23 ip-10-0-0-148 bash[114543]: Running command: /usr/bin/chown -R ceph:ceph /dev/mapper/
May 29 16:51:23 ip-10-0-0-148 bash[114543]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/
May 29 16:51:23 ip-10-0-0-148 bash[114543]: --> ceph-volume lvm activate successful for osd ID: 0
May 29 16:51:24 ip-10-0-0-148 bash[115166]: debug 2020-05-
May 29 16:51:24 ip-10-0-0-148 bash[115166]: debug 2020-05-
May 29 16:51:24 ip-10-0-0-148 bash[115166]: debug 2020-05-
May 29 16:51:24 ip-10-0-0-148 bash[115166]: debug 2020-05-
Using ubuntu 20.04 without root zfs works fine.
Changed in zfs-linux (Ubuntu): | |
assignee: | nobody → Andrea Righi (arighi) |
I've tried to reproduce the problem on a VM (that uses ZFS as rootfs) setting up a single-node ceph cluster, but OSD is coming up correctly:
$ sudo ceph -s | grep osd
osd: 1 osds: 1 up (since 50m), 1 in (since 59m)
Could you provide more details about your particular ceph configuration / infrastructure, so that I can try to reproduce the problem in an environment more similar to yours? Thanks.