ceph installation fails in ubuntu 24.04

[Rajat Dhasmana]

While trying to install devstack with ceph in Ubuntu 24.04, I faced the following error:

+/opt/stack/devstack-plugin-ceph/devstack/lib/cephadm:add_osds:270 echo 'Creating osd /dev/ceph_vg/ceph_lv_data on node ubuntu-VirtualBox'
Creating osd /dev/ceph_vg/ceph_lv_data on node ubuntu-VirtualBox
++/opt/stack/devstack-plugin-ceph/devstack/lib/cephadm:add_osds:271 sudo /usr/bin/cephadm shell --fsid f8e3f619-c6c5-4975-bcce-c3e25f62d022 --config /etc/ceph/ceph.conf --keyring /etc/ceph/ceph.client.admin.keyring -- ceph orch daemon add osd ubuntu-VirtualBox:/dev/ceph_vg/ceph_lv_data
Inferring config /var/lib/ceph/f8e3f619-c6c5-4975-bcce-c3e25f62d022/mon.ubuntu-VirtualBox/config
Using ceph image with id '2bc0b0f4375d' and tag 'v18.2' created on 2024-07-23 22:19:35 +0000 UTC
quay.io/ceph/ceph@sha256:6ac7f923aa1d23b43248ce0ddec7e1388855ee3d00813b52c3172b0b23b37906
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/usr/bin/cephadm/__main__.py", line 10889, in <module>
  File "/usr/bin/cephadm/__main__.py", line 10877, in main
  File "/usr/bin/cephadm/__main__.py", line 2576, in _infer_config
  File "/usr/bin/cephadm/__main__.py", line 2492, in _infer_fsid
  File "/usr/bin/cephadm/__main__.py", line 2558, in _infer_config
  File "/usr/bin/cephadm/__main__.py", line 2604, in _infer_image
  File "/usr/bin/cephadm/__main__.py", line 2479, in _validate_fsid
  File "/usr/bin/cephadm/__main__.py", line 7010, in command_shell
  File "/usr/bin/cephadm/__main__.py", line 3560, in get_container_mounts
  File "/usr/bin/cephadm/__main__.py", line 9877, in selinux_enabled
  File "/usr/bin/cephadm/__main__.py", line 9860, in kernel_security
  File "/usr/bin/cephadm/__main__.py", line 9841, in _fetch_apparmor
ValueError: too many values to unpack (expected 2)
+/opt/stack/devstack-plugin-ceph/devstack/lib/cephadm:add_osds:1 exit_trap
+./stack.sh:exit_trap:540 local r=1
++./stack.sh:exit_trap:541 jobs -p
+./stack.sh:exit_trap:541 jobs=566979
+./stack.sh:exit_trap:544 [[ -n 566979 ]]
+./stack.sh:exit_trap:544 [[ -n '' ]]
+./stack.sh:exit_trap:550 '[' -f '' ']'
+./stack.sh:exit_trap:555 kill_spinner
+./stack.sh:kill_spinner:450 '[' '!' -z '' ']'
+./stack.sh:exit_trap:557 [[ 1 -ne 0 ]]
+./stack.sh:exit_trap:558 echo 'Error on exit'
Error on exit
+./stack.sh:exit_trap:560 type -p generate-subunit
+./stack.sh:exit_trap:561 generate-subunit 1731573434 312 fail
+./stack.sh:exit_trap:563 [[ -z /opt/stack/logs ]]
+./stack.sh:exit_trap:566 /opt/stack/data/venv/bin/python3 /opt/stack/devstack/tools/worlddump.py -d /opt/stack/logs
World dumping... see /opt/stack/logs/worlddump-2024-11-14-084226.txt for details
+./stack.sh:exit_trap:575 exit 1

LOCAL.CONF file

[[local|localrc]]
ADMIN_PASSWORD=secret
DATABASE_PASSWORD=$ADMIN_PASSWORD
RABBIT_PASSWORD=$ADMIN_PASSWORD
SERVICE_PASSWORD=$ADMIN_PASSWORD

enable_plugin devstack-plugin-ceph https://opendev.org/openstack/devstack-plugin-ceph

ENABLE_CEPH_CINDER=True # ceph backend for cinder
ENABLE_CEPH_GLANCE=True # store images in ceph
ENABLE_CEPH_C_BAK=True # backup volumes to ceph
ENABLE_CEPH_NOVA=True # allow nova to use ceph resources

GLANCE_SHOW_DIRECT_URL=True
GLANCE_SHOW_MULTIPLE_LOCATIONS=True
HOST_IP=127.0.0.1

# Enable barbican
enable_plugin barbican https://opendev.org/openstack/barbican
enable_service rabbit mysql key tempest

[Carlos da Silva (silvacarlose)]

Hey, thanks for the report. Apparently, this is an issue with Ceph: https://www.spinics.net/lists/ceph-users/msg83201.html
It is likely going to block our Ubuntu 24.04 testing until this issue is fixed.

[Goutham Pacha Ravi (gouthamr)]

Hi,

I haven't tried this locally yet.. somehow, we don't seem to hit this issue on the OpenStack CI: https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/935398/

The app-armor handling bug on ceph: https://tracker.ceph.com/issues/66389
It has been fixed in main and squid currently; but needs fixes in reef (devstack-plugin-ceph's default) and quincy.

[Goutham Pacha Ravi (gouthamr)]

I'm closing this bug since a change has been made to Ceph in all current releases, and both Reef and Squid are deployable on Ubuntu 24.04 LTS with devstack-plugin-ceph. Please report another bug if this resolution doesn't work for you