package cephadm: dependency "cephadmlib" missing

[Marco]

[ Impact ]
cephadm tool is not usable due to files missing from the package.

[ Test Plan ]
sudo apt install cephadm
cephadm bootstrap --mon-ip 10.23.127.2

[ Where problems could occur ]
While fixing the minor packaging issue that causes this problem it was also noticed that the package is architecture any rather than all (and its pure python) so the packaging update includes this as well.

[ Original Bug Report ]
After installing cephadm at least on arm64 cephadmlib is missing.

Traceback (most recent call last):
  File "/usr/sbin/cephadm", line 33, in <module>
    from cephadmlib.constants import (
ModuleNotFoundError: No module named 'cephadmlib'

Steps to reproduce (on ARM64)

root@ceph-node1:~# apt install -y cephadm
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following additional packages will be installed:
  bridge-utils containerd dns-root-data dnsmasq-base docker.io pigz runc ubuntu-fan
Suggested packages:
  ifupdown aufs-tools cgroupfs-mount | cgroup-lite debootstrap docker-buildx docker-compose-v2
  docker-doc rinse zfs-fuse | zfsutils
The following NEW packages will be installed:
  bridge-utils cephadm containerd dns-root-data dnsmasq-base docker.io pigz runc ubuntu-fan
0 upgraded, 9 newly installed, 0 to remove and 0 not upgraded.

root@ceph-node1:~# cephadm bootstrap --mon-ip 10.23.127.2

Traceback (most recent call last):
  File "/usr/sbin/cephadm", line 33, in <module>
    from cephadmlib.constants import (
ModuleNotFoundError: No module named 'cephadmlib'

ProblemType: Bug
DistroRelease: Ubuntu 24.04
Package: cephadm 19.2.0~git20240301.4c76c50-0ubuntu6
ProcVersionSignature: Ubuntu 6.8.0-31.31-generic 6.8.1
Uname: Linux 6.8.0-31-generic aarch64
ApportVersion: 2.28.1-0ubuntu2
Architecture: arm64
CasperMD5CheckResult: pass
Date: Thu Apr 25 13:49:50 2024
InstallationDate: Installed on 2024-04-25 (0 days ago)
InstallationMedia: Ubuntu-Server 24.04 LTS "Noble Numbat" - Release arm64 (20240423)
ProcEnviron:
 LANG=en_US.UTF-8
 LC_CTYPE=C.UTF-8
 PATH=(custom, no user)
 SHELL=/bin/bash
 TERM=xterm-256color
SourcePackage: ceph
UpgradeStatus: No upgrade log present (probably fresh install)

[Frank Barton (bartonf.husson.edu)]

I am also able to replicate this on a fresh install of 24.04 LTS

[Johan Bosch (int0x21)]

Can confirm this on fresh install of 24.04 LTS amd64
Its also in caracal cloud repo ppa

[Johan Bosch (int0x21)]

A temporary fix is to check out source package build and copy out cephadmlib

apt source cephadm
cd ceph-19.2.0~git20240301.4c76c50/
debuild -us -uc
mkdir /usr/lib/python3/dist-packages/cephadmlib
cp -R ./debian/tmp/usr/lib/python3/dist-packages/cephadmlib/* /usr/lib/python3/dist-packages/cephadmlib/

currently the build script ignores copying the cephadmlib (dont know why and im not familiar enough with the scripts to make it not ignore it now with my morning coffee)

[James Page (james-page)]

Confirmed - Python module is missing from the cephadm package - this probably impacts the upstream ceph packaging as well.

[Michael Aossey (aossey)]

Also hitting this on a fresh install of 24.04.

[James Page (james-page)]

Test package building here:

https://launchpad.net/~james-page/+archive/ubuntu/caracal

[Frank Barton (bartonf.husson.edu)]

Any word on a formal fix for this hitting the repo?

[Andrew Beeman (kiendeleollc)]

I can confirm this is still an issue.

I could not get #4 to work; there were dependency errors on some of the commands.

[James Page (james-page)]

Updates are prepped but currently blocked by a broken snappy in oracular - the fix for that is pending review in Debian (as it creates a transition requirement) at which point we should be able to proceed with the required updates for the SRU to noble as well.

Please note that the packages in Noble are a snapshot, not the final release for Squid.

[James Page (james-page)]

We're currently blocked in oracular by a broken snappy package and a pending transition to resolve the issues its created:

https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1070977

As such I'd like to move forward with the SRU for noble as we need to resolve issues for those testing in preparation for migration to the new LTS

[James Page (james-page)]

Note that ceph in oracular FTBFS due to a broken API in the snappy package which is pending a transition across Debian and Ubuntu.

[Launchpad Janitor (janitor)]

This bug was fixed in the package ceph - 19.2.0~git20240301.4c76c50-0ubuntu7

---------------
ceph (19.2.0~git20240301.4c76c50-0ubuntu7) oracular; urgency=medium

  [ Luciano Lo Giudice]
  * d/control: Add python3-{packaging,ceph-common} to (Build-)Depends
    as these are undocumented/detected runtime dependencies in
    ceph-volume (LP: #2064717).

  [ James Page ]
  * d/cephadm.install: Install cephadmlib Python module which the
    cephadm script uses (LP: #2063456).
  * d/control: cephadm linux-any -> all.
  * d/gbp.conf: Update for ubuntu/oracular packaging branch.
  * d/control: Update Vcs-* to point to Launchpad for Ubuntu packaging.
  * d/p/mgr-distutils.patch: Directly use vendored distutils from
    setuptools for Python that runs in the mgr daemon (LP: #2065867).

 -- James Page <email address hidden> Thu, 23 May 2024 16:30:19 +0100

[Frank Barton (bartonf.husson.edu)]

Is there any movement on this for 24.04 LTS? still having the same issue on a fresh install
installed:
cephadm/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed]

[Frank Barton (bartonf.husson.edu)]

on a related note - ceph 19 hasn't been formally released - why is 19 the version that is included in 24.04 LTS, instead of version 18 "reef"?

[Timo Aaltonen (tjaalton)]

An upload of ceph to noble-proposed has been rejected from the upload queue for the following reason: "will be amended".

[Timo Aaltonen (tjaalton)]

Hello Marco, or anyone else affected,

Accepted ceph into noble-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/ceph/19.2.0~git20240301.4c76c50-0ubuntu6.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-noble to verification-done-noble. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-noble. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Thomas Pries (psamoht)]

Hi,

it doesn't seem to work for me, installed:

ceph-base/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-common/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-mds/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-mgr-modules-core/noble,noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 all [installed,automatic]
ceph-mgr/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-mon/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-osd/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-volume/noble,noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 all [installed,automatic]
ceph/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed]
cephadm/noble-proposed,now 19.2.0~git20240301.4c76c50-0ubuntu6.1 amd64 [installed]

Cluster bootstrap fails:

#####################################
#
# docker
#

root@ceph-1:~# cephadm bootstrap --mon-ip 192.168.130.11 --cluster-network 10.0.0.0/24
This is a development version of cephadm.
For information regarding the latest stable release:
    https://docs.ceph.com/docs/reef/cephadm/install
Verifying podman|docker is present...
Verifying lvm2 is present...
Verifying time synchronization is in place...
Unit ntpd.service is enabled and running
Repeating the final host check...
docker (/usr/bin/docker) is present
systemctl is present
lvcreate is present
Unit ntpd.service is enabled and running
Host looks OK
Cluster fsid: 13f3c78e-30a9-11ef-a884-001e06456e10
Verifying IP 192.168.130.11 port 3300 ...
Verifying IP 192.168.130.11 port 6789 ...
Mon IP `192.168.130.11` is in CIDR network `192.168.130.0/24`
Mon IP `192.168.130.11` is in CIDR network `192.168.130.0/24`
Pulling container image quay.ceph.io/ceph-ci/ceph:main...
Non-zero exit code 1 from /usr/bin/docker pull quay.ceph.io/ceph-ci/ceph:main
/usr/bin/docker: stdout main: Pulling from ceph-ci/ceph
/usr/bin/docker: stdout eb254c8cc372: Pulling fs layer
/usr/bin/docker: stdout 97244be9f0a8: Pulling fs layer
/usr/bin/docker: stdout eb254c8cc372: Retrying in 5 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 4 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 3 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 2 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 1 second
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 5 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 4 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 3 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 2 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 1 second
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 10 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 9 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 8 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 7 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 6 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 5 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 4 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 3 seconds
/usr/bin/docker: stdout 97244be9f...

[Thomas Pries (psamoht)]

Hi,

I'm sorry, I was to impatient, podman made it overnight, trying to set up a cluster to see, if it works.

Kind regards
Thomas