Comment 18 for bug 2063456

Revision history for this message
Thomas Pries (psamoht) wrote :

Hi,

it doesn't seem to work for me, installed:

ceph-base/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-common/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-mds/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-mgr-modules-core/noble,noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 all [installed,automatic]
ceph-mgr/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-mon/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-osd/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed,automatic]
ceph-volume/noble,noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 all [installed,automatic]
ceph/noble,now 19.2.0~git20240301.4c76c50-0ubuntu6 amd64 [installed]
cephadm/noble-proposed,now 19.2.0~git20240301.4c76c50-0ubuntu6.1 amd64 [installed]

Cluster bootstrap fails:

#####################################
#
# docker
#

root@ceph-1:~# cephadm bootstrap --mon-ip 192.168.130.11 --cluster-network 10.0.0.0/24
This is a development version of cephadm.
For information regarding the latest stable release:
    https://docs.ceph.com/docs/reef/cephadm/install
Verifying podman|docker is present...
Verifying lvm2 is present...
Verifying time synchronization is in place...
Unit ntpd.service is enabled and running
Repeating the final host check...
docker (/usr/bin/docker) is present
systemctl is present
lvcreate is present
Unit ntpd.service is enabled and running
Host looks OK
Cluster fsid: 13f3c78e-30a9-11ef-a884-001e06456e10
Verifying IP 192.168.130.11 port 3300 ...
Verifying IP 192.168.130.11 port 6789 ...
Mon IP `192.168.130.11` is in CIDR network `192.168.130.0/24`
Mon IP `192.168.130.11` is in CIDR network `192.168.130.0/24`
Pulling container image quay.ceph.io/ceph-ci/ceph:main...
Non-zero exit code 1 from /usr/bin/docker pull quay.ceph.io/ceph-ci/ceph:main
/usr/bin/docker: stdout main: Pulling from ceph-ci/ceph
/usr/bin/docker: stdout eb254c8cc372: Pulling fs layer
/usr/bin/docker: stdout 97244be9f0a8: Pulling fs layer
/usr/bin/docker: stdout eb254c8cc372: Retrying in 5 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 4 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 3 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 2 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 1 second
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 5 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 4 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 3 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 2 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 1 second
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 10 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 9 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 8 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 7 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 6 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 5 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 4 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 3 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 2 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 1 second
/usr/bin/docker: stdout eb254c8cc372: Retrying in 10 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 9 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 8 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 7 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 6 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 5 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 4 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 3 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 2 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 1 second
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 15 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 14 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 13 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 12 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 11 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 10 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 9 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 8 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 7 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 6 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 5 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 4 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 3 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 2 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 1 second
/usr/bin/docker: stdout eb254c8cc372: Retrying in 15 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 14 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 13 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 12 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 11 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 10 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 9 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 8 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 7 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 6 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 5 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 4 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 3 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 2 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 1 second
/usr/bin/docker: stdout eb254c8cc372: Retrying in 20 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 19 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 18 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 17 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 16 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 15 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 14 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 13 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 12 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 11 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 10 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 9 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 8 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 7 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 6 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 5 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 20 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 4 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 19 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 3 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 18 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 2 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 17 seconds
/usr/bin/docker: stdout eb254c8cc372: Retrying in 1 second
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 16 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 15 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 14 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 13 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 12 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 11 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 10 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 9 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 8 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 7 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 6 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 5 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 4 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 3 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 2 seconds
/usr/bin/docker: stdout 97244be9f0a8: Retrying in 1 second
/usr/bin/docker: stderr unexpected EOF
Error: Failed command: /usr/bin/docker pull quay.ceph.io/ceph-ci/ceph:main

        ***************
        Cephadm hit an issue during cluster installation. Current cluster files will be deleted automatically.
        To disable this behaviour you can pass the --no-cleanup-on-failure flag. In case of any previous
        broken installation, users must use the following command to completely delete the broken cluster:

        > cephadm rm-cluster --force --zap-osds --fsid <fsid>

        for more information please refer to https://docs.ceph.com/en/latest/cephadm/operations/#purging-a-cluster
        ***************

Deleting cluster with fsid: 13f3c78e-30a9-11ef-a884-001e06456e10
ERROR: Failed command: /usr/bin/docker pull quay.ceph.io/ceph-ci/ceph:main
root@ceph-1:~#

If I'm using podman, it got stuck infinetly:

##############################################
#
# podman
#
root@ceph-1:~# cephadm bootstrap --mon-ip 192.168.130.11 --cluster-network 10.0.0.0/24
This is a development version of cephadm.
For information regarding the latest stable release:
    https://docs.ceph.com/docs/reef/cephadm/install
Verifying podman|docker is present...
Verifying lvm2 is present...
Verifying time synchronization is in place...
Unit ntpd.service is enabled and running
Repeating the final host check...
podman (/usr/bin/podman) version 4.9.3 is present
systemctl is present
lvcreate is present
Unit ntpd.service is enabled and running
Host looks OK
Cluster fsid: eb6c13ff-30af-11ef-82a5-001e06456e10
Verifying IP 192.168.130.11 port 3300 ...
Verifying IP 192.168.130.11 port 6789 ...
Mon IP `192.168.130.11` is in CIDR network `192.168.130.0/24`
Mon IP `192.168.130.11` is in CIDR network `192.168.130.0/24`
Pulling container image quay.ceph.io/ceph-ci/ceph:main...