microceph is bound on Calico IP address - Failed executing cmd: ['microceph', 'cluster', 'join' ... Error: Failed to get certificate of cluster member "10.1.32.192:7443": Get "htt ps://10.1.32.192:7443": Unable to connect to: 10.1.32.192:7443 ([dial tcp 10.1.32.192:7443: i/o timeout]
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Canonical Juju |
Incomplete
|
Undecided
|
Unassigned | ||
OpenStack Snap |
Fix Released
|
High
|
Guillaume Boutry |
Bug Description
After working around LP: #2065470, I tried to add the second node with `sunbeam cluster add` and `sunbeam cluster join`.
However, microceph charm failed to form the two nodes clusters with the following error.
unit-microceph-1: 15:21:51 INFO unit.microceph/
.123.0/24'), 'micro_ip': IPv4Address(
unit-microceph-1: 15:22:01 ERROR unit.microceph/
2MwYjYwMzZjNWJh
wiam9pbl9hZGRyZ
ps://10.
unit-microceph-1: 15:22:01 WARNING unit.microceph/
o connect to: 10.1.32.192:7443 ([dial tcp 10.1.32.192:7443: i/o timeout])
sunbeam-1:~$ ip -br a
lo UNKNOWN 127.0.0.1/8 ::1/128
enp1s0 UP 192.168.123.228/24 metric 100 fe80::5054:
enp9s0 DOWN
cali2ae07341a2e@if3 UP fe80::ecee:
vxlan.calico UNKNOWN 10.1.32.192/32 fe80::64a8:
calib5f1a1d0dc7@if3 UP fe80::ecee:
cali8eb9d73bdf4@if3 UP fe80::ecee:
...
ovs-system DOWN
br-int DOWN
br-ex UNKNOWN 10.20.20.1/24 fe80::4c18:
192.168.123.0/24 is the host network and 10.1.32.192 is on the calico VXLAN interface. But the microceph on the initial node is bound on the Calico IP.
$ sudo microceph status
MicroCeph deployment summary:
- sunbeam-1 (10.1.32.192)
Services: mds, mgr, mon, osd
Disks: 2
- sunbeam-2 (192.168.123.173)
Services:
Disks: 0
$ echo 'eyJuYW1lIjoibW
{"name"
tags: | added: open-2190 |
Changed in snap-openstack: | |
assignee: | nobody → Guillaume Boutry (gboutry) |
microceph charm is using the manual provider in this context, and the binding is not used other than the default "alpha". Not sure if Juju is capable to leverage multiple spaces on the manual provider these days or not though.
$ juju spaces
192. 168.123. 0/24
Name Space ID Subnets
alpha 0 10.1.32.192/32
$ juju show-application microceph bindings:
microceph:
charm: microceph
base: ubuntu@22.04
channel: latest/edge
constraints:
arch: amd64
principal: true
exposed: false
remote: false
life: alive
endpoint-
"": alpha
admin: alpha
ceph: alpha
cluster: alpha
mds: alpha
peers: alpha
public: alpha
radosgw: alpha
https:/ /github. com/canonical/ charm-microceph /blob/6cd11fa64 5040d53e7a7e688 14151c1c138dda2 f/src/microceph .py#L86- L99