ceph osd configuration has v1 MSG hardcoded

[Gábor Mészáros]

Using the latest ceph-osd charm (308) the ceph.conf has port 6789 hardcoded for the mon hosts.
In reality it connects using messenger v2 (3300), so this is very confusing and misleading.

https://github.com/openstack/charm-ceph-osd/blob/stable/21.01/hooks/ceph_hooks.py#L590

On a side note, should we optionally let disabling legacy messenger comms on the ceph-mon?

[Gábor Mészáros (gabor.meszaros)]

root@ip-172-31-1-23:~# ceph mon dump
dumped monmap epoch 2
epoch 2
fsid 7907788a-7cc7-11eb-b454-0653053d92a6
last_changed 2021-03-04 08:56:41.071783
created 2021-03-04 08:56:26.462517
min_mon_release 14 (nautilus)
0: [v2:172.31.1.23:3300/0,v1:172.31.1.23:6789/0] mon.ip-172-31-1-23
1: [v2:172.31.21.53:3300/0,v1:172.31.21.53:6789/0] mon.ip-172-31-21-53
2: [v2:172.31.47.224:3300/0,v1:172.31.47.224:6789/0] mon.ip-172-31-47-224

root@ip-172-31-27-10:~# ss -tupnw | grep 3300
tcp ESTAB 0 0 172.31.27.10:33348 172.31.21.53:3300 users:(("ceph-osd",pid=2928,fd=55))
tcp ESTAB 0 0 172.31.27.10:33354 172.31.21.53:3300 users:(("ceph-osd",pid=2927,fd=55))

[Gábor Mészáros (gabor.meszaros)]

root@ip-172-31-27-10:~# grep 'mon host' /etc/ceph/ceph.conf
mon host = 172.31.1.23:6789 172.31.21.53:6789 172.31.47.224:6789

[Chris MacNaughton (chris.macnaughton)]

I've proposed a fix for this at https://review.opendev.org/c/openstack/charm-ceph-osd/+/780763

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/charm-ceph-osd/+/780763
Committed: https://opendev.org/openstack/charm-ceph-osd/commit/1af3d6f041bb416b3ed56c9ac1167c0926284ffb
Submitter: "Zuul (22348)"
Branch: master

commit 1af3d6f041bb416b3ed56c9ac1167c0926284ffb
Author: Chris MacNaughton <email address hidden>
Date: Tue Mar 16 10:38:45 2021 +0100

    Update get_mon_hosts to not specify mon ports

    Update get_mon_hosts to avoid specifying the port number for the
    MON daemons; we use the default so this is not required, and at
    Nautilus the MON daemons run both v1 and v2 messenger ports.

    Specifying the port in the ceph.conf file disables the v2
    messenger port which is not the desired behaviour on upgrade
    or new installation.

    Change-Id: I5333cc85f755771733fe09e963d5523fd93c16d2
    Closes-Bug: #1917742