Comment 46 for bug 1719436

Revision history for this message
Craig Bender (craig-bender) wrote :

Have same issue, recreatable 100% of time.

$ juju status ceph-mon |awk '/Unit/,/^$/'
Unit Workload Agent Machine Public address Ports Message
ceph-mon/0* maintenance executing 1/lxd/0 172.27.20.149 Bootstrapping MON cluster
ceph-mon/1 maintenance executing 2/lxd/0 172.27.21.97 Bootstrapping MON cluster
ceph-mon/2 maintenance executing 3/lxd/0 172.27.21.77 Bootstrapping MON cluster

bundle is openstack-base (as of 27-04-2018)

All units can ping each other and conf has correct ips of other mon units:

Sanity check: https://pastebin.canonical.com/p/yVgCRBPmkT/
Output of Sanity check: https://pastebin.canonical.com/p/pr74vkPbNC/

One unit will not create admin key ring

Other units create a keyring.tmp.

If I bound jujud-ceph-mon, .tmp files will become keyring files.

output of: juju debug-log --include ceph-mon
unit-ceph-mon-1: 13:33:35 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:33:36 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:33:37 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:33:38 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:33:39 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:33:40 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:33:42 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:33:43 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:33:44 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:33:45 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:32:44 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:32:45 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:32:46 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
unit-ceph-mon-1: 13:32:47 DEBUG unit.ceph-mon/1.mon-relation-changed INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'

Happy to give access to this box, as I say it's recreatable 100% of the time.