Comment 23 for bug 1719436

from ceph-mon/2:

2017-10-12 00:20:19 DEBUG mon-relation-changed creating /var/lib/ceph/tmp/juju-c5aebb-auto-osci-sv02-2.mon.keyring
2017-10-12 00:20:19 DEBUG mon-relation-changed added entity mon. auth auth(auid = 18446744073709551615 key=AQDgtN5Z1TiPARAAOO1plbio6lhXS4Yduv0AJg== with 0 caps)
2017-10-12 00:20:19 DEBUG mon-relation-changed ceph-mon: renaming mon.noname-a 172.17.102.4:6789/0 to mon.juju-c5aebb-auto-osci-sv02-2
2017-10-12 00:20:19 DEBUG mon-relation-changed ceph-mon: set fsid to e5c884d4-aee2-11e7-abb4-fa163ec0db83
2017-10-12 00:20:19 DEBUG mon-relation-changed ceph-mon: created monfs at /var/lib/ceph/mon/ceph-juju-c5aebb-auto-osci-sv02-2 for mon.juju-c5aebb-auto-osci-sv02-2
2017-10-12 00:20:22 DEBUG mon-relation-changed Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.service → /lib/systemd/system/ceph-mon.service.
2017-10-12 00:20:23 INFO juju-log mon:0: Retrying 'add_keyring_to_ceph' 3 more times (delay=5)
2017-10-12 00:20:28 DEBUG mon-relation-changed creating /var/lib/ceph/tmp/juju-c5aebb-auto-osci-sv02-2.mon.keyring
2017-10-12 00:20:28 DEBUG mon-relation-changed added entity mon. auth auth(auid = 18446744073709551615 key=AQDgtN5Z1TiPARAAOO1plbio6lhXS4Yduv0AJg== with 0 caps)
2017-10-12 00:20:28 DEBUG mon-relation-changed '/var/lib/ceph/mon/ceph-juju-c5aebb-auto-osci-sv02-2' already exists and is not empty: monitor may already exist
2017-10-12 00:20:35 INFO juju-log mon:0: Retrying 'add_keyring_to_ceph' 2 more times (delay=10)
2017-10-12 00:20:45 DEBUG mon-relation-changed creating /var/lib/ceph/tmp/juju-c5aebb-auto-osci-sv02-2.mon.keyring
2017-10-12 00:20:45 DEBUG mon-relation-changed added entity mon. auth auth(auid = 18446744073709551615 key=AQDgtN5Z1TiPARAAOO1plbio6lhXS4Yduv0AJg== with 0 caps)
2017-10-12 00:20:45 DEBUG mon-relation-changed '/var/lib/ceph/mon/ceph-juju-c5aebb-auto-osci-sv02-2' already exists and is not empty: monitor may already exist
2017-10-12 00:20:51 INFO juju-log mon:0: Retrying 'add_keyring_to_ceph' 1 more times (delay=15)
2017-10-12 00:21:06 DEBUG mon-relation-changed creating /var/lib/ceph/tmp/juju-c5aebb-auto-osci-sv02-2.mon.keyring
2017-10-12 00:21:06 DEBUG mon-relation-changed added entity mon. auth auth(auid = 18446744073709551615 key=AQDgtN5Z1TiPARAAOO1plbio6lhXS4Yduv0AJg== with 0 caps)
2017-10-12 00:21:06 DEBUG mon-relation-changed '/var/lib/ceph/mon/ceph-juju-c5aebb-auto-osci-sv02-2' already exists and is not empty: monitor may already exist
2017-10-12 00:21:11 DEBUG mon-relation-changed Traceback (most recent call last):
2017-10-12 00:21:11 DEBUG mon-relation-changed File "/var/lib/juju/agents/unit-ceph-mon-2/charm/hooks/mon-relation-changed", line 713, in <module>
2017-10-12 00:21:11 DEBUG mon-relation-changed hooks.execute(sys.argv)
2017-10-12 00:21:11 DEBUG mon-relation-changed File "/var/lib/juju/agents/unit-ceph-mon-2/charm/hooks/charmhelpers/core/hookenv.py", line 768, in execute
2017-10-12 00:21:11 DEBUG mon-relation-changed self._hooks[hook_name]()
2017-10-12 00:21:11 DEBUG mon-relation-changed File "/var/lib/juju/agents/unit-ceph-mon-2/charm/hooks/mon-relation-changed", line 357, in mon_relation
2017-10-12 00:21:11 DEBUG mon-relation-changed ceph.bootstrap_monitor_cluster(leader_get('monitor-secret'))
2017-10-12 00:21:11 DEBUG mon-relation-changed File "lib/ceph/utils.py", line 1296, in bootstrap_monitor_cluster
2017-10-12 00:21:11 DEBUG mon-relation-changed init_marker)
2017-10-12 00:21:11 DEBUG mon-relation-changed File "/var/lib/juju/agents/unit-ceph-mon-2/charm/hooks/charmhelpers/core/decorators.py", line 40, in _retry_on_exception_inner_2
2017-10-12 00:21:11 DEBUG mon-relation-changed return f(*args, **kwargs)
2017-10-12 00:21:11 DEBUG mon-relation-changed File "lib/ceph/utils.py", line 1333, in add_keyring_to_ceph
2017-10-12 00:21:11 DEBUG mon-relation-changed osstat = os.stat("/etc/ceph/ceph.client.admin.keyring")
2017-10-12 00:21:11 DEBUG mon-relation-changed OSError: [Errno 2] No such file or directory: '/etc/ceph/ceph.client.admin.keyring'
2017-10-12 00:21:11 ERROR juju.worker.uniter.operation runhook.go:107 hook "mon-relation-changed" failed: exit status 1