from ceph-mon/2:
2017-10-12 00:20:19 DEBUG mon-relation-changed creating /var/lib/ceph/tmp/juju-c5aebb-auto-osci-sv02-2.mon.keyring 2017-10-12 00:20:19 DEBUG mon-relation-changed added entity mon. auth auth(auid = 18446744073709551615 key=AQDgtN5Z1TiPARAAOO1plbio6lhXS4Yduv0AJg== with 0 caps) 2017-10-12 00:20:19 DEBUG mon-relation-changed ceph-mon: renaming mon.noname-a 172.17.102.4:6789/0 to mon.juju-c5aebb-auto-osci-sv02-2 2017-10-12 00:20:19 DEBUG mon-relation-changed ceph-mon: set fsid to e5c884d4-aee2-11e7-abb4-fa163ec0db83 2017-10-12 00:20:19 DEBUG mon-relation-changed ceph-mon: created monfs at /var/lib/ceph/mon/ceph-juju-c5aebb-auto-osci-sv02-2 for mon.juju-c5aebb-auto-osci-sv02-2 2017-10-12 00:20:22 DEBUG mon-relation-changed Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.service → /lib/systemd/system/ceph-mon.service. 2017-10-12 00:20:23 INFO juju-log mon:0: Retrying 'add_keyring_to_ceph' 3 more times (delay=5) 2017-10-12 00:20:28 DEBUG mon-relation-changed creating /var/lib/ceph/tmp/juju-c5aebb-auto-osci-sv02-2.mon.keyring 2017-10-12 00:20:28 DEBUG mon-relation-changed added entity mon. auth auth(auid = 18446744073709551615 key=AQDgtN5Z1TiPARAAOO1plbio6lhXS4Yduv0AJg== with 0 caps) 2017-10-12 00:20:28 DEBUG mon-relation-changed '/var/lib/ceph/mon/ceph-juju-c5aebb-auto-osci-sv02-2' already exists and is not empty: monitor may already exist 2017-10-12 00:20:35 INFO juju-log mon:0: Retrying 'add_keyring_to_ceph' 2 more times (delay=10) 2017-10-12 00:20:45 DEBUG mon-relation-changed creating /var/lib/ceph/tmp/juju-c5aebb-auto-osci-sv02-2.mon.keyring 2017-10-12 00:20:45 DEBUG mon-relation-changed added entity mon. auth auth(auid = 18446744073709551615 key=AQDgtN5Z1TiPARAAOO1plbio6lhXS4Yduv0AJg== with 0 caps) 2017-10-12 00:20:45 DEBUG mon-relation-changed '/var/lib/ceph/mon/ceph-juju-c5aebb-auto-osci-sv02-2' already exists and is not empty: monitor may already exist 2017-10-12 00:20:51 INFO juju-log mon:0: Retrying 'add_keyring_to_ceph' 1 more times (delay=15) 2017-10-12 00:21:06 DEBUG mon-relation-changed creating /var/lib/ceph/tmp/juju-c5aebb-auto-osci-sv02-2.mon.keyring 2017-10-12 00:21:06 DEBUG mon-relation-changed added entity mon. auth auth(auid = 18446744073709551615 key=AQDgtN5Z1TiPARAAOO1plbio6lhXS4Yduv0AJg== with 0 caps) 2017-10-12 00:21:06 DEBUG mon-relation-changed '/var/lib/ceph/mon/ceph-juju-c5aebb-auto-osci-sv02-2' already exists and is not empty: monitor may already exist 2017-10-12 00:21:11 DEBUG mon-relation-changed Traceback (most recent call last): 2017-10-12 00:21:11 DEBUG mon-relation-changed File "/var/lib/juju/agents/unit-ceph-mon-2/charm/hooks/mon-relation-changed", line 713, in <module> 2017-10-12 00:21:11 DEBUG mon-relation-changed hooks.execute(sys.argv) 2017-10-12 00:21:11 DEBUG mon-relation-changed File "/var/lib/juju/agents/unit-ceph-mon-2/charm/hooks/charmhelpers/core/hookenv.py", line 768, in execute 2017-10-12 00:21:11 DEBUG mon-relation-changed self._hooks[hook_name]() 2017-10-12 00:21:11 DEBUG mon-relation-changed File "/var/lib/juju/agents/unit-ceph-mon-2/charm/hooks/mon-relation-changed", line 357, in mon_relation 2017-10-12 00:21:11 DEBUG mon-relation-changed ceph.bootstrap_monitor_cluster(leader_get('monitor-secret')) 2017-10-12 00:21:11 DEBUG mon-relation-changed File "lib/ceph/utils.py", line 1296, in bootstrap_monitor_cluster 2017-10-12 00:21:11 DEBUG mon-relation-changed init_marker) 2017-10-12 00:21:11 DEBUG mon-relation-changed File "/var/lib/juju/agents/unit-ceph-mon-2/charm/hooks/charmhelpers/core/decorators.py", line 40, in _retry_on_exception_inner_2 2017-10-12 00:21:11 DEBUG mon-relation-changed return f(*args, **kwargs) 2017-10-12 00:21:11 DEBUG mon-relation-changed File "lib/ceph/utils.py", line 1333, in add_keyring_to_ceph 2017-10-12 00:21:11 DEBUG mon-relation-changed osstat = os.stat("/etc/ceph/ceph.client.admin.keyring") 2017-10-12 00:21:11 DEBUG mon-relation-changed OSError: [Errno 2] No such file or directory: '/etc/ceph/ceph.client.admin.keyring' 2017-10-12 00:21:11 ERROR juju.worker.uniter.operation runhook.go:107 hook "mon-relation-changed" failed: exit status 1
from ceph-mon/2:
2017-10-12 00:20:19 DEBUG mon-relation- changed creating /var/lib/ ceph/tmp/ juju-c5aebb- auto-osci- sv02-2. mon.keyring changed added entity mon. auth auth(auid = 184467440737095 51615 key=AQDgtN5Z1Ti PARAAOO1plbio6l hXS4Yduv0AJg= = with 0 caps) changed ceph-mon: renaming mon.noname-a 172.17.102.4:6789/0 to mon.juju- c5aebb- auto-osci- sv02-2 changed ceph-mon: set fsid to e5c884d4- aee2-11e7- abb4-fa163ec0db 83 changed ceph-mon: created monfs at /var/lib/ ceph/mon/ ceph-juju- c5aebb- auto-osci- sv02-2 for mon.juju- c5aebb- auto-osci- sv02-2 changed Created symlink /etc/systemd/ system/ multi-user. target. wants/ceph- mon.service → /lib/systemd/ system/ ceph-mon. service. to_ceph' 3 more times (delay=5) changed creating /var/lib/ ceph/tmp/ juju-c5aebb- auto-osci- sv02-2. mon.keyring changed added entity mon. auth auth(auid = 184467440737095 51615 key=AQDgtN5Z1Ti PARAAOO1plbio6l hXS4Yduv0AJg= = with 0 caps) changed '/var/lib/ ceph/mon/ ceph-juju- c5aebb- auto-osci- sv02-2' already exists and is not empty: monitor may already exist to_ceph' 2 more times (delay=10) changed creating /var/lib/ ceph/tmp/ juju-c5aebb- auto-osci- sv02-2. mon.keyring changed added entity mon. auth auth(auid = 184467440737095 51615 key=AQDgtN5Z1Ti PARAAOO1plbio6l hXS4Yduv0AJg= = with 0 caps) changed '/var/lib/ ceph/mon/ ceph-juju- c5aebb- auto-osci- sv02-2' already exists and is not empty: monitor may already exist to_ceph' 1 more times (delay=15) changed creating /var/lib/ ceph/tmp/ juju-c5aebb- auto-osci- sv02-2. mon.keyring changed added entity mon. auth auth(auid = 184467440737095 51615 key=AQDgtN5Z1Ti PARAAOO1plbio6l hXS4Yduv0AJg= = with 0 caps) changed '/var/lib/ ceph/mon/ ceph-juju- c5aebb- auto-osci- sv02-2' already exists and is not empty: monitor may already exist changed Traceback (most recent call last): changed File "/var/lib/ juju/agents/ unit-ceph- mon-2/charm/ hooks/mon- relation- changed" , line 713, in <module> changed hooks.execute( sys.argv) changed File "/var/lib/ juju/agents/ unit-ceph- mon-2/charm/ hooks/charmhelp ers/core/ hookenv. py", line 768, in execute changed self._hooks[ hook_name] () changed File "/var/lib/ juju/agents/ unit-ceph- mon-2/charm/ hooks/mon- relation- changed" , line 357, in mon_relation changed ceph.bootstrap_ monitor_ cluster( leader_ get('monitor- secret' )) changed File "lib/ceph/ utils.py" , line 1296, in bootstrap_ monitor_ cluster changed init_marker) changed File "/var/lib/ juju/agents/ unit-ceph- mon-2/charm/ hooks/charmhelp ers/core/ decorators. py", line 40, in _retry_ on_exception_ inner_2 changed return f(*args, **kwargs) changed File "lib/ceph/ utils.py" , line 1333, in add_keyring_to_ceph changed osstat = os.stat( "/etc/ceph/ ceph.client. admin.keyring" ) changed OSError: [Errno 2] No such file or directory: '/etc/ceph/ ceph.client. admin.keyring' uniter. operation runhook.go:107 hook "mon-relation- changed" failed: exit status 1
2017-10-12 00:20:19 DEBUG mon-relation-
2017-10-12 00:20:19 DEBUG mon-relation-
2017-10-12 00:20:19 DEBUG mon-relation-
2017-10-12 00:20:19 DEBUG mon-relation-
2017-10-12 00:20:22 DEBUG mon-relation-
2017-10-12 00:20:23 INFO juju-log mon:0: Retrying 'add_keyring_
2017-10-12 00:20:28 DEBUG mon-relation-
2017-10-12 00:20:28 DEBUG mon-relation-
2017-10-12 00:20:28 DEBUG mon-relation-
2017-10-12 00:20:35 INFO juju-log mon:0: Retrying 'add_keyring_
2017-10-12 00:20:45 DEBUG mon-relation-
2017-10-12 00:20:45 DEBUG mon-relation-
2017-10-12 00:20:45 DEBUG mon-relation-
2017-10-12 00:20:51 INFO juju-log mon:0: Retrying 'add_keyring_
2017-10-12 00:21:06 DEBUG mon-relation-
2017-10-12 00:21:06 DEBUG mon-relation-
2017-10-12 00:21:06 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 DEBUG mon-relation-
2017-10-12 00:21:11 ERROR juju.worker.