Added ceilometer to the bug as I found it there too:

[from unit-ceilometer-0.log]
2017-01-05 21:17:54 INFO cluster-relation-joined error: cannot write leadership settings: cannot write settings: not the leader
2017-01-05 21:17:54 INFO cluster-relation-joined Traceback (most recent call last):
2017-01-05 21:17:54 INFO cluster-relation-joined   File "/var/lib/juju/agents/unit-ceilometer-0/charm/hooks/cluster-relation-joined", line 390, in <module>
2017-01-05 21:17:54 INFO cluster-relation-joined     hooks.execute(sys.argv)
2017-01-05 21:17:54 INFO cluster-relation-joined   File "/var/lib/juju/agents/unit-ceilometer-0/charm/hooks/charmhelpers/core/hookenv.py", line 715, in execute
2017-01-05 21:17:54 INFO cluster-relation-joined     self._hooks[hook_name]()
2017-01-05 21:17:54 INFO cluster-relation-joined   File "/var/lib/juju/agents/unit-ceilometer-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 1817, in wrapped_f
2017-01-05 21:17:54 INFO cluster-relation-joined     restart_functions)
2017-01-05 21:17:54 INFO cluster-relation-joined   File "/var/lib/juju/agents/unit-ceilometer-0/charm/hooks/charmhelpers/core/host.py", line 524, in restart_on_change_helper
2017-01-05 21:17:54 INFO cluster-relation-joined     r = lambda_f()
2017-01-05 21:17:54 INFO cluster-relation-joined   File "/var/lib/juju/agents/unit-ceilometer-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 1816, in <lambda>
2017-01-05 21:17:54 INFO cluster-relation-joined     (lambda: f(*args, **kwargs)), restart_map, stopstart,
2017-01-05 21:17:54 INFO cluster-relation-joined   File "/var/lib/juju/agents/unit-ceilometer-0/charm/hooks/cluster-relation-joined", line 218, in cluster_joined
2017-01-05 21:17:54 INFO cluster-relation-joined     peer_store('shared_secret', get_shared_secret())
2017-01-05 21:17:54 INFO cluster-relation-joined   File "/var/lib/juju/agents/unit-ceilometer-0/charm/hooks/charmhelpers/contrib/peerstorage/__init__.py", line 198, in peer_store
2017-01-05 21:17:54 INFO cluster-relation-joined     relation_settings={key: value})
2017-01-05 21:17:54 INFO cluster-relation-joined   File "/var/lib/juju/agents/unit-ceilometer-0/charm/hooks/charmhelpers/contrib/peerstorage/__init__.py", line 135, in relation_set
2017-01-05 21:17:54 INFO cluster-relation-joined     return leader_set(settings=relation_settings, **kwargs)
2017-01-05 21:17:54 INFO cluster-relation-joined   File "/var/lib/juju/agents/unit-ceilometer-0/charm/hooks/charmhelpers/core/hookenv.py", line 837, in inner_translate_exc2
2017-01-05 21:17:54 INFO cluster-relation-joined     return f(*args, **kwargs)
2017-01-05 21:17:54 INFO cluster-relation-joined   File "/var/lib/juju/agents/unit-ceilometer-0/charm/hooks/charmhelpers/core/hookenv.py", line 890, in leader_set
2017-01-05 21:17:54 INFO cluster-relation-joined     subprocess.check_call(cmd)
2017-01-05 21:17:54 INFO cluster-relation-joined   File "/usr/lib/python2.7/subprocess.py", line 541, in check_call
2017-01-05 21:17:54 INFO cluster-relation-joined     raise CalledProcessError(retcode, cmd)
2017-01-05 21:17:54 INFO cluster-relation-joined subprocess.CalledProcessError: Command '['leader-set', 'shared_secret=b96c0d39-8766-42b5-88d9-69564e403601']' returned non-zero exit status 1
2017-01-05 21:17:54 ERROR juju.worker.uniter.operation runhook.go:107 hook "cluster-relation-joined" failed: exit status 1
2017-01-05 21:17:54 WARNING juju.worker.uniter.operation leader.go:115 we should run a leader-deposed hook here, but we can't yet