unit-site-a-ceph-rbd-mirror-0: 13:54:40 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:54:40 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 13:54:40 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:54:40 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 13:54:40 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 13:54:40 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:54:40 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:54:40 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 26 flags set
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:41 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 13:54:41 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status inactive
unit-site-a-ceph-rbd-mirror-0: 13:54:41 WARNING unit.site-a-ceph-rbd-mirror/0.update-status Unit /etc/systemd/system/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service is masked, ignoring.
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:42 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:43 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:43 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2118922134643086386
unit-site-a-ceph-rbd-mirror-0: 13:54:43 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 13:54:43 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 13:54:43 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:54:43 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 13:54:43 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:54:43 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 13:59:50 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:59:50 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 13:59:50 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:59:50 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 13:59:50 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 13:59:50 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:59:50 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:59:50 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 26 flags set
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 13:59:51 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status inactive
unit-site-a-ceph-rbd-mirror-0: 13:59:51 WARNING unit.site-a-ceph-rbd-mirror/0.update-status Unit /etc/systemd/system/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service is masked, ignoring.
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:53 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8917852319687549394
unit-site-a-ceph-rbd-mirror-0: 13:59:53 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 13:59:53 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 13:59:53 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:59:53 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 13:59:53 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 13:59:53 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:04:34 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:04:34 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:04:34 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:04:34 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:04:34 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:04:34 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:04:34 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:04:34 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 26 flags set
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:35 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:04:35 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status inactive
unit-site-a-ceph-rbd-mirror-0: 14:04:35 WARNING unit.site-a-ceph-rbd-mirror/0.update-status Unit /etc/systemd/system/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service is masked, ignoring.
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:36 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:37 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6564645648656639660
unit-site-a-ceph-rbd-mirror-0: 14:04:37 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:04:37 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:04:37 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:04:37 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:04:37 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:04:37 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:09:06 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:09:06 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:09:06 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:09:06 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:09:06 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:09:06 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:09:06 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:09:06 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 26 flags set
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:07 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:09:07 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status inactive
unit-site-a-ceph-rbd-mirror-0: 14:09:07 WARNING unit.site-a-ceph-rbd-mirror/0.update-status Unit /etc/systemd/system/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service is masked, ignoring.
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:08 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:09 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:09 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3000653069328376564
unit-site-a-ceph-rbd-mirror-0: 14:09:09 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:09:09 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:09:09 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:09:09 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:09:09 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:09:09 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:14:12 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:14:12 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:14:12 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:14:12 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:14:12 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:14:12 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:14:12 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:14:12 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 26 flags set
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:13 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:14:13 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status inactive
unit-site-a-ceph-rbd-mirror-0: 14:14:13 WARNING unit.site-a-ceph-rbd-mirror/0.update-status Unit /etc/systemd/system/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service is masked, ignoring.
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:15 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:15 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3550978148585476563
unit-site-a-ceph-rbd-mirror-0: 14:14:15 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:14:15 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:14:15 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:14:15 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:14:15 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:14:15 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:19:29 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:19:29 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:19:29 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:19:29 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:19:29 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:19:29 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:19:29 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:19:29 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 26 flags set
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:30 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:19:30 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status inactive
unit-site-a-ceph-rbd-mirror-0: 14:19:30 WARNING unit.site-a-ceph-rbd-mirror/0.update-status Unit /etc/systemd/system/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service is masked, ignoring.
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:32 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:32 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3667916477632037083
unit-site-a-ceph-rbd-mirror-0: 14:19:32 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:19:32 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:19:32 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:19:32 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:19:32 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:19:32 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:23:36 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:23:36 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:23:36 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:23:36 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:23:36 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:23:36 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:23:36 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:23:36 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:23:36 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:36 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 26 flags set
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:37 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:23:37 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status inactive
unit-site-a-ceph-rbd-mirror-0: 14:23:37 WARNING unit.site-a-ceph-rbd-mirror/0.update-status Unit /etc/systemd/system/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service is masked, ignoring.
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8250856513316931824
unit-site-a-ceph-rbd-mirror-0: 14:23:38 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:23:39 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:23:39 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:23:39 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:23:39 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:23:39 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:27:54 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:27:54 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:27:54 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:27:54 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:27:54 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:27:54 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:27:54 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:27:54 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 26 flags set
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:27:55 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status inactive
unit-site-a-ceph-rbd-mirror-0: 14:27:55 WARNING unit.site-a-ceph-rbd-mirror/0.update-status Unit /etc/systemd/system/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service is masked, ignoring.
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:56 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:57 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:57 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-611653152355198457
unit-site-a-ceph-rbd-mirror-0: 14:27:57 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:27:57 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:27:57 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:27:57 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:27:57 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:27:57 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:32:23 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:32:23 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:32:23 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:32:23 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:32:25 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:32:25 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:32:25 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:32:25 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:32:25 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:25 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 26 flags set
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:26 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:32:26 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status inactive
unit-site-a-ceph-rbd-mirror-0: 14:32:26 WARNING unit.site-a-ceph-rbd-mirror/0.update-status Unit /etc/systemd/system/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service is masked, ignoring.
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-137539871597357955
unit-site-a-ceph-rbd-mirror-0: 14:32:27 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:32:28 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:32:28 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:32:28 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:32:28 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:32:28 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:34:43 DEBUG juju.worker.uniter.remotestate got a relation units change for site-a-ceph-rbd-mirror/0 : {2 {map[site-a-ceph-mon/2:{1}] map[] []}}
unit-site-a-ceph-rbd-mirror-0: 14:34:43 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:34:43 DEBUG juju.worker.uniter.operation running operation run relation-changed (2; unit: site-a-ceph-mon/2) hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:43 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/2) hook)
unit-site-a-ceph-rbd-mirror-0: 14:34:43 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/2) hook)
unit-site-a-ceph-rbd-mirror-0: 14:34:43 DEBUG juju.worker.uniter.operation preparing operation "run relation-changed (2; unit: site-a-ceph-mon/2) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:43 DEBUG juju.worker.uniter.operation executing operation "run relation-changed (2; unit: site-a-ceph-mon/2) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:43 DEBUG juju.worker.uniter [AGENT-STATUS] executing: running ceph-local-relation-changed hook
unit-site-a-ceph-rbd-mirror-0: 14:34:43 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Reactive main running for hook ceph-local-relation-changed
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: set flag endpoint.ceph-local.changed.auth
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: set flag endpoint.ceph-local.changed.broker_requests
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: set flag endpoint.ceph-local.changed.ceph-public-address
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: set flag endpoint.ceph-local.changed.juju-ae4ac4-site-a-3_key
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: set flag endpoint.ceph-local.changed.pools
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.auth
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.ceph-public-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: hooks phase, 0 handlers queued
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: main dispatch loop, 6 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:44 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/layer_openstack.py:154:default_config_not_rendered
unit-site-a-ceph-rbd-mirror-0: 14:34:44 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed inactive
unit-site-a-ceph-rbd-mirror-0: 14:34:44 WARNING unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed Unit /etc/systemd/system/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service is masked, ignoring.
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: cleared flag endpoint.ceph-local.changed.auth
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: cleared flag endpoint.ceph-local.changed.juju-ae4ac4-site-a-3_key
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: cleared flag endpoint.ceph-local.changed.ceph-public-address
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: set flag ceph-local.available
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-local" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:34:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Making dir /var/lib/ceph/rbd-mirror ceph:ceph 750
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/ceph.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQB5tlRgzKAiJRAATUXZad+85305psXzViJoQg==)
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-remote" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/remote.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQDU6VNgDbJ3NxAAA/T0GwFSj9zWDmk0zyxWog==)
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Writing file /etc/ceph/ceph.conf root:ceph 640
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Writing file /etc/ceph/remote.conf root:ceph 640
unit-site-a-ceph-rbd-mirror-0: 14:34:46 WARNING unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed Failed to start ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service: Unit ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service is masked.
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: set flag config.rendered
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:34:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:34:46 WARNING unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed Removed /etc/systemd/system/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service.
unit-site-a-ceph-rbd-mirror-0: 14:34:46 WARNING unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed Created symlink /etc/systemd/system/ceph-rbd-mirror.target.wants/ceph-rbd-mirror@rbd-mirror.juju-ae4ac4-site-a-3.service → /lib/systemd/system/ceph-rbd-mirror@.service.
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed inactive
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:47 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Request for evaluation: "None"
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:34:47 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7409384080488722787
unit-site-a-ceph-rbd-mirror-0: 14:34:48 INFO juju.worker.uniter.operation ran "ceph-local-relation-changed" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:34:48 DEBUG juju.worker.uniter.operation committing operation "run relation-changed (2; unit: site-a-ceph-mon/2) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:48 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/2) hook)
unit-site-a-ceph-rbd-mirror-0: 14:34:48 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:48 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:34:48 DEBUG juju.worker.uniter [AGENT-STATUS] idle: 
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG juju.worker.uniter.remotestate got a relation units change for site-a-ceph-rbd-mirror/0 : {2 {map[site-a-ceph-mon/1:{1}] map[] []}}
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG juju.worker.uniter.operation running operation run relation-changed (2; unit: site-a-ceph-mon/1) hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG juju.worker.uniter.operation preparing operation "run relation-changed (2; unit: site-a-ceph-mon/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG juju.worker.uniter.operation executing operation "run relation-changed (2; unit: site-a-ceph-mon/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG juju.worker.uniter [AGENT-STATUS] executing: running ceph-local-relation-changed hook
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Reactive main running for hook ceph-local-relation-changed
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: set flag endpoint.ceph-local.changed.auth
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: set flag endpoint.ceph-local.changed.ceph-public-address
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: set flag endpoint.ceph-local.changed.juju-ae4ac4-site-a-3_key
unit-site-a-ceph-rbd-mirror-0: 14:34:51 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: starting handler dispatch, 34 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.auth
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.ceph-public-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: hooks phase, 0 handlers queued
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG juju.worker.uniter.remotestate got a relation units change for site-a-ceph-rbd-mirror/0 : {2 {map[site-a-ceph-mon/0:{1}] map[] []}}
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed active
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-local" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:52 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:34:52 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/ceph.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQB5tlRgzKAiJRAATUXZad+85305psXzViJoQg==)
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-remote" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/remote.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQDU6VNgDbJ3NxAAA/T0GwFSj9zWDmk0zyxWog==)
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Writing file /etc/ceph/ceph.conf root:ceph 640
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Request for evaluation: "None"
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: cleared flag endpoint.ceph-local.changed.auth
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: cleared flag endpoint.ceph-local.changed.juju-ae4ac4-site-a-3_key
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: cleared flag endpoint.ceph-local.changed.ceph-public-address
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:34:53 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4042440447632777358
unit-site-a-ceph-rbd-mirror-0: 14:34:54 INFO juju.worker.uniter.operation ran "ceph-local-relation-changed" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG juju.worker.uniter.operation committing operation "run relation-changed (2; unit: site-a-ceph-mon/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG juju.worker.uniter.operation running operation run relation-changed (2; unit: site-a-ceph-mon/0) hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG juju.worker.uniter.operation preparing operation "run relation-changed (2; unit: site-a-ceph-mon/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG juju.worker.uniter.operation executing operation "run relation-changed (2; unit: site-a-ceph-mon/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Reactive main running for hook ceph-local-relation-changed
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: set flag endpoint.ceph-local.changed.auth
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: set flag endpoint.ceph-local.changed.ceph-public-address
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: set flag endpoint.ceph-local.changed.juju-ae4ac4-site-a-3_key
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:54 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: starting handler dispatch, 34 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.auth
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.ceph-public-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: hooks phase, 0 handlers queued
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed active
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-local" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/ceph.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQB5tlRgzKAiJRAATUXZad+85305psXzViJoQg==)
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-remote" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/remote.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQDU6VNgDbJ3NxAAA/T0GwFSj9zWDmk0zyxWog==)
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Writing file /etc/ceph/ceph.conf root:ceph 640
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:55 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Request for evaluation: "None"
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: cleared flag endpoint.ceph-local.changed.auth
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: cleared flag endpoint.ceph-local.changed.juju-ae4ac4-site-a-3_key
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: cleared flag endpoint.ceph-local.changed.ceph-public-address
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:34:56 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-5113337993063136492
unit-site-a-ceph-rbd-mirror-0: 14:34:57 INFO juju.worker.uniter.operation ran "ceph-local-relation-changed" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:34:57 DEBUG juju.worker.uniter.operation committing operation "run relation-changed (2; unit: site-a-ceph-mon/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:57 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:34:57 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:34:57 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:34:57 DEBUG juju.worker.uniter [AGENT-STATUS] idle: 
unit-site-a-ceph-rbd-mirror-0: 14:34:57 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:35:25 DEBUG juju.worker.uniter.remotestate got a relation units change for site-a-ceph-rbd-mirror/0 : {2 {map[site-a-ceph-mon/1:{2}] map[] []}}
unit-site-a-ceph-rbd-mirror-0: 14:35:25 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:35:25 DEBUG juju.worker.uniter.operation running operation run relation-changed (2; unit: site-a-ceph-mon/1) hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:25 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:25 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:25 DEBUG juju.worker.uniter.operation preparing operation "run relation-changed (2; unit: site-a-ceph-mon/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG juju.worker.uniter.operation executing operation "run relation-changed (2; unit: site-a-ceph-mon/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG juju.worker.uniter [AGENT-STATUS] executing: running ceph-local-relation-changed hook
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Reactive main running for hook ceph-local-relation-changed
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: starting handler dispatch, 31 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: hooks phase, 0 handlers queued
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:35:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:26 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed active
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-local" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/ceph.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQB5tlRgzKAiJRAATUXZad+85305psXzViJoQg==)
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-remote" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/remote.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQDU6VNgDbJ3NxAAA/T0GwFSj9zWDmk0zyxWog==)
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:27 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Request for evaluation: "None"
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4046022948054249099
unit-site-a-ceph-rbd-mirror-0: 14:35:28 INFO juju.worker.uniter.operation ran "ceph-local-relation-changed" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG juju.worker.uniter.operation committing operation "run relation-changed (2; unit: site-a-ceph-mon/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:35:28 DEBUG juju.worker.uniter [AGENT-STATUS] idle: 
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG juju.worker.uniter.remotestate got a relation units change for site-a-ceph-rbd-mirror/0 : {2 {map[site-a-ceph-mon/0:{2}] map[] []}}
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG juju.worker.uniter.operation running operation run relation-changed (2; unit: site-a-ceph-mon/0) hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG juju.worker.uniter.operation preparing operation "run relation-changed (2; unit: site-a-ceph-mon/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG juju.worker.uniter.operation executing operation "run relation-changed (2; unit: site-a-ceph-mon/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG juju.worker.uniter [AGENT-STATUS] executing: running ceph-local-relation-changed hook
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:31 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Reactive main running for hook ceph-local-relation-changed
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: starting handler dispatch, 31 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: hooks phase, 0 handlers queued
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed active
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-local" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}, 'glance': {'applications': {'rbd': {}}, 'parameters': {'pg_num': '128', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/ceph.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQB5tlRgzKAiJRAATUXZad+85305psXzViJoQg==)
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-remote" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:32 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:32 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:35:33 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/remote.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:33 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQDU6VNgDbJ3NxAAA/T0GwFSj9zWDmk0zyxWog==)
unit-site-a-ceph-rbd-mirror-0: 14:35:33 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:33 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:33 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:35:33 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:33 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:33 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:35:33 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:33 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:35:33 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:33 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Enabling mirroring for pool "glance"
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed a5e3de14-1a07-447d-b0d9-f95fdda3ce1c
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Request for evaluation: "<charmhelpers.contrib.storage.linux.ceph.CephBrokerRq object at 0x7f62df8c64f0>"
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Sending request 5c6b46ac-88c0-11eb-a642-13f3541ab4e1
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "relation-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "relation-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "relation-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "relation-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:34 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:35 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:35 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:35 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:35 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:35 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'ERROR': 1}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:35:35 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-1668145686561420281
unit-site-a-ceph-rbd-mirror-0: 14:35:35 INFO juju.worker.uniter.operation ran "ceph-local-relation-changed" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:35:35 DEBUG juju.worker.uniter.operation committing operation "run relation-changed (2; unit: site-a-ceph-mon/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:35 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:35 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:35 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:35:35 DEBUG juju.worker.uniter [AGENT-STATUS] idle: 
unit-site-a-ceph-rbd-mirror-0: 14:35:44 DEBUG juju.worker.uniter.remotestate got a relation units change for site-a-ceph-rbd-mirror/0 : {2 {map[site-a-ceph-mon/1:{3}] map[] []}}
unit-site-a-ceph-rbd-mirror-0: 14:35:44 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:35:44 DEBUG juju.worker.uniter.operation running operation run relation-changed (2; unit: site-a-ceph-mon/1) hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:44 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:44 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:44 DEBUG juju.worker.uniter.operation preparing operation "run relation-changed (2; unit: site-a-ceph-mon/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:44 DEBUG juju.worker.uniter.operation executing operation "run relation-changed (2; unit: site-a-ceph-mon/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:44 DEBUG juju.worker.uniter [AGENT-STATUS] executing: running ceph-local-relation-changed hook
unit-site-a-ceph-rbd-mirror-0: 14:35:44 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Reactive main running for hook ceph-local-relation-changed
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: starting handler dispatch, 31 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: hooks phase, 0 handlers queued
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:35:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed active
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-local" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}, 'glance': {'applications': {'rbd': {}}, 'parameters': {'pg_num': '128', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/ceph.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQB5tlRgzKAiJRAATUXZad+85305psXzViJoQg==)
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-remote" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/remote.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQDU6VNgDbJ3NxAAA/T0GwFSj9zWDmk0zyxWog==)
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG juju.worker.uniter.remotestate got a relation units change for site-a-ceph-rbd-mirror/0 : {2 {map[site-a-ceph-mon/2:{2}] map[] []}}
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Request for evaluation: "<charmhelpers.contrib.storage.linux.ceph.CephBrokerRq object at 0x7feffca9e4c0>"
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Request already sent but not complete, not sending new request
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'ERROR': 1}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-6959182360478565254
unit-site-a-ceph-rbd-mirror-0: 14:35:47 INFO juju.worker.uniter.operation ran "ceph-local-relation-changed" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG juju.worker.uniter.operation committing operation "run relation-changed (2; unit: site-a-ceph-mon/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG juju.worker.uniter.operation running operation run relation-changed (2; unit: site-a-ceph-mon/2) hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/2) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/2) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG juju.worker.uniter.operation preparing operation "run relation-changed (2; unit: site-a-ceph-mon/2) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG juju.worker.uniter.operation executing operation "run relation-changed (2; unit: site-a-ceph-mon/2) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:47 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Reactive main running for hook ceph-local-relation-changed
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: starting handler dispatch, 31 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: hooks phase, 0 handlers queued
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:35:48 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:48 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed active
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-local" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}, 'glance': {'applications': {'rbd': {}}, 'parameters': {'pg_num': '128', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/ceph.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQB5tlRgzKAiJRAATUXZad+85305psXzViJoQg==)
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-remote" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/remote.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQDU6VNgDbJ3NxAAA/T0GwFSj9zWDmk0zyxWog==)
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Request for evaluation: "<charmhelpers.contrib.storage.linux.ceph.CephBrokerRq object at 0x7f32b5a494c0>"
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Request already sent but not complete, not sending new request
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:49 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'ERROR': 1}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-7764058877573251426
unit-site-a-ceph-rbd-mirror-0: 14:35:50 INFO juju.worker.uniter.operation ran "ceph-local-relation-changed" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG juju.worker.uniter.operation committing operation "run relation-changed (2; unit: site-a-ceph-mon/2) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/2) hook)
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG juju.worker.uniter [AGENT-STATUS] idle: 
unit-site-a-ceph-rbd-mirror-0: 14:35:50 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:36:03 DEBUG juju.worker.uniter.remotestate got a relation units change for site-a-ceph-rbd-mirror/0 : {2 {map[site-a-ceph-mon/0:{3}] map[] []}}
unit-site-a-ceph-rbd-mirror-0: 14:36:03 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:36:03 DEBUG juju.worker.uniter.operation running operation run relation-changed (2; unit: site-a-ceph-mon/0) hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:03 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:03 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:03 DEBUG juju.worker.uniter.operation preparing operation "run relation-changed (2; unit: site-a-ceph-mon/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:03 DEBUG juju.worker.uniter.operation executing operation "run relation-changed (2; unit: site-a-ceph-mon/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:03 DEBUG juju.worker.uniter [AGENT-STATUS] executing: running ceph-local-relation-changed hook
unit-site-a-ceph-rbd-mirror-0: 14:36:03 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:36:03 DEBUG juju.worker.uniter.remotestate got a relation units change for site-a-ceph-rbd-mirror/0 : {4 {map[remote-109cbaa83b094df38540bc265ba85463/0:{3}] map[] []}}
unit-site-a-ceph-rbd-mirror-0: 14:36:03 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:03 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Reactive main running for hook ceph-local-relation-changed
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: starting handler dispatch, 31 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer: hooks phase, 0 handlers queued
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:36:04 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:04 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed active
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-local" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}, 'glance': {'applications': {'rbd': {}}, 'parameters': {'pg_num': '128', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/ceph.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQB5tlRgzKAiJRAATUXZad+85305psXzViJoQg==)
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Ceph endpoint "ceph-remote" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed creating /var/lib/ceph/rbd-mirror/remote.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-local-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQDU6VNgDbJ3NxAAA/T0GwFSj9zWDmk0zyxWog==)
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Request for evaluation: "<charmhelpers.contrib.storage.linux.ceph.CephBrokerRq object at 0x7f2cfc2dc4c0>"
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Request already sent but not complete, not sending new request
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:05 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:06 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:06 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-local:2: mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'ERROR': 1}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:36:06 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-ceph-local-relation-changed-4922209702746480410
unit-site-a-ceph-rbd-mirror-0: 14:36:06 INFO juju.worker.uniter.operation ran "ceph-local-relation-changed" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:36:06 DEBUG juju.worker.uniter.operation committing operation "run relation-changed (2; unit: site-a-ceph-mon/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:06 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (2; unit: site-a-ceph-mon/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:06 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:06 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:36:06 DEBUG juju.worker.uniter.operation running operation run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/0) hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:06 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:08 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:08 DEBUG juju.worker.uniter.operation preparing operation "run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:08 DEBUG juju.worker.uniter.operation executing operation "run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:08 DEBUG juju.worker.uniter [AGENT-STATUS] executing: running ceph-remote-relation-changed hook
unit-site-a-ceph-rbd-mirror-0: 14:36:08 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Reactive main running for hook ceph-remote-relation-changed
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: tracer>
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: tracer: hooks phase, 0 handlers queued
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:36:09 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:09 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed active
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Ceph endpoint "ceph-local" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}, 'glance': {'applications': {'rbd': {}}, 'parameters': {'pg_num': '128', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed creating /var/lib/ceph/rbd-mirror/ceph.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQB5tlRgzKAiJRAATUXZad+85305psXzViJoQg==)
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Ceph endpoint "ceph-remote" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}, 'glance': {'applications': {'rbd': {}}, 'parameters': {'pg_num': '128', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed creating /var/lib/ceph/rbd-mirror/remote.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQDU6VNgDbJ3NxAAA/T0GwFSj9zWDmk0zyxWog==)
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Request for evaluation: "<charmhelpers.contrib.storage.linux.ceph.CephBrokerRq object at 0x7ffb3b2b23a0>"
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Request already sent but not complete, not sending new request
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:10 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'ERROR': 1}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-509668429961260816
unit-site-a-ceph-rbd-mirror-0: 14:36:11 INFO juju.worker.uniter.operation ran "ceph-remote-relation-changed" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG juju.worker.uniter.operation committing operation "run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/0) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/0) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG juju.worker.uniter [AGENT-STATUS] idle: 
unit-site-a-ceph-rbd-mirror-0: 14:36:11 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:36:14 DEBUG juju.worker.uniter.remotestate got a relation units change for site-a-ceph-rbd-mirror/0 : {4 {map[remote-109cbaa83b094df38540bc265ba85463/2:{3}] map[] []}}
unit-site-a-ceph-rbd-mirror-0: 14:36:14 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:36:14 DEBUG juju.worker.uniter.operation running operation run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/2) hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:14 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/2) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:15 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/2) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:15 DEBUG juju.worker.uniter.operation preparing operation "run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/2) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:15 DEBUG juju.worker.uniter.operation executing operation "run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/2) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:15 DEBUG juju.worker.uniter [AGENT-STATUS] executing: running ceph-remote-relation-changed hook
unit-site-a-ceph-rbd-mirror-0: 14:36:15 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Reactive main running for hook ceph-remote-relation-changed
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: tracer: hooks phase, 0 handlers queued
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:36:16 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:16 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed active
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Ceph endpoint "ceph-local" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}, 'glance': {'applications': {'rbd': {}}, 'parameters': {'pg_num': '128', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed creating /var/lib/ceph/rbd-mirror/ceph.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQB5tlRgzKAiJRAATUXZad+85305psXzViJoQg==)
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Ceph endpoint "ceph-remote" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}, 'glance': {'applications': {'rbd': {}}, 'parameters': {'pg_num': '128', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed creating /var/lib/ceph/rbd-mirror/remote.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQDU6VNgDbJ3NxAAA/T0GwFSj9zWDmk0zyxWog==)
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Request for evaluation: "<charmhelpers.contrib.storage.linux.ceph.CephBrokerRq object at 0x7fd682d5a490>"
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Request already sent but not complete, not sending new request
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:17 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'ERROR': 1}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-5342453098220515050
unit-site-a-ceph-rbd-mirror-0: 14:36:18 INFO juju.worker.uniter.operation ran "ceph-remote-relation-changed" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG juju.worker.uniter.operation committing operation "run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/2) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/2) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:36:18 DEBUG juju.worker.uniter [AGENT-STATUS] idle: 
unit-site-a-ceph-rbd-mirror-0: 14:36:25 DEBUG juju.worker.uniter.remotestate got a relation units change for site-a-ceph-rbd-mirror/0 : {4 {map[remote-109cbaa83b094df38540bc265ba85463/1:{3}] map[] []}}
unit-site-a-ceph-rbd-mirror-0: 14:36:25 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:36:25 DEBUG juju.worker.uniter.operation running operation run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/1) hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:25 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:25 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:25 DEBUG juju.worker.uniter.operation preparing operation "run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:25 DEBUG juju.worker.uniter.operation executing operation "run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:25 DEBUG juju.worker.uniter [AGENT-STATUS] executing: running ceph-remote-relation-changed hook
unit-site-a-ceph-rbd-mirror-0: 14:36:25 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Reactive main running for hook ceph-remote-relation-changed
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: tracer: hooks phase, 0 handlers queued
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:36:26 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:26 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed active
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Ceph endpoint "ceph-local" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}, 'glance': {'applications': {'rbd': {}}, 'parameters': {'pg_num': '128', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed creating /var/lib/ceph/rbd-mirror/ceph.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQB5tlRgzKAiJRAATUXZad+85305psXzViJoQg==)
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Ceph endpoint "ceph-remote" available, configuring keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Pools: "{'device_health_metrics': {'applications': {'mgr_devicehealth': {}}, 'parameters': {'pg_num': '1', 'size': '3'}, 'quota': {}}, 'glance': {'applications': {'rbd': {}}, 'parameters': {'pg_num': '128', 'size': '3'}, 'quota': {}}}"
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed creating /var/lib/ceph/rbd-mirror/remote.client.rbd-mirror.juju-ae4ac4-site-a-3.keyring
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG unit.site-a-ceph-rbd-mirror/0.ceph-remote-relation-changed added entity client.rbd-mirror.juju-ae4ac4-site-a-3 auth(key=AQDU6VNgDbJ3NxAAA/T0GwFSj9zWDmk0zyxWog==)
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Changing permissions on existing content: 33184 -> 416
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Request for evaluation: "<charmhelpers.contrib.storage.linux.ceph.CephBrokerRq object at 0x7fab3d2dc4c0>"
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Request already sent but not complete, not sending new request
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 INFO unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:27 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log ceph-remote:4: mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'ERROR': 1}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-ceph-remote-relation-changed-6895430713409000685
unit-site-a-ceph-rbd-mirror-0: 14:36:28 INFO juju.worker.uniter.operation ran "ceph-remote-relation-changed" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG juju.worker.uniter.operation committing operation "run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/1) hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run relation-changed (4; unit: remote-109cbaa83b094df38540bc265ba85463/1) hook)
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:36:28 DEBUG juju.worker.uniter [AGENT-STATUS] idle: 
unit-site-a-ceph-rbd-mirror-0: 14:37:16 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:37:16 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:37:16 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:37:16 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:37:16 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:37:16 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:37:16 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:37:16 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:37:16 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:16 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:37:17 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:17 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'OK': 1}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1755831984282684840
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:37:18 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:37:18 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:42:44 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:42:44 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:42:44 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:42:44 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:42:44 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:42:44 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:42:44 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:42:44 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:42:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:44 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:42:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'OK': 1}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6724915848479363900
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:42:46 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:42:46 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:48:13 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:48:13 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:48:13 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:48:13 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:48:13 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:48:13 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:48:13 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:48:13 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:48:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:14 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'OK': 1}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-625927741616007683
unit-site-a-ceph-rbd-mirror-0: 14:48:15 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:48:16 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:48:16 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:48:16 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:48:16 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:48:16 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:53:59 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:53:59 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:53:59 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:53:59 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:53:59 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:53:59 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:53:59 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:53:59 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:54:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:00 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:54:01 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 14:54:01 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:01 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:54:01 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:01 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:54:01 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:01 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:54:01 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:01 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:54:01 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:01 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:54:01 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:01 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'OK': 1}), 'image_states': defaultdict(<class 'int'>, {})}"
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6839112471749827473
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:54:02 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:54:02 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:58:38 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:58:38 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 14:58:38 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:58:38 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:58:38 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:58:38 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:58:38 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:58:38 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 14:58:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:58:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:59:09 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:59:09 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'WARNING': 1}), 'image_states': defaultdict(<class 'int'>, {'unknown': 1})}"
unit-site-a-ceph-rbd-mirror-0: 14:59:09 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:59:09 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-312850202973142757
unit-site-a-ceph-rbd-mirror-0: 14:59:09 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 14:59:09 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 14:59:09 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:59:09 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 14:59:09 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 14:59:09 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:02:45 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:02:45 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:02:45 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:02:45 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:02:45 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:02:45 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:02:45 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:02:45 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:02:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:46 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'WARNING': 1}), 'image_states': defaultdict(<class 'int'>, {'unknown': 1})}"
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6132470630448052833
unit-site-a-ceph-rbd-mirror-0: 15:02:47 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:02:48 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 15:02:48 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:02:48 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:02:48 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:02:48 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:07:49 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:07:49 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:07:49 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:07:49 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:07:49 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:07:49 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:07:50 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:50 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:07:51 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 15:07:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:07:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:07:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:07:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:07:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:51 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 15:07:51 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:51 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 15:07:52 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:52 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:07:52 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:09:20 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:09:20 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'WARNING': 1}), 'image_states': defaultdict(<class 'int'>, {'unknown': 1})}"
unit-site-a-ceph-rbd-mirror-0: 15:09:20 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:09:20 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-81422590894116365
unit-site-a-ceph-rbd-mirror-0: 15:09:20 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:09:20 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 15:09:20 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:09:20 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:09:20 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:09:20 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:11:53 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:11:53 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:11:53 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:11:53 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:11:58 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:11:58 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:11:58 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:11:58 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:11:59 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:11:59 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:00 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:05 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'WARNING': 1}), 'image_states': defaultdict(<class 'int'>, {'unknown': 1})}"
unit-site-a-ceph-rbd-mirror-0: 15:12:05 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:05 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-823057248559817899
unit-site-a-ceph-rbd-mirror-0: 15:12:05 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:12:05 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 15:12:05 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:12:05 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:12:05 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:12:05 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:16:28 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:16:28 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:16:28 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:16:28 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:16:28 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:16:28 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:16:28 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:16:28 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:16:29 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:29 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:16:30 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 15:16:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:30 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:16:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:30 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:16:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:30 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:16:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:30 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:16:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:30 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 15:16:30 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:30 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'WARNING': 1}), 'image_states': defaultdict(<class 'int'>, {'unknown': 1})}"
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-2884145368737588477
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:16:31 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:16:31 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:21:11 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:21:11 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:21:11 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:21:11 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:21:11 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:21:11 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:21:12 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:12 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:21:13 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 15:21:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:13 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:21:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:13 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:21:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:13 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:21:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:13 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:21:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:13 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 15:21:13 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:13 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'WARNING': 1}), 'image_states': defaultdict(<class 'int'>, {'unknown': 1})}"
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-6264035317284904052
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:21:14 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:21:14 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:26:43 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:26:43 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:26:43 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:26:43 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:26:43 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:26:43 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:26:44 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:44 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:26:45 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 15:26:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:26:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:26:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:26:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:26:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:45 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 15:26:45 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:45 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'WARNING': 1}), 'image_states': defaultdict(<class 'int'>, {'unknown': 1})}"
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-8733052529641203326
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:26:46 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:26:46 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:31:38 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:31:38 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:31:38 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:31:38 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:31:38 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:31:38 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:31:38 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:31:38 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:31:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:41 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'WARNING': 1}), 'image_states': defaultdict(<class 'int'>, {'unknown': 1})}"
unit-site-a-ceph-rbd-mirror-0: 15:31:41 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-1095178468693139212
unit-site-a-ceph-rbd-mirror-0: 15:31:41 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:31:41 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 15:31:41 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:31:42 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:31:42 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:31:42 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:37:38 DEBUG juju.worker.uniter.remotestate update status timer triggered for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:37:38 DEBUG juju.worker.uniter no operations in progress; waiting for changes
unit-site-a-ceph-rbd-mirror-0: 15:37:38 DEBUG juju.worker.uniter.operation running operation run update-status hook for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:37:38 DEBUG juju.machinelock acquire machine lock for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:37:38 DEBUG juju.machinelock machine lock acquired for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:37:38 DEBUG juju.worker.uniter.operation preparing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:37:38 DEBUG juju.worker.uniter.operation executing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:37:38 DEBUG juju.worker.uniter.runner starting jujuc server  {unix @/var/lib/juju/agents/unit-site-a-ceph-rbd-mirror-0/agent.socket <nil>}
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Reactive main running for hook update-status
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "config-get" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "relation-list" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "is-leader" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Initializing Leadership Layer (is leader)
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "leader-get" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: starting handler dispatch, 32 flags set
tracer: set flag ceph-local.available
tracer: set flag ceph-local.connected
tracer: set flag ceph-rbd-mirror-installed
tracer: set flag ceph-remote.available
tracer: set flag ceph-remote.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.rendered
tracer: set flag config.set.source
tracer: set flag config.set.use-syslog
tracer: set flag endpoint.ceph-local.changed
tracer: set flag endpoint.ceph-local.changed.broker_requests
tracer: set flag endpoint.ceph-local.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-local.changed.egress-subnets
tracer: set flag endpoint.ceph-local.changed.ingress-address
tracer: set flag endpoint.ceph-local.changed.pools
tracer: set flag endpoint.ceph-local.changed.private-address
tracer: set flag endpoint.ceph-local.joined
tracer: set flag endpoint.ceph-remote.changed
tracer: set flag endpoint.ceph-remote.changed.broker-rsp-site-a-ceph-rbd-mirror-0
tracer: set flag endpoint.ceph-remote.changed.broker_requests
tracer: set flag endpoint.ceph-remote.changed.ceph-cluster-address
tracer: set flag endpoint.ceph-remote.changed.egress-subnets
tracer: set flag endpoint.ceph-remote.changed.ingress-address
tracer: set flag endpoint.ceph-remote.changed.juju-ae4ac4-site-a-3_key
tracer: set flag endpoint.ceph-remote.changed.pools
tracer: set flag endpoint.ceph-remote.changed.private-address
tracer: set flag endpoint.ceph-remote.joined
tracer: set flag leadership.is_leader
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag run-default-update-status
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer: set flag is-update-status-hook
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: main dispatch loop, 8 handlers queued
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:77:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag run-default-update-status
tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status
unit-site-a-ceph-rbd-mirror-0: 15:37:39 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:39 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG unit.site-a-ceph-rbd-mirror/0.update-status active
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 INFO unit.site-a-ceph-rbd-mirror/0.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log Running _assess_status()
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "application-version-set" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "relation-ids" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:40 DEBUG jujuc running hook tool "relation-get" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:41 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log mirror_pools_summary = "{'pool_health': defaultdict(<class 'int'>, {'WARNING': 1}), 'image_states': defaultdict(<class 'int'>, {'unknown': 1})}"
unit-site-a-ceph-rbd-mirror-0: 15:37:41 DEBUG jujuc running hook tool "status-set" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:41 DEBUG jujuc running hook tool "juju-log" for site-a-ceph-rbd-mirror/0-update-status-3374776200086035410
unit-site-a-ceph-rbd-mirror-0: 15:37:41 DEBUG unit.site-a-ceph-rbd-mirror/0.juju-log tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:52:joined:ceph-remote
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-local
tracer: ++   queue handler hooks/relations/ceph-rbd-mirror/requires.py:56:changed:ceph-remote
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:100:configure_pools
tracer: ++   queue handler reactive/ceph_rbd_mirror_handlers.py:63:render_stuff
tracer: ++   queue handler reactive/layer_openstack.py:163:default_config_rendered
unit-site-a-ceph-rbd-mirror-0: 15:37:41 INFO juju.worker.uniter.operation ran "update-status" hook (via explicit, bespoke hook script)
unit-site-a-ceph-rbd-mirror-0: 15:37:41 DEBUG juju.worker.uniter.operation committing operation "run update-status hook" for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:37:41 DEBUG juju.machinelock machine lock released for site-a-ceph-rbd-mirror/0 uniter (run update-status hook)
unit-site-a-ceph-rbd-mirror-0: 15:37:41 DEBUG juju.worker.uniter.operation lock released for site-a-ceph-rbd-mirror/0
unit-site-a-ceph-rbd-mirror-0: 15:37:41 DEBUG juju.worker.uniter no operations in progress; waiting for changes