unit-mysql-innodb-cluster-5: 08:15:32 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 08:15:32 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:15:32 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 08:15:32 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 08:15:32 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 08:15:32 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 08:15:32 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 08:15:32 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 08:15:32 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 08:15:33 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 08:15:34 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 08:15:34 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 08:15:35 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 08:15:35 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 08:15:35 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 08:15:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 08:15:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:15:35 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:15:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 08:15:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 08:15:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:15:35 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:15:35 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 08:15:35 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:15:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:15:35 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 08:15:35 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 08:15:35 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 08:15:35 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 08:15:35 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 08:15:35 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 08:15:36 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 08:15:36 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 08:15:36 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 08:15:39 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:17:21 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 08:17:21 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:17:21 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:17:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 08:17:23 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 08:17:24 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:17:24 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:17:24 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 08:17:24 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 08:17:24 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 08:17:24 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 08:17:24 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 08:17:24 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 08:17:26 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 08:17:26 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 08:17:26 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 08:17:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 08:17:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:17:26 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:17:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 08:17:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 08:17:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:17:26 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:17:26 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 08:17:26 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:17:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:17:26 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 08:17:26 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 08:17:27 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 08:17:27 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 08:17:27 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 08:17:27 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 08:17:27 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 08:17:28 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 08:17:32 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:18:19 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:18:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 08:18:20 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 08:18:20 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 08:18:21 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 08:18:21 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 08:18:21 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 08:18:21 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 08:18:21 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:18:21 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:18:21 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 08:18:21 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 08:18:21 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:18:21 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:18:21 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 08:18:21 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:18:21 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:18:21 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:18:21 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 08:18:21 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 08:18:21 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 08:18:21 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 08:18:21 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 08:18:22 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 08:18:22 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 08:18:22 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:18:51 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:18:51 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 08:19:08 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 08:19:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:19:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 08:19:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 08:19:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 08:19:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 08:19:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 08:19:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 08:19:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 08:19:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 08:19:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:19:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:19:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 08:19:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 08:19:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 08:19:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:19:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:19:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:19:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:19:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:19:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:19:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 08:19:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 08:19:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 08:19:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 08:19:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 08:19:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 08:19:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 08:19:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 08:19:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 08:19:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 08:19:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 08:19:13 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:19:13 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:19:13 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 08:19:13 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 08:19:13 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 08:19:13 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 08:19:14 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 08:19:14 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 08:19:14 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 08:19:14 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 08:19:14 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 08:19:14 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 08:19:14 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:19:14 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:19:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 08:19:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 08:19:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:19:15 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 08:19:15 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:19:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:19:15 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:19:15 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 08:19:15 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 08:19:15 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 08:19:16 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 08:19:17 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 08:19:17 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 08:19:17 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:19:20 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:19:20 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 08:19:23 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 08:21:28 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 08:21:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:21:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 08:21:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 08:21:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 08:21:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 08:21:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 08:21:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 08:21:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 08:21:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 08:21:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 08:21:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 08:21:30 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 08:21:30 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 08:21:30 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 08:21:30 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:21:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 08:21:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:21:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:21:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 08:21:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:21:31 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:21:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 08:21:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 08:21:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 08:21:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 08:21:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 08:21:31 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 08:21:32 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 08:21:32 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 08:21:32 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 08:21:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:22:24 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 08:22:25 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:22:25 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 08:22:25 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 08:22:25 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 08:22:25 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 08:22:25 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 08:22:25 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 08:22:25 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 08:22:25 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 08:22:26 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 08:22:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 08:22:28 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 08:22:28 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 08:22:28 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 08:22:28 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 08:22:28 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 08:22:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 08:22:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:22:28 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:22:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 08:22:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 08:22:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:22:29 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:22:29 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 08:22:29 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:22:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:22:29 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 08:22:29 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 08:22:29 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 08:22:29 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 08:22:29 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 08:22:30 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 08:22:30 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 08:22:30 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:22:31 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 08:22:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 08:22:33 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 08:22:33 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 08:22:33 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 08:22:33 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:22:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:22:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:22:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 08:22:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:22:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:22:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:22:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 08:22:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 08:22:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 08:22:34 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 08:22:34 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 08:22:34 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 08:22:34 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 08:22:34 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 08:22:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:23:03 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:23:03 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 08:23:25 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 08:23:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:23:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 08:23:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 08:23:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 08:23:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 08:23:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 08:23:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 08:23:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 08:23:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 08:23:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:23:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:23:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 08:23:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 08:23:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 08:23:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:23:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:23:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:23:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:23:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:23:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:23:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 08:23:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 08:23:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 08:23:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 08:23:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 08:23:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 08:23:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 08:23:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 08:23:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 08:23:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 08:23:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 08:23:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:23:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:23:30 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 08:23:30 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 08:23:30 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 08:23:30 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 08:23:30 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 08:23:31 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 08:23:31 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 08:23:31 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 08:23:31 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 08:23:31 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 08:23:31 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:23:31 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:23:31 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 08:23:31 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 08:23:31 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:23:31 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 08:23:31 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:23:32 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:23:32 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:23:32 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 08:23:32 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 08:23:32 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 08:23:32 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 08:23:33 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:23:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 08:23:34 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 08:23:34 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 08:23:34 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 08:23:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 08:26:28 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 08:26:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:26:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 08:26:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 08:26:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 08:26:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 08:26:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 08:26:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 08:26:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 08:26:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 08:26:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 08:26:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 08:26:30 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 08:26:30 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 08:26:30 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 08:26:30 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:26:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 08:26:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 08:26:31 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:26:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:26:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 08:26:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:26:31 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:26:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 08:26:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 08:26:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 08:26:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 08:26:31 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 08:26:31 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 08:26:32 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 08:26:32 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 08:26:32 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 08:26:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:27:03 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:27:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 08:27:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 08:27:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 08:27:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 08:27:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 08:27:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 08:27:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:27:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:27:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 08:27:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 08:27:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 08:27:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 08:27:06 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 08:27:06 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 08:27:07 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 08:27:07 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 08:27:07 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 08:27:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 08:27:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:27:07 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:27:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 08:27:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 08:27:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:27:07 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:27:07 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 08:27:07 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:27:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:27:07 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 08:27:07 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 08:27:07 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 08:27:08 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 08:27:08 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 08:27:08 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 08:27:08 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 08:27:09 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 08:27:13 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:27:25 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:27:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 08:27:26 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 08:27:26 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 08:27:26 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 08:27:26 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:27:26 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:27:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 08:27:27 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 08:27:27 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:27:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:27:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 08:27:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:27:27 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:27:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:27:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 08:27:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 08:27:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 08:27:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 08:27:27 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 08:27:28 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 08:27:28 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 08:27:28 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 08:27:47 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 08:27:48 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:27:48 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 08:27:48 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 08:27:48 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 08:27:48 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 08:27:49 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 08:27:49 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 08:27:49 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 08:27:49 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 08:27:49 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:27:49 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:27:49 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 08:27:49 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 08:27:49 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 08:27:50 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:27:50 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:27:50 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:27:50 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:27:50 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:27:50 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:27:50 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 08:27:50 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:27:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 08:27:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 08:27:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 08:27:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 08:27:52 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 08:27:52 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 08:27:53 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 08:27:53 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 08:27:53 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 08:27:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 08:27:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:27:53 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:27:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 08:27:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 08:27:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:27:53 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 08:27:53 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:27:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:27:53 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:27:53 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 08:27:54 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 08:27:54 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 08:27:54 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 08:27:56 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 08:27:56 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 08:27:56 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:27:57 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:27:57 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 08:28:03 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:28:26 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:28:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:30:47 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 08:30:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:30:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 08:30:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 08:30:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 08:30:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 08:30:49 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 08:30:49 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 08:30:50 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 08:30:50 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 08:30:50 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 08:30:50 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 08:30:50 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:30:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:30:50 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 08:30:50 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 08:30:50 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:30:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:30:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 08:30:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:30:50 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:30:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 08:30:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 08:30:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 08:30:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 08:30:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 08:30:50 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 08:30:51 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 08:30:51 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 08:30:51 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 08:30:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 08:32:03 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 08:32:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:32:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 08:32:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 08:32:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 08:32:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 08:32:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 08:32:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 08:32:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 08:32:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 08:32:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:32:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:32:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 08:32:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 08:32:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 08:32:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:32:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:32:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:32:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:32:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:32:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:32:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 08:32:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 08:32:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 08:32:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 08:32:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 08:32:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 08:32:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 08:32:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 08:32:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 08:32:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 08:32:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 08:32:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:32:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:32:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 08:32:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 08:32:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 08:32:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 08:32:09 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 08:32:10 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 08:32:10 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 08:32:10 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 08:32:10 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 08:32:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 08:32:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:32:10 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:32:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 08:32:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 08:32:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:32:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 08:32:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:32:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:32:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:32:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 08:32:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 08:32:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 08:32:11 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 08:32:14 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 08:32:14 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 08:32:14 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 08:32:15 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 08:32:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:32:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 08:32:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 08:32:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 08:32:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 08:32:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 08:32:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 08:32:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 08:32:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 08:32:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 08:32:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 08:32:18 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 08:32:19 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 08:32:19 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 08:32:19 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 08:32:19 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 08:32:19 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 08:32:19 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 08:32:19 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:32:19 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:32:19 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 08:32:19 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 08:32:19 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:32:19 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:32:19 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 08:32:19 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:32:19 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:32:19 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 08:32:19 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 08:32:20 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 08:32:20 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 08:32:20 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 08:32:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 08:32:21 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 08:32:21 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 08:32:21 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 08:32:25 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:33:24 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 08:33:24 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:33:24 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 08:33:24 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 08:33:24 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:33:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:33:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 08:33:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 08:33:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 08:33:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 08:33:26 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 08:33:26 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 08:33:26 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 08:33:26 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 08:33:26 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 08:33:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 08:33:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:33:26 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:33:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 08:33:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 08:33:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:33:26 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:33:26 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 08:33:26 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:33:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:33:26 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:33:26 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 08:33:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 08:33:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 08:33:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 08:33:27 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 08:33:27 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 08:33:27 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 08:33:27 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:33:57 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:33:57 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:34:26 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:34:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:36:21 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:36:22 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 08:36:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 08:36:24 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 08:36:24 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 08:36:24 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 08:36:24 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 08:36:24 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 08:36:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 08:36:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:36:24 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:36:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 08:36:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 08:36:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:36:24 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:36:24 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 08:36:24 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:36:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:36:24 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 08:36:25 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 08:36:25 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 08:36:25 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 08:36:25 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 08:36:25 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 08:36:25 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 08:36:25 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 08:36:25 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 08:36:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:37:34 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 08:37:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:37:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 08:37:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 08:37:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 08:37:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 08:37:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 08:37:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 08:37:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 08:37:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 08:37:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 08:37:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 08:37:38 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 08:37:38 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 08:37:38 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 08:37:38 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 08:37:38 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 08:37:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 08:37:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:37:38 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:37:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 08:37:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 08:37:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:37:38 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:37:38 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 08:37:38 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:37:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:37:38 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 08:37:38 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 08:37:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 08:37:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 08:37:39 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 08:37:40 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 08:37:40 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 08:37:40 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:37:44 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 08:37:44 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:37:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 08:37:45 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 08:37:45 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 08:37:46 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 08:37:46 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 08:37:46 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 08:37:46 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 08:37:46 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:37:46 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:37:46 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 08:37:46 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 08:37:46 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:37:46 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:37:46 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 08:37:46 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:37:46 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:37:46 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:37:46 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 08:37:46 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 08:37:46 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 08:37:46 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 08:37:46 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 08:37:47 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 08:37:47 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 08:37:47 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 08:37:55 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 08:37:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:37:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 08:37:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 08:37:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 08:37:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 08:37:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 08:37:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 08:37:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 08:37:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 08:37:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:37:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:37:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 08:37:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 08:37:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 08:37:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:37:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:37:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:37:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:37:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:37:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:37:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 08:38:00 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 08:38:00 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 08:38:00 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 08:38:00 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 08:38:00 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 08:38:00 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 08:38:00 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 08:38:00 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 08:38:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 08:38:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 08:38:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:38:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:38:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 08:38:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 08:38:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 08:38:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 08:38:02 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 08:38:02 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 08:38:02 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 08:38:03 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 08:38:03 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 08:38:03 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 08:38:03 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:38:03 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:38:03 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 08:38:03 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 08:38:03 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:38:03 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 08:38:03 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:38:03 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:38:03 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:38:03 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 08:38:03 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 08:38:03 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 08:38:04 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 08:38:06 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 08:38:06 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 08:38:06 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 08:38:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:38:16 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:38:16 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:38:45 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:38:45 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:41:16 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:41:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 08:41:18 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 08:41:19 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 08:41:19 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 08:41:19 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 08:41:19 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:41:19 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 08:41:19 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 08:41:19 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:41:19 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 08:41:19 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 08:41:19 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 08:41:20 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 08:41:20 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 08:41:20 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 08:41:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 08:42:22 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 08:42:23 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:42:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 08:42:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 08:42:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 08:42:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 08:42:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 08:42:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 08:42:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 08:42:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 08:42:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:42:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:42:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 08:42:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 08:42:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 08:42:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:42:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:42:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:42:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:42:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:42:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:42:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 08:42:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 08:42:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 08:42:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 08:42:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 08:42:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 08:42:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 08:42:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 08:42:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 08:42:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 08:42:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 08:42:27 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 08:42:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:42:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:42:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 08:42:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 08:42:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 08:42:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 08:42:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 08:42:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 08:42:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 08:42:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 08:42:27 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 08:42:28 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 08:42:28 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 08:42:28 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 08:42:28 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:42:28 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:42:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 08:42:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:42:28 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:42:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 08:42:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:42:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:42:28 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:42:28 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:42:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:42:28 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 08:42:28 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:42:29 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 08:42:29 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 08:42:29 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:42:29 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 08:42:30 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 08:42:30 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 08:42:30 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 08:42:30 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 08:42:30 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-4: 08:42:30 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 08:42:30 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 08:42:30 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 08:42:30 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 08:42:31 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 08:42:31 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:42:31 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:42:31 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 08:42:31 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 08:42:31 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:42:31 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:42:31 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 08:42:31 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:42:31 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:42:31 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 08:42:31 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 08:42:31 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 08:42:31 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 08:42:31 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 08:42:32 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 08:42:32 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 08:42:32 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 08:42:32 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 08:42:32 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 08:42:32 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 08:42:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 08:42:37 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:43:32 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 08:43:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 08:43:34 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 08:43:34 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 08:43:34 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 08:43:34 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:43:34 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 08:43:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:43:34 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:43:35 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 08:43:35 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:43:35 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:43:35 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:43:35 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 08:43:35 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 08:43:35 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 08:43:35 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 08:43:35 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 08:43:35 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 08:43:35 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 08:43:35 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:44:05 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:44:05 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:44:34 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:44:34 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:46:34 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:46:35 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 08:46:36 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 08:46:37 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 08:46:37 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 08:46:37 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 08:46:37 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 08:46:37 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 08:46:37 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 08:46:37 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 08:46:37 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 08:46:37 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:46:37 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:46:37 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 08:46:37 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 08:46:37 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:46:37 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:46:37 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 08:46:37 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:46:37 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:46:37 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 08:46:37 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 08:46:37 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 08:46:38 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 08:46:38 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 08:46:38 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 08:46:38 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 08:46:38 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 08:46:38 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 08:46:41 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 08:47:12 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 08:47:13 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:47:13 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 08:47:13 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 08:47:13 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 08:47:14 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 08:47:14 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 08:47:14 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 08:47:14 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 08:47:14 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 08:47:14 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:47:14 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:47:14 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 08:47:14 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 08:47:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 08:47:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:47:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:47:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:47:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:47:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:47:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:47:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 08:47:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 08:47:15 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 08:47:16 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 08:47:16 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 08:47:16 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 08:47:16 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 08:47:16 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 08:47:16 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 08:47:16 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 08:47:16 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 08:47:16 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:47:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:47:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 08:47:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 08:47:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 08:47:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 08:47:18 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 08:47:18 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 08:47:18 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 08:47:18 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 08:47:18 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 08:47:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 08:47:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:47:18 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:47:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 08:47:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 08:47:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:47:18 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 08:47:18 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:47:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:47:19 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:47:19 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 08:47:19 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 08:47:19 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 08:47:20 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 08:47:21 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 08:47:21 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 08:47:22 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 08:47:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 08:47:32 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:47:33 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 08:47:34 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 08:47:35 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 08:47:35 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 08:47:36 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 08:47:36 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 08:47:36 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 08:47:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 08:47:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:47:36 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:47:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 08:47:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 08:47:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:47:36 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:47:36 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 08:47:36 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:47:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:47:36 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 08:47:36 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 08:47:37 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 08:47:37 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 08:47:37 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 08:47:38 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 08:47:38 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 08:47:38 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 08:47:42 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:47:46 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:47:47 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 08:47:48 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 08:47:48 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 08:47:48 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 08:47:48 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:47:48 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:47:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 08:47:49 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 08:47:49 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:47:49 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:47:49 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 08:47:49 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:47:49 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:47:49 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:47:49 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 08:47:49 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 08:47:49 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 08:47:49 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 08:47:49 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 08:47:50 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 08:47:50 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 08:47:50 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:48:19 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:48:19 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:48:48 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:48:48 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:52:06 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 08:52:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:52:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 08:52:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 08:52:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 08:52:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 08:52:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 08:52:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 08:52:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 08:52:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 08:52:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 08:52:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 08:52:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 08:52:10 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 08:52:10 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 08:52:10 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 08:52:10 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 08:52:10 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 08:52:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 08:52:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:52:10 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:52:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 08:52:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 08:52:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:52:10 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:52:10 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 08:52:10 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:52:11 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:52:11 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 08:52:11 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 08:52:11 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 08:52:11 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 08:52:11 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 08:52:12 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 08:52:12 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 08:52:12 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 08:52:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:52:27 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 08:52:27 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:52:27 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 08:52:27 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 08:52:27 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 08:52:27 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 08:52:27 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 08:52:27 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 08:52:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 08:52:29 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 08:52:29 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 08:52:29 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 08:52:29 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 08:52:29 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 08:52:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 08:52:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:52:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:52:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 08:52:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 08:52:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:52:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:52:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 08:52:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:52:30 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:52:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 08:52:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 08:52:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 08:52:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 08:52:30 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 08:52:30 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 08:52:31 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 08:52:31 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 08:52:31 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 08:52:34 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:52:42 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:52:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 08:52:43 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 08:52:43 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 08:52:44 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 08:52:44 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 08:52:44 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 08:52:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 08:52:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:52:44 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:52:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 08:52:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 08:52:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:52:44 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:52:44 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 08:52:44 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:52:44 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:52:44 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:52:44 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 08:52:44 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 08:52:44 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 08:52:44 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 08:52:44 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 08:52:45 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 08:52:45 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 08:52:45 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 08:53:05 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 08:53:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:53:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 08:53:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 08:53:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 08:53:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 08:53:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 08:53:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 08:53:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 08:53:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 08:53:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:53:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:53:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 08:53:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 08:53:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 08:53:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:53:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:53:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:53:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:53:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:53:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:53:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 08:53:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 08:53:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 08:53:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 08:53:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 08:53:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 08:53:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 08:53:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 08:53:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 08:53:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 08:53:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 08:53:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:53:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:53:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 08:53:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 08:53:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 08:53:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 08:53:11 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 08:53:11 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 08:53:11 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 08:53:11 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 08:53:11 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 08:53:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 08:53:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:53:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:53:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 08:53:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 08:53:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:53:12 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 08:53:12 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:53:12 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:53:12 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:53:12 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 08:53:12 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 08:53:12 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 08:53:12 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 08:53:14 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:53:14 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 08:53:14 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 08:53:14 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 08:53:14 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 08:53:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:53:43 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:53:43 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 08:57:23 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 08:57:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:57:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 08:57:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 08:57:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 08:57:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 08:57:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 08:57:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 08:57:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 08:57:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 08:57:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:57:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 08:57:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 08:57:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 08:57:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 08:57:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:57:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 08:57:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:57:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 08:57:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:57:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 08:57:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 08:57:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 08:57:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 08:57:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 08:57:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 08:57:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 08:57:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 08:57:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 08:57:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 08:57:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 08:57:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 08:57:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:57:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 08:57:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 08:57:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 08:57:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 08:57:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 08:57:28 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 08:57:28 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 08:57:29 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 08:57:29 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 08:57:29 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 08:57:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 08:57:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:57:29 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 08:57:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 08:57:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 08:57:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:57:29 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 08:57:29 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:57:30 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 08:57:30 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 08:57:30 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 08:57:30 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 08:57:30 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 08:57:31 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 08:57:33 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 08:57:33 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 08:57:33 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:57:40 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 08:57:40 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:57:40 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:57:40 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 08:57:40 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 08:57:40 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 08:57:40 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 08:57:40 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 08:57:40 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 08:57:40 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 08:57:40 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 08:57:40 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:57:40 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 08:57:41 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 08:57:41 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 08:57:42 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 08:57:42 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 08:57:42 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 08:57:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 08:57:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:57:42 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 08:57:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 08:57:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 08:57:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:57:42 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:57:42 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 08:57:42 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:57:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 08:57:42 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 08:57:42 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 08:57:42 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 08:57:42 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 08:57:42 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 08:57:42 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 08:57:42 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 08:57:43 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 08:57:43 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 08:57:43 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 08:57:43 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 08:57:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:57:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 08:57:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 08:57:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 08:57:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 08:57:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 08:57:45 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 08:57:45 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 08:57:45 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 08:57:45 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 08:57:45 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 08:57:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 08:57:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:57:45 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 08:57:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 08:57:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 08:57:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:57:45 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 08:57:46 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 08:57:46 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:57:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 08:57:46 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 08:57:46 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 08:57:46 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 08:57:46 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 08:57:46 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 08:57:46 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 08:57:46 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 08:57:46 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 08:57:47 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 08:57:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:57:50 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 08:57:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:57:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 08:57:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 08:57:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 08:57:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 08:57:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 08:57:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 08:57:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 08:57:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 08:57:54 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 08:57:54 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 08:57:54 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 08:57:54 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 08:57:54 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 08:57:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 08:57:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:57:54 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 08:57:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 08:57:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 08:57:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:57:54 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 08:57:54 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 08:57:55 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:57:55 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 08:57:55 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 08:57:55 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 08:57:55 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 08:57:55 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 08:57:55 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 08:57:56 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 08:57:56 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 08:57:56 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 08:58:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 08:58:12 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:58:12 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 08:58:42 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 08:58:42 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:02:01 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:02:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 09:02:03 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 09:02:03 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 09:02:03 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 09:02:03 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 09:02:03 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 09:02:04 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 09:02:04 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:02:04 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:02:04 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 09:02:04 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 09:02:04 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:02:04 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:02:04 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 09:02:04 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:02:04 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:02:04 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 09:02:04 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 09:02:04 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 09:02:04 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 09:02:04 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 09:02:04 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 09:02:05 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 09:02:05 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 09:02:05 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:02:22 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 09:02:23 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:02:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 09:02:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 09:02:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 09:02:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 09:02:25 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 09:02:25 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 09:02:25 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 09:02:25 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 09:02:25 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 09:02:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 09:02:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:02:25 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:02:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 09:02:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 09:02:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:02:25 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:02:25 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 09:02:25 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:02:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:02:25 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 09:02:26 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 09:02:26 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 09:02:26 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 09:02:26 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 09:02:26 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 09:02:26 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 09:02:26 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 09:02:26 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:02:29 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:02:34 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:02:34 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:03:03 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:03:03 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 09:03:20 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 09:03:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:03:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 09:03:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 09:03:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 09:03:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 09:03:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 09:03:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 09:03:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 09:03:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 09:03:22 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:03:22 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:03:22 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 09:03:22 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 09:03:22 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 09:03:22 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:03:22 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:03:22 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:03:23 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:03:23 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:03:23 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:03:23 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 09:03:23 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 09:03:23 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 09:03:23 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 09:03:23 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 09:03:23 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 09:03:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 09:03:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 09:03:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 09:03:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 09:03:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 09:03:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:03:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:03:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 09:03:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 09:03:24 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 09:03:25 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 09:03:25 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 09:03:25 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 09:03:25 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 09:03:26 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 09:03:26 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 09:03:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 09:03:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:03:26 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:03:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 09:03:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 09:03:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:03:26 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 09:03:26 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:03:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:03:26 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:03:26 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 09:03:26 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 09:03:26 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 09:03:27 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 09:03:30 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 09:03:30 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 09:03:30 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 09:03:35 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 09:03:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:03:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 09:03:35 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:03:36 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:03:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 09:03:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 09:03:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 09:03:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 09:03:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:03:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:03:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 09:03:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 09:03:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 09:03:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 09:03:38 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 09:03:38 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 09:03:39 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 09:03:39 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 09:03:39 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 09:03:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 09:03:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:03:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:03:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 09:03:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 09:03:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:03:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:03:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 09:03:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:03:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:03:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:03:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 09:03:40 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 09:03:40 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 09:03:40 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 09:03:41 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 09:03:41 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 09:03:41 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 09:03:45 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:07:47 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 09:07:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:07:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 09:07:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 09:07:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 09:07:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 09:07:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 09:07:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 09:07:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 09:07:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 09:07:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 09:07:49 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 09:07:49 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 09:07:49 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 09:07:49 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 09:07:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:07:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:07:50 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 09:07:50 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 09:07:50 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:07:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:07:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 09:07:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:07:50 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:07:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 09:07:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 09:07:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 09:07:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 09:07:50 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 09:07:50 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 09:07:51 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 09:07:51 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 09:07:51 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:07:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:07:55 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:07:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 09:07:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 09:07:56 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 09:07:57 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 09:07:57 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 09:07:57 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 09:07:57 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 09:07:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 09:07:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:07:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:07:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 09:07:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 09:07:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:07:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:07:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 09:07:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:07:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:07:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 09:07:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 09:07:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 09:07:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 09:07:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 09:07:57 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 09:07:58 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 09:07:58 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 09:07:58 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:08:27 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:08:27 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 09:08:54 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 09:08:55 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:08:55 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 09:08:56 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 09:08:56 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 09:08:56 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 09:08:56 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 09:08:56 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 09:08:56 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 09:08:56 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 09:08:56 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:08:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 09:08:56 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:08:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:08:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 09:08:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 09:08:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 09:08:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:08:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:08:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:08:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:08:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:08:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:08:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 09:08:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 09:08:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 09:08:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 09:08:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 09:08:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 09:08:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 09:08:58 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 09:08:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 09:08:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 09:08:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 09:08:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:08:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:08:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 09:08:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 09:08:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 09:08:59 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 09:09:00 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 09:09:00 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 09:09:00 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 09:09:01 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 09:09:01 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 09:09:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 09:09:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:09:01 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:09:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 09:09:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 09:09:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:09:01 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 09:09:01 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:09:01 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:09:01 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:09:01 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 09:09:02 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 09:09:02 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 09:09:02 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 09:09:04 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 09:09:04 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 09:09:04 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 09:09:04 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 09:09:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:09:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 09:09:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:09:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:09:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:09:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 09:09:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 09:09:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 09:09:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 09:09:07 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 09:09:07 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 09:09:07 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 09:09:07 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 09:09:07 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 09:09:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 09:09:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:09:07 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:09:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 09:09:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 09:09:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:09:08 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:09:08 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 09:09:08 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:09:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:09:08 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:09:08 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 09:09:08 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 09:09:08 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 09:09:08 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 09:09:09 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 09:09:09 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 09:09:09 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 09:09:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:09:13 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:12:31 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 09:12:32 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 09:12:33 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 09:12:33 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 09:12:33 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 09:12:34 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 09:12:34 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 09:12:34 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:13:03 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:13:03 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:13:33 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:13:33 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:13:46 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 09:13:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:13:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 09:13:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 09:13:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 09:13:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 09:13:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 09:13:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 09:13:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 09:13:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 09:13:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 09:13:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 09:13:48 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 09:13:48 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 09:13:48 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 09:13:48 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:13:48 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 09:13:48 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 09:13:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:13:49 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:13:49 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 09:13:49 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:13:49 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:13:49 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 09:13:49 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 09:13:49 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 09:13:49 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 09:13:49 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 09:13:49 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 09:13:50 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 09:13:50 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 09:13:50 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:13:53 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 09:14:25 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 09:14:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:14:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 09:14:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 09:14:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 09:14:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 09:14:26 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 09:14:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 09:14:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 09:14:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 09:14:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:14:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:14:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 09:14:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 09:14:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 09:14:27 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:14:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:14:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:14:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:14:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:14:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:14:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 09:14:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 09:14:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 09:14:28 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 09:14:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 09:14:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 09:14:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 09:14:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 09:14:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 09:14:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 09:14:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 09:14:29 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:14:30 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:14:30 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 09:14:30 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 09:14:30 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 09:14:30 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 09:14:30 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 09:14:31 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 09:14:31 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 09:14:31 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 09:14:31 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 09:14:31 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 09:14:31 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:14:31 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:14:31 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 09:14:31 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 09:14:32 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:14:32 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 09:14:32 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:14:32 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:14:32 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:14:32 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 09:14:32 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 09:14:32 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 09:14:33 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 09:14:35 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 09:14:35 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 09:14:35 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 09:14:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:14:59 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 09:14:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:14:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 09:14:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 09:14:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:15:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 09:15:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:15:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:15:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 09:15:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 09:15:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 09:15:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 09:15:02 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 09:15:02 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 09:15:02 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 09:15:02 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 09:15:02 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 09:15:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 09:15:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:15:03 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:15:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 09:15:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 09:15:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:15:03 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:15:03 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 09:15:03 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:15:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:15:03 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:15:03 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 09:15:03 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 09:15:03 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 09:15:03 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 09:15:04 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 09:15:04 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 09:15:04 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 09:15:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:17:25 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:17:25 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 09:17:26 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 09:17:26 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 09:17:27 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 09:17:27 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 09:17:27 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 09:17:27 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 09:17:27 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 09:17:27 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:17:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:17:27 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 09:17:27 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 09:17:27 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:17:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:17:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 09:17:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:17:27 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:17:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 09:17:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 09:17:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 09:17:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 09:17:27 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 09:17:27 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 09:17:28 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 09:17:28 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 09:17:28 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:17:58 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:17:58 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:18:03 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 09:18:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:18:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 09:18:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 09:18:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 09:18:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 09:18:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 09:18:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 09:18:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 09:18:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 09:18:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 09:18:05 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 09:18:05 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 09:18:05 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 09:18:05 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:18:05 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:18:05 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 09:18:06 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 09:18:06 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:18:06 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:18:06 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 09:18:06 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:18:06 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:18:06 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 09:18:06 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 09:18:06 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 09:18:06 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 09:18:06 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 09:18:06 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 09:18:07 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 09:18:07 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 09:18:07 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:18:10 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:18:27 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:18:27 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 09:19:49 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 09:19:50 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:19:50 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 09:19:50 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 09:19:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 09:19:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 09:19:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 09:19:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 09:19:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 09:19:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 09:19:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:19:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:19:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 09:19:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 09:19:51 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 09:19:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:19:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:19:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:19:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:19:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:19:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:19:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 09:19:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 09:19:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 09:19:52 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 09:19:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 09:19:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 09:19:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 09:19:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 09:19:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 09:19:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 09:19:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 09:19:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:19:53 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:19:54 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 09:19:54 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 09:19:54 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 09:19:54 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 09:19:54 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 09:19:54 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 09:19:55 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 09:19:55 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 09:19:55 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 09:19:55 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 09:19:55 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:19:55 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:19:55 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 09:19:55 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 09:19:56 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:19:56 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 09:19:56 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:19:56 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:19:56 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:19:56 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 09:19:56 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 09:19:56 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 09:19:57 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 09:19:59 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 09:19:59 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 09:19:59 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 09:20:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:20:08 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 09:20:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:20:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 09:20:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 09:20:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 09:20:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 09:20:08 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:20:09 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 09:20:10 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 09:20:11 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 09:20:11 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 09:20:11 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 09:20:11 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 09:20:11 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 09:20:11 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 09:20:11 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 09:20:11 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 09:20:11 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:20:11 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:20:11 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 09:20:11 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 09:20:11 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:20:11 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:20:11 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 09:20:11 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:20:12 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:20:12 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:20:12 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 09:20:12 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 09:20:12 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 09:20:12 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 09:20:13 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 09:20:13 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 09:20:13 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 09:20:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:22:05 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 09:22:05 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 09:22:06 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 09:22:06 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 09:22:07 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 09:22:07 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 09:22:07 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 09:22:07 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 09:22:07 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:22:07 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:22:07 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 09:22:07 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 09:22:07 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:22:07 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:22:07 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 09:22:07 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:22:07 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:22:07 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 09:22:07 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 09:22:07 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 09:22:07 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 09:22:07 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 09:22:07 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 09:22:08 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 09:22:08 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 09:22:08 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:22:37 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:22:37 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:23:06 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:23:06 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:24:00 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 09:24:01 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:24:02 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:24:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 09:24:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 09:24:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 09:24:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 09:24:03 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 09:24:03 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 09:24:03 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 09:24:03 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 09:24:03 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 09:24:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 09:24:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:24:03 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:24:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 09:24:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 09:24:03 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:24:03 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:24:03 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 09:24:03 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:24:04 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:24:04 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 09:24:04 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 09:24:04 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 09:24:04 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 09:24:04 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 09:24:04 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 09:24:04 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 09:24:04 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 09:24:05 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:24:08 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 09:24:42 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 09:24:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:24:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 09:24:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 09:24:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 09:24:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 09:24:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 09:24:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 09:24:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 09:24:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 09:24:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:24:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:24:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 09:24:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 09:24:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 09:24:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:24:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:24:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:24:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:24:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:24:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:24:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 09:24:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 09:24:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 09:24:46 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 09:24:46 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 09:24:46 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 09:24:46 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 09:24:46 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 09:24:46 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 09:24:46 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 09:24:46 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 09:24:47 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:24:47 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:24:47 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 09:24:47 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 09:24:47 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 09:24:47 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 09:24:48 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 09:24:48 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 09:24:48 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 09:24:48 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 09:24:48 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 09:24:48 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 09:24:48 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:24:48 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:24:48 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 09:24:48 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 09:24:49 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:24:49 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 09:24:49 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:24:49 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:24:49 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:24:49 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 09:24:49 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 09:24:49 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 09:24:50 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 09:24:51 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 09:24:51 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 09:24:51 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 09:24:57 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:25:13 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 09:25:14 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 09:25:15 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 09:25:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 09:25:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 09:25:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:25:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:25:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 09:25:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 09:25:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 09:25:16 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 09:25:16 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 09:25:16 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 09:25:17 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 09:25:17 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 09:25:17 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 09:25:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 09:25:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:25:17 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:25:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 09:25:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 09:25:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:25:17 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:25:17 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 09:25:17 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:25:17 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:25:17 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:25:17 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 09:25:17 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 09:25:17 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 09:25:17 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 09:25:18 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 09:25:18 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 09:25:18 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 09:25:22 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:26:14 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 09:26:14 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:26:14 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 09:26:14 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 09:26:14 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 09:26:14 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 09:26:14 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 09:26:14 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 09:26:14 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 09:26:14 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 09:26:14 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:26:14 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 09:26:15 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 09:26:15 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 09:26:16 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 09:26:16 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 09:26:16 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 09:26:16 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 09:26:16 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 09:26:16 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:26:16 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:26:16 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 09:26:16 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 09:26:16 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:26:16 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:26:16 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 09:26:16 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:26:16 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:26:16 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 09:26:16 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 09:26:16 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 09:26:16 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 09:26:16 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 09:26:16 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 09:26:17 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 09:26:17 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 09:26:17 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:26:46 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:26:46 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:27:16 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:27:16 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 09:29:05 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 09:29:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:29:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 09:29:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 09:29:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 09:29:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 09:29:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 09:29:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 09:29:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 09:29:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 09:29:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:29:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:29:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 09:29:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 09:29:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 09:29:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:29:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:29:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:29:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:29:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:29:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:29:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 09:29:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 09:29:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 09:29:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 09:29:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 09:29:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 09:29:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 09:29:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 09:29:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 09:29:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 09:29:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 09:29:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:29:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:29:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 09:29:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 09:29:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 09:29:10 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 09:29:10 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 09:29:10 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 09:29:11 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 09:29:11 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 09:29:11 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 09:29:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 09:29:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:29:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:29:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 09:29:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 09:29:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:29:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 09:29:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:29:11 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:29:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:29:11 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 09:29:12 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 09:29:12 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 09:29:12 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 09:29:14 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 09:29:14 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 09:29:14 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 09:29:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 09:29:44 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 09:29:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:29:44 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 09:29:45 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 09:29:46 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 09:29:46 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 09:29:47 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 09:29:47 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 09:29:47 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 09:29:47 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 09:29:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 09:29:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:29:47 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:29:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 09:29:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 09:29:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:29:47 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:29:47 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 09:29:47 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:29:47 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:29:47 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 09:29:47 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 09:29:47 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 09:29:47 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 09:29:47 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 09:29:47 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 09:29:48 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 09:29:48 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 09:29:48 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:29:51 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:30:02 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 09:30:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:30:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 09:30:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:30:03 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:30:04 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:30:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 09:30:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 09:30:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 09:30:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 09:30:05 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 09:30:05 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 09:30:05 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 09:30:05 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 09:30:05 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 09:30:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 09:30:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:30:05 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:30:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 09:30:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 09:30:05 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:30:06 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:30:06 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 09:30:06 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:30:06 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:30:06 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:30:06 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 09:30:06 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 09:30:06 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 09:30:06 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 09:30:07 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 09:30:07 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 09:30:07 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 09:30:11 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:30:17 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:30:17 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 09:30:18 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 09:30:18 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 09:30:18 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 09:30:18 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:30:18 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:30:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 09:30:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 09:30:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:30:19 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:30:19 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 09:30:19 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:30:19 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:30:19 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 09:30:19 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 09:30:19 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 09:30:19 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 09:30:19 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 09:30:19 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 09:30:19 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 09:30:19 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 09:30:20 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:30:49 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:30:49 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:31:18 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:31:18 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:34:10 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 09:34:10 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:34:10 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 09:34:11 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 09:34:12 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 09:34:12 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 09:34:13 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 09:34:13 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 09:34:13 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 09:34:13 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 09:34:13 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:34:13 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:34:13 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 09:34:13 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 09:34:13 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:34:13 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:34:13 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 09:34:13 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:34:13 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:34:13 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 09:34:13 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 09:34:13 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 09:34:13 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 09:34:13 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 09:34:13 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 09:34:14 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 09:34:14 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 09:34:14 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:34:17 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 09:34:39 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 09:34:40 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:34:40 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 09:34:40 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 09:34:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 09:34:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 09:34:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 09:34:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 09:34:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 09:34:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 09:34:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:34:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:34:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 09:34:41 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 09:34:42 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 09:34:42 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:34:42 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:34:42 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:34:42 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:34:42 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:34:42 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:34:42 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 09:34:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 09:34:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 09:34:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 09:34:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 09:34:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 09:34:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 09:34:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 09:34:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 09:34:43 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 09:34:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 09:34:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:34:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:34:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 09:34:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 09:34:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 09:34:44 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 09:34:45 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 09:34:45 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 09:34:45 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 09:34:45 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 09:34:45 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 09:34:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 09:34:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:34:45 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:34:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 09:34:45 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 09:34:46 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:34:46 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 09:34:46 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:34:46 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:34:46 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:34:46 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 09:34:46 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 09:34:46 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 09:34:47 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 09:34:48 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 09:34:48 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 09:34:49 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 09:34:50 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 09:34:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:34:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:34:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 09:34:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 09:34:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 09:34:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 09:34:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:34:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:34:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 09:34:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 09:34:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 09:34:53 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 09:34:53 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 09:34:53 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 09:34:54 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 09:34:54 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 09:34:54 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 09:34:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 09:34:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:34:54 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:34:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 09:34:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 09:34:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:34:54 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:34:54 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 09:34:54 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:34:54 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:34:54 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:34:55 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 09:34:55 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 09:34:55 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 09:34:55 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 09:34:56 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:34:56 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 09:34:56 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 09:34:56 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 09:35:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:35:00 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 09:35:00 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 09:35:01 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 09:35:02 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 09:35:02 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 09:35:02 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 09:35:02 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:35:02 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:35:02 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:35:02 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 09:35:02 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:35:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:35:02 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 09:35:02 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 09:35:02 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 09:35:02 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 09:35:03 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 09:35:03 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-11: 09:35:03 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 09:35:03 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 09:35:03 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:35:33 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:35:33 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:36:02 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:36:02 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:38:58 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:38:59 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 09:39:00 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 09:39:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:39:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:39:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 09:39:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 09:39:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 09:39:01 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 09:39:01 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 09:39:01 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 09:39:01 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 09:39:01 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 09:39:02 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 09:39:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 09:39:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:39:02 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:39:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 09:39:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 09:39:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:39:02 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:39:02 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 09:39:02 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:39:02 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:39:02 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:39:02 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 09:39:02 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 09:39:02 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 09:39:02 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 09:39:03 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 09:39:03 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 09:39:03 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 09:39:07 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:39:54 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 09:39:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:39:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 09:39:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 09:39:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 09:39:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 09:39:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 09:39:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 09:39:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 09:39:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 09:39:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:39:54 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 09:39:55 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 09:39:56 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-5: 09:39:56 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 09:39:56 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 09:39:56 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:39:56 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 09:39:56 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:39:56 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:39:57 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 09:39:57 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:39:57 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:39:57 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 09:39:57 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 09:39:57 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 09:39:57 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 09:39:57 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 09:39:57 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 09:39:57 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 09:39:58 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 09:39:58 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:39:58 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:39:58 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 09:39:59 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 09:39:59 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 09:40:00 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 09:40:00 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 09:40:00 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 09:40:00 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 09:40:00 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:40:00 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:40:00 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 09:40:00 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 09:40:00 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:40:00 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:40:00 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 09:40:00 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:40:00 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:40:00 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 09:40:00 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 09:40:00 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 09:40:00 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 09:40:00 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 09:40:00 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 09:40:00 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:40:01 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 09:40:01 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 09:40:01 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 09:40:15 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 09:40:16 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:40:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 09:40:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 09:40:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 09:40:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 09:40:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 09:40:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 09:40:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 09:40:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 09:40:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:40:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:40:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 09:40:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 09:40:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 09:40:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:40:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:40:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:40:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:40:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:40:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:40:18 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 09:40:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 09:40:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 09:40:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 09:40:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 09:40:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 09:40:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 09:40:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 09:40:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 09:40:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 09:40:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 09:40:19 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:40:20 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:40:20 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 09:40:20 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 09:40:20 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 09:40:20 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 09:40:20 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 09:40:20 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 09:40:21 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 09:40:21 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 09:40:21 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 09:40:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 09:40:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:40:21 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:40:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 09:40:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 09:40:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:40:21 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 09:40:21 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:40:21 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:40:21 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:40:21 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 09:40:22 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 09:40:22 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 09:40:22 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 09:40:24 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 09:40:24 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 09:40:24 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 09:40:30 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 09:40:30 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:40:30 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:40:59 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:40:59 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:44:48 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 09:44:49 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 09:44:50 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 09:44:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 09:44:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 09:44:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 09:44:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 09:44:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:44:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:44:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 09:44:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 09:44:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 09:44:51 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 09:44:51 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 09:44:52 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 09:44:52 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 09:44:52 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 09:44:52 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 09:44:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 09:44:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:44:52 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:44:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 09:44:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 09:44:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:44:52 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:44:52 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 09:44:52 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:44:52 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:44:52 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:44:52 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 09:44:53 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 09:44:53 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 09:44:53 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 09:44:54 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 09:44:54 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 09:44:54 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-11: 09:44:55 INFO unit.mysql-innodb-cluster/11.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-11: 09:44:55 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-11: 09:44:56 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-11: 09:44:56 DEBUG unit.mysql-innodb-cluster/11.update-status lxc unit-mysql-innodb-cluster-11: 09:44:57 WARNING unit.mysql-innodb-cluster/11.update-status All snaps up to date. unit-mysql-innodb-cluster-11: 09:44:57 INFO unit.mysql-innodb-cluster/11.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-11: 09:44:57 INFO unit.mysql-innodb-cluster/11.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-11: 09:44:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-11: 09:44:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:44:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-11: 09:44:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-11: 09:44:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-11: 09:44:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:44:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:44:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-11: 09:44:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:44:57 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-11: 09:44:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-11: 09:44:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-11: 09:44:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-11: 09:44:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-11: 09:44:57 INFO unit.mysql-innodb-cluster/11.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-11: 09:44:57 DEBUG unit.mysql-innodb-cluster/11.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 09:44:58 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:44:58 DEBUG unit.mysql-innodb-cluster/11.update-status active unit-mysql-innodb-cluster-11: 09:44:58 DEBUG unit.mysql-innodb-cluster/11.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-11: 09:44:58 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:45:23 INFO unit.mysql-innodb-cluster/5.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-5: 09:45:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:45:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-5: 09:45:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-5: 09:45:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-5: 09:45:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-5: 09:45:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-5: 09:45:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-5: 09:45:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-5: 09:45:24 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-5: 09:45:25 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-5: 09:45:26 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-5: 09:45:26 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-5: 09:45:26 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-5: 09:45:26 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:45:26 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-5: 09:45:26 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-5: 09:45:26 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-5: 09:45:26 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-5: 09:45:26 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-5: 09:45:26 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-5: 09:45:26 DEBUG unit.mysql-innodb-cluster/5.update-status lxc unit-mysql-innodb-cluster-11: 09:45:27 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:45:27 DEBUG unit.mysql-innodb-cluster/11.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:45:27 WARNING unit.mysql-innodb-cluster/5.update-status All snaps up to date. unit-mysql-innodb-cluster-5: 09:45:28 INFO unit.mysql-innodb-cluster/5.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-5: 09:45:28 INFO unit.mysql-innodb-cluster/5.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-5: 09:45:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-5: 09:45:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:45:28 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-5: 09:45:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-5: 09:45:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-5: 09:45:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:45:28 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-5: 09:45:28 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-5: 09:45:28 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:45:28 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-5: 09:45:28 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-5: 09:45:28 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router unit-mysql-innodb-cluster-5: 09:45:28 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-5: 09:45:28 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-5: 09:45:28 INFO unit.mysql-innodb-cluster/5.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-5: 09:45:28 DEBUG unit.mysql-innodb-cluster/5.juju-log Running _assess_status() unit-mysql-innodb-cluster-5: 09:45:29 DEBUG unit.mysql-innodb-cluster/5.update-status active unit-mysql-innodb-cluster-5: 09:45:29 DEBUG unit.mysql-innodb-cluster/5.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-5: 09:45:29 DEBUG unit.mysql-innodb-cluster/5.juju-log Checking cluster status. unit-mysql-innodb-cluster-5: 09:45:32 DEBUG unit.mysql-innodb-cluster/5.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-11: 09:45:56 ERROR unit.mysql-innodb-cluster/11.juju-log Cluster is unavailable: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Traceback (most recent call last): File "", line 2, in SystemError: RuntimeError: Dba.get_cluster: This function is not available through a session to an instance belonging to an unmanaged replication group unit-mysql-innodb-cluster-11: 09:45:56 DEBUG unit.mysql-innodb-cluster/11.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-4: 09:46:02 INFO unit.mysql-innodb-cluster/4.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-4: 09:46:03 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:46:04 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-4: 09:46:04 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-4: 09:46:04 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-4: 09:46:04 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-4: 09:46:04 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-4: 09:46:04 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-4: 09:46:04 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-4: 09:46:04 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-4: 09:46:04 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:46:04 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-4: 09:46:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-4: 09:46:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-4: 09:46:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-4: 09:46:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:46:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-4: 09:46:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:46:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-4: 09:46:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:46:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-4: 09:46:05 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-4: 09:46:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-4: 09:46:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-4: 09:46:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-4: 09:46:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-4: 09:46:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-4: 09:46:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-4: 09:46:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-4: 09:46:06 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-4: 09:46:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-4: 09:46:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-4: 09:46:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:46:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-4: 09:46:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-4: 09:46:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-4: 09:46:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-4: 09:46:07 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-4: 09:46:08 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-4: 09:46:08 DEBUG unit.mysql-innodb-cluster/4.update-status lxc unit-mysql-innodb-cluster-4: 09:46:08 WARNING unit.mysql-innodb-cluster/4.update-status All snaps up to date. unit-mysql-innodb-cluster-4: 09:46:08 INFO unit.mysql-innodb-cluster/4.juju-log Initializing Leadership Layer (is leader) unit-mysql-innodb-cluster-4: 09:46:08 INFO unit.mysql-innodb-cluster/4.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-4: 09:46:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: starting handler dispatch, 125 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-4: 09:46:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:46:08 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-4: 09:46:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-4: 09:46:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-4: 09:46:08 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:46:08 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-4: 09:46:08 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:46:09 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-4: 09:46:09 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-4: 09:46:09 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-4: 09:46:09 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-4: 09:46:09 INFO unit.mysql-innodb-cluster/4.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-4: 09:46:09 DEBUG unit.mysql-innodb-cluster/4.juju-log Running _assess_status() unit-mysql-innodb-cluster-4: 09:46:11 DEBUG unit.mysql-innodb-cluster/4.update-status active unit-mysql-innodb-cluster-4: 09:46:11 DEBUG unit.mysql-innodb-cluster/4.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-4: 09:46:11 DEBUG unit.mysql-innodb-cluster/4.juju-log Checking cluster status. unit-mysql-innodb-cluster-4: 09:46:17 DEBUG unit.mysql-innodb-cluster/4.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:49:35 INFO unit.mysql-innodb-cluster/6.juju-log Reactive main running for hook update-status unit-mysql-innodb-cluster-6: 09:49:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:49:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_cert unit-mysql-innodb-cluster-6: 09:49:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_key unit-mysql-innodb-cluster-6: 09:49:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.ssl_ca unit-mysql-innodb-cluster-6: 09:49:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.action-managed-upgrade unit-mysql-innodb-cluster-6: 09:49:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.source unit-mysql-innodb-cluster-6: 09:49:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.source unit-mysql-innodb-cluster-6: 09:49:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.cluster-name unit-mysql-innodb-cluster-6: 09:49:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.cluster-name unit-mysql-innodb-cluster-6: 09:49:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:49:36 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.auto-rejoin-tries unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.expel-timeout unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.expel-timeout unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-buffer-pool-size unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-change-buffering unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-io-capacity unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.innodb-file-per-table unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.tuning-level unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.tuning-level unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.table-open-cache unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.table-open-cache unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.max-connections unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.max-connections unit-mysql-innodb-cluster-6: 09:49:37 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.enable-binlogs unit-mysql-innodb-cluster-6: 09:49:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-path unit-mysql-innodb-cluster-6: 09:49:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-path unit-mysql-innodb-cluster-6: 09:49:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-max-size unit-mysql-innodb-cluster-6: 09:49:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-max-size unit-mysql-innodb-cluster-6: 09:49:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:49:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.binlogs-expire-days unit-mysql-innodb-cluster-6: 09:49:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.prefer-ipv6 unit-mysql-innodb-cluster-6: 09:49:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.set.wait-timeout unit-mysql-innodb-cluster-6: 09:49:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.wait-timeout unit-mysql-innodb-cluster-6: 09:49:38 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag config.default.os-db-router-hostname unit-mysql-innodb-cluster-6: 09:49:38 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Snap Layer unit-mysql-innodb-cluster-6: 09:49:38 DEBUG unit.mysql-innodb-cluster/6.update-status lxc unit-mysql-innodb-cluster-6: 09:49:39 WARNING unit.mysql-innodb-cluster/6.update-status All snaps up to date. unit-mysql-innodb-cluster-6: 09:49:39 INFO unit.mysql-innodb-cluster/6.juju-log Coordinator: Initializing coordinator layer unit-mysql-innodb-cluster-6: 09:49:39 INFO unit.mysql-innodb-cluster/6.juju-log Initializing Leadership Layer (is follower) unit-mysql-innodb-cluster-6: 09:49:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: starting handler dispatch, 121 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag charms.openstack.do-default-upgrade-charm tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.action-managed-upgrade tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-buffer-pool-size tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.max-connections tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.166 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.181 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.189 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.200 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.205 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.225 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.53 tracer: set flag leadership.set.cluster-instance-clustered-192.168.200.56 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.166 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.181 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.189 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.200 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.205 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.225 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.53 tracer: set flag leadership.set.cluster-instance-configured-192.168.200.56 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.mysql-barbican.passwd tracer: set flag leadership.set.mysql-cinder.passwd tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-octavia.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql-vault.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set unit-mysql-innodb-cluster-6: 09:49:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:49:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:59:default_update_status unit-mysql-innodb-cluster-6: 09:49:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag run-default-update-status unit-mysql-innodb-cluster-6: 09:49:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer: set flag is-update-status-hook unit-mysql-innodb-cluster-6: 09:49:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:77:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:88:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:49:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered unit-mysql-innodb-cluster-6: 09:49:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:77:check_really_is_update_status unit-mysql-innodb-cluster-6: 09:49:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:49:39 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:88:run_default_update_status unit-mysql-innodb-cluster-6: 09:49:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates unit-mysql-innodb-cluster-6: 09:49:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router unit-mysql-innodb-cluster-6: 09:49:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster unit-mysql-innodb-cluster-6: 09:49:39 INFO unit.mysql-innodb-cluster/6.juju-log Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster unit-mysql-innodb-cluster-6: 09:49:39 DEBUG unit.mysql-innodb-cluster/6.juju-log Running _assess_status() unit-mysql-innodb-cluster-6: 09:49:40 DEBUG unit.mysql-innodb-cluster/6.update-status active unit-mysql-innodb-cluster-6: 09:49:40 DEBUG unit.mysql-innodb-cluster/6.juju-log Opening db connection for root@localhost unit-mysql-innodb-cluster-6: 09:49:41 DEBUG unit.mysql-innodb-cluster/6.juju-log Checking cluster status. unit-mysql-innodb-cluster-6: 09:49:45 DEBUG unit.mysql-innodb-cluster/6.juju-log tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:198:signal_clustered