2020-06-04 18:39:48 [INFO] Deploying bundle './tests/bundles/focal-ussuri.yaml' on to 'zaza-06426b0084ad' model
...
zaza.model.UnitError: Units mysql-innodb-cluster/0 in error state
debug log for unit:
2020-06-04 19:04:09 DEBUG db-router-relation-changed Traceback (most recent call last):
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "/var/lib/juju/agents/unit-mysql-innodb-cluster-0/charm/hooks/db-router-relation-changed", line 22, in <module>
2020-06-04 19:04:09 DEBUG db-router-relation-changed main()
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "/var/lib/juju/agents/unit-mysql-innodb-cluster-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
2020-06-04 19:04:09 DEBUG db-router-relation-changed bus.dispatch(restricted=restricted_mode)
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "/var/lib/juju/agents/unit-mysql-innodb-cluster-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
2020-06-04 19:04:09 DEBUG db-router-relation-changed _invoke(other_handlers)
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "/var/lib/juju/agents/unit-mysql-innodb-cluster-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
2020-06-04 19:04:09 DEBUG db-router-relation-changed handler.invoke()
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "/var/lib/juju/agents/unit-mysql-innodb-cluster-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
2020-06-04 19:04:09 DEBUG db-router-relation-changed self._action(*args)
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "/var/lib/juju/agents/unit-mysql-innodb-cluster-0/charm/reactive/mysql_innodb_cluster_handlers.py", line 274, in db_router_respond
2020-06-04 19:04:09 DEBUG db-router-relation-changed if instance.create_databases_and_users(db_router):
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "lib/charm/openstack/mysql_innodb_cluster.py", line 1059, in create_databases_and_users
2020-06-04 19:04:09 DEBUG db-router-relation-changed password = self.configure_db_for_hosts(
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "lib/charm/openstack/mysql_innodb_cluster.py", line 1135, in configure_db_for_hosts
2020-06-04 19:04:09 DEBUG db-router-relation-changed password = rw_helper.configure_db(host, database, username)
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "/var/lib/juju/agents/unit-mysql-innodb-cluster-0/.venv/lib/python3.8/site-packages/charmhelpers/contrib/database/mysql.py", line 464, in configure_db
2020-06-04 19:04:09 DEBUG db-router-relation-changed self.create_database(database)
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "/var/lib/juju/agents/unit-mysql-innodb-cluster-0/.venv/lib/python3.8/site-packages/charmhelpers/contrib/database/mysql.py", line 115, in create_database
2020-06-04 19:04:09 DEBUG db-router-relation-changed cursor.execute("CREATE DATABASE `{}` CHARACTER SET UTF8"
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "/var/lib/juju/agents/unit-mysql-innodb-cluster-0/.venv/lib/python3.8/site-packages/MySQLdb/cursors.py", line 209, in execute
2020-06-04 19:04:09 DEBUG db-router-relation-changed res = self._query(query)
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "/var/lib/juju/agents/unit-mysql-innodb-cluster-0/.venv/lib/python3.8/site-packages/MySQLdb/cursors.py", line 315, in _query
2020-06-04 19:04:09 DEBUG db-router-relation-changed db.query(q)
2020-06-04 19:04:09 DEBUG db-router-relation-changed File "/var/lib/juju/agents/unit-mysql-innodb-cluster-0/.venv/lib/python3.8/site-packages/MySQLdb/connections.py", line 239, in query
2020-06-04 19:04:09 DEBUG db-router-relation-changed _mysql.connection.query(self, query)
2020-06-04 19:04:09 DEBUG db-router-relation-changed MySQLdb._exceptions.OperationalError: (1290, 'The MySQL server is running with the --super-read-only option so it cannot execute this statement')
2020-06-04 19:04:09 ERROR juju.worker.uniter.operation runhook.go:132 hook "db-router-relation-changed" failed: exit status 1
https://review.opendev.org/#/c/732667/
https://openstack-ci-reports.ubuntu.com/artifacts/test_charm_pipeline_func_full/openstack/charm-octavia-diskimage-retrofit/732667/1/5943/index.html
Hit this issue while deploying "Ussuri" on focal.
mysql-innodb- cluster - Gets in error with "hook failed: "cluster- relation- changed" " openstack- base-69 cluster charms used - cs:mysql- innodb- cluster- 0 and cs:~openstack- charmers- next/mysql- innodb- cluster- 42
Ussuri Bundle - cs:bundle/
mysql-innodb-
Debug logs - innodb- cluster- 6: 11:17:12 INFO unit.mysql- innodb- cluster/ 6.juju- log cluster:90: Invoking reactive handler: hooks/relations /mysql- innodb- cluster/ peers.py: 69:joined: cluster innodb- cluster- 6: 11:17:12 DEBUG unit.mysql- innodb- cluster/ 6.juju- log cluster:90: tracer> mysql_innodb_ cluster_ handlers. py:88:create_ remote_ cluster_ user mysql_innodb_ cluster_ handlers. py:66:send_ cluster_ connection_ info innodb- cluster- 6: 11:17:12 INFO unit.mysql- innodb- cluster/ 6.juju- log cluster:90: Invoking reactive handler: hooks/relations /mysql- innodb- cluster/ peers.py: 75:changed: cluster innodb- cluster- 6: 11:17:12 INFO unit.mysql- innodb- cluster/ 6.juju- log cluster:90: Invoking reactive handler: hooks/relations /tls-certificat es/requires. py:109: broken: certificates innodb- cluster- 6: 11:17:13 INFO unit.mysql- innodb- cluster/ 6.juju- log cluster:90: Invoking reactive handler: hooks/relations /mysql- router/ provides. py:47:joined: db-router innodb- cluster- 6: 11:17:13 INFO unit.mysql- innodb- cluster/ 6.juju- log cluster:90: Invoking reactive handler: hooks/relations /mysql- router/ provides. py:53:changed: db-router innodb- cluster- 6: 11:17:13 INFO unit.mysql- innodb- cluster/ 6.juju- log cluster:90: Invoking reactive handler: reactive/ mysql_innodb_ cluster_ handlers. py:88:create_ remote_ cluster_ user innodb- cluster- 6: 11:17:14 DEBUG unit.mysql- innodb- cluster/ 6.juju- log cluster:90: Creating remote users. innodb- cluster- 6: 11:17:14 WARNING unit.mysql- innodb- cluster/ 6.juju- log cluster:90: This instance is not yet clustered: cannot determine the cluster status. innodb- cluster- 6: 11:17:14 WARNING unit.mysql- innodb- cluster/ 6.juju- log cluster:90: Cannot determine the cluster primary RW node for writes. innodb- cluster- 6: 11:17:14 DEBUG unit.mysql- innodb- cluster/ 6.juju- log cluster:90: Opening db connection for root@None innodb- cluster- 6: 11:17:14 WARNING unit.mysql- innodb- cluster/ 6.juju- log cluster:90: User clusteruser already exists. innodb- cluster- 6: 11:17:14 ERROR unit.mysql- innodb- cluster/ 6.juju- log cluster:90: Hook error: juju/agents/ unit-mysql- innodb- cluster- 6/.venv/ lib/python3. 8/site- packages/ charms/ reactive/ __init_ _.py", line 74, in main dispatch( restricted= restricted_ mode) juju/agents/ unit-mysql- innodb- cluster- 6/.venv/ lib/python3. 8/site- packages/ charms/ reactive/ bus.py" , line 390, in dispatch other_handlers) juju/agents/ unit-mysql- innodb- cluster- 6/.venv/ lib/python3. 8/site- packages/ charms/ reactive/ bus.py" , line 359, in _invoke invoke( ) juju/agents/ unit-mysql- innodb- cluster- 6/.venv/ lib/python3. 8/site- packages/ charms/ reactive. ..
unit-mysql-
unit-mysql-
tracer: set flag cluster.available
tracer: ++ queue handler reactive/
tracer: -- dequeue handler reactive/
unit-mysql-
unit-mysql-
unit-mysql-
unit-mysql-
unit-mysql-
unit-mysql-
unit-mysql-
unit-mysql-
unit-mysql-
unit-mysql-
unit-mysql-
Traceback (most recent call last):
File "/var/lib/
bus.
File "/var/lib/
_invoke(
File "/var/lib/
handler.
File "/var/lib/