mysql-router containers on Openstack-base not working

[Tiago Augusto Demay]

as seen below...
When i deploy bundle.yaml mysql-router service does not connect other services to the database.

ceph-radosgw/0* waiting idle 0/lxd/1 192.168.15.59 80/tcp Incomplete relations: identity
cinder/0* waiting executing 1/lxd/1 192.168.15.46 8776/tcp Incomplete relations: database, identity
  cinder-ceph/0* active idle 192.168.15.46 Unit is ready
  cinder-mysql-router/0* blocked idle 192.168.15.46 Failed to connect to MySQL
glance/0* error idle 2/lxd/1 192.168.15.61 9292/tcp hook failed: "shared-db-relation-changed"
  glance-mysql-router/0* blocked idle 192.168.15.61 Failed to connect to MySQL
keystone/0* maintenance executing 0/lxd/2 192.168.15.50 5000/tcp Migrating the keystone database
  keystone-mysql-router/0* blocked idle 192.168.15.50 Failed to connect to MySQL
mysql-innodb-cluster/0 active idle 0/lxd/3 192.168.15.48 Unit is ready: Mode: R/O, Cluster is ONLINE and can tolerate up to ONE failure.
mysql-innodb-cluster/1 active idle 1/lxd/2 192.168.15.43 Unit is ready: Mode: R/O, Cluster is ONLINE and can tolerate up to ONE failure.
mysql-innodb-cluster/2* active idle 2/lxd/2 192.168.15.60 Unit is ready: Mode: R/W, Cluster is ONLINE and can tolerate up to ONE failure.
neutron-api/0* error idle 1/lxd/3 192.168.15.45 9696/tcp hook failed: "shared-db-relation-changed"
  neutron-api-plugin-ovn/0* waiting idle 192.168.15.45 'certificates' awaiting server certificate data, 'neutron-plugin' incomplete, 'ovsdb-cms' incomplete
  neutron-mysql-router/0* blocked idle 192.168.15.45 Failed to connect to MySQL
nova-cloud-controller/0* error idle 0/lxd/4 192.168.15.49 8774/tcp,8775/tcp hook failed: "shared-db-relation-changed"
  nova-mysql-router/0* blocked idle 192.168.15.49 Failed to connect to MySQL
nova-compute/0 active idle 0 192.168.15.40 Unit is ready
  ntp/1* active idle 192.168.15.40 123/udp chrony: Ready
  ovn-chassis/1* waiting idle 192.168.15.40 'certificates' awaiting server certificate data, 'ovsdb' incomplete
nova-compute/1 active idle 1 192.168.15.42 Unit is ready
  ntp/0 active idle 192.168.15.42 123/udp chrony: Ready
  ovn-chassis/0 waiting idle 192.168.15.42 'certificates' awaiting server certificate data, 'ovsdb' incomplete
nova-compute/2* active idle 2 192.168.15.41 Unit is ready
  ntp/2 active idle 192.168.15.41 123/udp chrony: Ready
  ovn-chassis/2 waiting idle 192.168.15.41 'certificates' awaiting server certificate data, 'ovsdb' incomplete
openstack-dashboard/0* error idle 1/lxd/4 192.168.15.55 80/tcp,443/tcp hook failed: "shared-db-relation-changed"
  dashboard-mysql-router/0* blocked idle 192.168.15.55 Failed to connect to MySQL
ovn-central/0* waiting idle 0/lxd/5 192.168.15.47 6641/tcp,6642/tcp 'ovsdb-peer' incomplete, 'certificates' awaiting server certificate data
ovn-central/1 waiting idle 1/lxd/5 192.168.15.56 6641/tcp,6642/tcp 'ovsdb-peer' incomplete, 'certificates' awaiting server certificate data
ovn-central/2 waiting idle 2/lxd/3 192.168.15.54 6641/tcp,6642/tcp 'ovsdb-peer' incomplete, 'certificates' awaiting server certificate data
placement/0* waiting idle 2/lxd/4 192.168.15.51 8778/tcp 'identity-service' incomplete
  placement-mysql-router/0* blocked idle 192.168.15.51 Failed to connect to MySQL
rabbitmq-server/0* active idle 2/lxd/5 192.168.15.52 5672/tcp Unit is ready
vault/0* blocked idle 0/lxd/6 192.168.15.58 8200/tcp Vault service not running
  vault-mysql-router/0* blocked idle 192.168.15.58 Failed to connect to MySQL

[John A Meinel (jameinel)]

Can you include the version of Juju that you are running and the bundle that you are trying to deploy?
It would also be helpful to include any logs associated with the failures. I do see:
neutron-mysql-router/0* blocked idle 192.168.15.45 Failed to connect to MySQL

But that doesn't include enough information to understand why it is failing to connect to MySQL.

It does appear that MySQL is available:
mysql-innodb-cluster/0 active idle 0/lxd/3 192.168.15.48 Unit is ready: Mode: R/O, Cluster is ONLINE and can tolerate up to ONE failure.
mysql-innodb-cluster/1 active idle 1/lxd/2 192.168.15.43 Unit is ready: Mode: R/O, Cluster is ONLINE and can tolerate up to ONE failure.
mysql-innodb-cluster/2* active idle 2/lxd/2 192.168.15.60 Unit is ready: Mode: R/W, Cluster is ONLINE and can tolerate up to ONE failure.

There is nothing that indicates this is a bug in Juju (vs a bug in the charm, vs configuration, etc).
Though if it is something that "it worked yesterday with Juju 2.9.25 and fails today with 2.9.27" that could be something that we changed.

[Tiago Augusto Demay (tiagodemay)]

$ juju version 2.9.29-ubuntu-amd64

By OpenStack Charmers

cs:openstack-base 78

juju deploy ./bundle.yaml

I changed this to Fix..

 annotations:
      gui-x: '900'
      gui-y: '1400'
    charm: cs:mysql-router-15
    charm: cs:mysql-router-26
  cinder:
    annotations:
      gui-x: '980'
@@ -204,7 +204,7 @@ applications:
    annotations:
      gui-x: '-290'
      gui-y: '1400'
    charm: cs:mysql-router-15
    charm: cs:mysql-router-26
  glance:
    annotations:
      gui-x: '-230'
@@ -220,7 +220,7 @@ applications:
    annotations:
      gui-x: '230'
      gui-y: '1400'
    charm: cs:mysql-router-15
    charm: cs:mysql-router-26
  keystone:
    annotations:
      gui-x: '300'
@@ -236,7 +236,7 @@ applications:
    annotations:
      gui-x: '505'
      gui-y: '1385'
    charm: cs:mysql-router-15
    charm: cs:mysql-router-26
  neutron-api-plugin-ovn:
    annotations:
      gui-x: '690'
@@ -259,7 +259,7 @@ applications:
    annotations:
      gui-x: '1320'
      gui-y: '1385'
    charm: cs:mysql-router-15
    charm: cs:mysql-router-26
  placement:
    annotations:
      gui-x: '1320'
@@ -275,7 +275,7 @@ applications:
    annotations:
      gui-x: '-30'
      gui-y: '1385'
    charm: cs:mysql-router-15
    charm: cs:mysql-router-26
  nova-cloud-controller:
    annotations:
      gui-x: '35'
@@ -314,7 +314,7 @@ applications:
    annotations:
      gui-x: '510'
      gui-y: '1030'
    charm: cs:mysql-router-15
    charm: cs:mysql-router-26
  openstack-dashboard:
    annotations:
      gui-x: '585'
@@ -370,7 +370,7 @@ applications:
    annotations:
      gui-x: '1535'
      gui-y: '1560'
    charm: cs:mysql-router-15
    charm: cs:mysql-router-26
  vault:
    annotations:
      gui-x: '1610'

[Launchpad Janitor (janitor)]

[Expired for juju because there has been no activity for 60 days.]