Failed to connect to NOVA_API database

Bug #1851654 reported by Andrew McLeod
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Placement Charm
Triaged
High
Unassigned

Bug Description

Race found from a deploy of eoan-train on s390x - resolving manually leads to the database being available eventually.

unit-placement-0: 13:33:52 DEBUG unit.placement/0.identity-service-relation-changed Failed to connect to NOVA_API database
unit-placement-0: 13:33:52 DEBUG unit.placement/0.identity-service-relation-changed mysql: [Warning] Using a password on the command line interface can be insecure.
unit-placement-0: 13:33:52 DEBUG unit.placement/0.identity-service-relation-changed ERROR 2003 (HY000): Can't connect to MySQL server on '10.13.3.207' (113)
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed Unable to proceed without connection to nova database
unit-placement-0: 13:33:54 DEBUG worker.uniter.jujuc running hook tool "juju-log"
unit-placement-0: 13:33:54 DEBUG unit.placement/0.juju-log identity-service:40: ['/usr/share/placement/mysql-migrate-db.sh', '--migrate', '--skip-locks', '/etc/placement/migrate-db.rc'] returncode=5 output=None
unit-placement-0: 13:33:54 DEBUG worker.uniter.jujuc running hook tool "juju-log"
unit-placement-0: 13:33:54 ERROR unit.placement/0.juju-log identity-service:40: Hook error:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-placement-0/.venv/lib/python3.7/site-packages/charms/reactive/__init__.py", line 74, in main
    bus.dispatch(restricted=restricted_mode)
  File "/var/lib/juju/agents/unit-placement-0/.venv/lib/python3.7/site-packages/charms/reactive/bus.py", line 390, in dispatch
    _invoke(other_handlers)
  File "/var/lib/juju/agents/unit-placement-0/.venv/lib/python3.7/site-packages/charms/reactive/bus.py", line 359, in _invoke
    handler.invoke()
  File "/var/lib/juju/agents/unit-placement-0/.venv/lib/python3.7/site-packages/charms/reactive/bus.py", line 181, in invoke
    self._action(*args)
  File "/var/lib/juju/agents/unit-placement-0/charm/reactive/placement_handlers.py", line 53, in init_db
    placement_charm.db_migrate()
  File "lib/charm/openstack/placement.py", line 87, in db_migrate
    subprocess.check_call(self.migrate_cmd)
  File "/usr/lib/python3.7/subprocess.py", line 363, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/usr/share/placement/mysql-migrate-db.sh', '--migrate', '--skip-locks', '/etc/placement/migrate-db.rc']' returned non-zero exit status 5.

unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed Traceback (most recent call last):
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed File "/var/lib/juju/agents/unit-placement-0/charm/hooks/identity-service-relation-changed", line 22, in <module>
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed main()
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed File "/var/lib/juju/agents/unit-placement-0/.venv/lib/python3.7/site-packages/charms/reactive/__init__.py", line 74, in main
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed bus.dispatch(restricted=restricted_mode)
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed File "/var/lib/juju/agents/unit-placement-0/.venv/lib/python3.7/site-packages/charms/reactive/bus.py", line 390, in dispatch
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed _invoke(other_handlers)
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed File "/var/lib/juju/agents/unit-placement-0/.venv/lib/python3.7/site-packages/charms/reactive/bus.py", line 359, in _invoke
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed handler.invoke()
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed File "/var/lib/juju/agents/unit-placement-0/.venv/lib/python3.7/site-packages/charms/reactive/bus.py", line 181, in invoke
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed self._action(*args)
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed File "/var/lib/juju/agents/unit-placement-0/charm/reactive/placement_handlers.py", line 53, in init_db
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed placement_charm.db_migrate()
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed File "lib/charm/openstack/placement.py", line 87, in db_migrate
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed subprocess.check_call(self.migrate_cmd)
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed File "/usr/lib/python3.7/subprocess.py", line 363, in check_call
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed raise CalledProcessError(retcode, cmd)
unit-placement-0: 13:33:54 DEBUG unit.placement/0.identity-service-relation-changed subprocess.CalledProcessError: Command '['/usr/share/placement/mysql-migrate-db.sh', '--migrate', '--skip-locks', '/etc/placement/migrate-db.rc']' returned non-zero exit status 5.
unit-placement-0: 13:33:55 ERROR juju.worker.uniter.operation hook "identity-service-relation-changed" failed: exit status 1

Changed in charm-placement:
status: New → Triaged
importance: Undecided → High
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.