Comment 0 for bug 1906280

Revision history for this message
Michael Skalka (mskalka) wrote : Charm stuck waiting for ovsdb 'no key "ovn-remote" in Open_vSwitch record'

As seen during this Focal Ussuri test run: https://solutions.qa.canonical.com/testruns/testRun/5f7ad510-f57e-40ce-beb7-5f39800fa5f0
Crashdump here: https://oil-jenkins.canonical.com/artifacts/5f7ad510-f57e-40ce-beb7-5f39800fa5f0/generated/generated/openstack/juju-crashdump-openstack-2020-11-28-03.40.36.tar.gz

Octavia's ovn-chassis units are stuck waiting:

octavia/0 blocked idle 1/lxd/8 10.244.8.170 9876/tcp Awaiting leader to create required resources
  hacluster-octavia/1 active idle 10.244.8.170 Unit is ready and clustered
  logrotated/63 active idle 10.244.8.170 Unit is ready.
  octavia-ovn-chassis/1 waiting executing 10.244.8.170 'ovsdb' incomplete
  public-policy-routing/45 active idle 10.244.8.170 Unit is ready

When the db is reporting healthy:

ovn-central/0* active idle 1/lxd/9 10.246.64.225 6641/tcp,6642/tcp Unit is ready (leader: ovnnb_db, ovnsb_db)
  logrotated/19 active idle 10.246.64.225 Unit is ready.
ovn-central/1 active idle 3/lxd/9 10.246.64.250 6641/tcp,6642/tcp Unit is ready (northd: active)
  logrotated/27 active idle 10.246.64.250 Unit is ready.
ovn-central/2 active idle 5/lxd/9 10.246.65.21 6641/tcp,6642/tcp Unit is ready
  logrotated/52 active idle 10.246.65.21 Unit is ready.

Warning in the juju unit logs indicates that the charm is blocking on a missing key in the ovsdb:

2020-11-27 23:36:57 INFO juju-log ovsdb:195: Invoking reactive handler: hooks/relations/ovsdb-subordinate/provides.py:97:joined:ovsdb-subordinate
2020-11-27 23:36:57 DEBUG jujuc server.go:211 running hook tool "relation-get"
2020-11-27 23:36:57 WARNING ovsdb-relation-changed ovs-vsctl: no key "ovn-remote" in Open_vSwitch record "." column external_ids
2020-11-27 23:36:57 DEBUG jujuc server.go:211 running hook tool "juju-log"
2020-11-27 23:36:57 INFO juju-log ovsdb:195: Invoking reactive handler: hooks/relations/ovsdb/requires.py:34:joined:ovsdb