Comment 6 for bug 1925233

On Mon, 2022-02-07 at 20:30 +0000, Bas de Bruijne wrote:
> Is there any progress on this? It has been blocking ~40 hours of
> testruns in the last month. All occurrences can be found here:
>
> https://solutions.qa.canonical.com/bugs/bugs/bug/1925233
>

hi Blas, I was taking a look to the crashdump file juju-crashdump-
openstack-2021-04-19-19.23.41.tar.gz[0].

The service designate-mdns started successfully 16:04

$ grep -P '(Starting mdns service|oslo_db\.exception)'
designate_0/var/log/designate/designate-mdns.log | tail -n 4
2021-04-19 16:04:24.429 70854 CRITICAL designate [-] Unhandled error:
oslo_db.exception.CantStartEngineError: No sql_connection parameter is
established
2021-04-19 16:04:24.429 70854 ERROR designate
oslo_db.exception.CantStartEngineError: No sql_connection parameter is
established
2021-04-19 16:04:28.498 71732 INFO designate.service [-] Starting mdns
service (version: 10.0.0)
2021-04-19 16:05:38.214 72577 INFO designate.service [-] Starting mdns
service (version: 10.0.0)

Before that timestamp effectively designate-mdns was failing with error
in the bug description.

The charm created the designate database at 15:57

$ grep -C 2 shared-db.setup designate_0/var/log/juju/unit-designate-
0.log
2021-04-19 15:57:47 DEBUG jujuc server.go:211 running hook tool "juju-
log" for designate/0-shared-db-relation-changed-5362817322778822974
2021-04-19 15:57:47 DEBUG juju-log shared-db:108: tracer>
tracer: set flag shared-db.setup
tracer: -- dequeue handler
reactive/designate_handlers.py:93:setup_database
2021-04-19 15:57:47 DEBUG jujuc server.go:211 running hook tool "juju-
log" for designate/0-shared-db-relation-changed-5362817322778822974

The shared-db.setup flag is set when the mysql charm replied to the
request of creating a database -
https://github.com/openstack/charm-designate/blob/master/src/reactive/designate_handlers.py#L93-L105

Then the configuration files got rendered at 16:05

$ grep -C 2 base-config.rendered designate_0/var/log/juju/unit-
designate-0.log | head -n 6
2021-04-19 16:05:14 DEBUG jujuc server.go:211 running hook tool "juju-
log" for designate/0-identity-service-relation-changed-
452563743676873630
2021-04-19 16:05:14 DEBUG juju-log identity-service:105: tracer>
tracer: set flag base-config.rendered
tracer: ++ queue handler
reactive/designate_handlers.py:144:run_db_migration
tracer: ++ queue handler
reactive/designate_handlers.py:155:sync_pool_manager_cache
--

The base-config.rendered flag indicates when the configuration files
are rendered.
https://github.com/openstack/charm-designate/blob/master/src/reactive/designate_handlers.py#L141

Is there any other symptom that leads to believe that designate-mdns
wasn't working correctly?.

[0]
https://oil-jenkins.canonical.com/artifacts/9d23156f-b697-49f0-8a04-f87452fdfc18/generated/generated/openstack/juju-crashdump-openstack-2021-04-19-19.23.41.tar.gz