DNS HA broken with percona-cluster

[James Page]

Proxying via email:

Using the maas provider today, juju rc1, and calls to charms with the following syntax, cs:xenial/<charm name>, it appears as though lxd networking behaves ok from juju now as described this morning (which is great), however dns-ha is an issue still.

Charm config:

percona-cluster2:
  root-password: **********
  sst-password: **********
  os-access-hostname: xxx.xxx.net
  dns-ha: true
hacluster:
  cluster_count=2

Deploying with the following command(s), from both lxd and bare metal, with appropriate differences to --to format:

juju deploy --config percona-cluster cs:xenial/percona-cluster percona-cluster2 --to lxd:1
juju add-unit percona-cluster2 --to lxd:2
juju deploy --config percona-cluster cs:xenial/hacluster hacluster
juju status
juju add-relation hacluster percona-cluster2

When I configured the percona-cluster charm to set os-access-network=”xxx.xxx.net”, dns-ha=”true” and adding the relation with the hacluster charm, you can see the following error in the unit log:

2016-09-22 03:59:11 INFO worker.uniter.jujuc server.go:174 running hook tool "juju-log" ["-l" "DEBUG" "DNS HA: At least one hostname is set os-access-hostname xxx.box.net"]

2016-09-22 03:59:11 DEBUG juju-log ha:9: DNS HA: At least one hostname is set os-access-hostname: xxx.box.net

2016-09-22 03:59:11 INFO worker.uniter.jujuc server.go:174 running hook tool "config-get" ["sst-password" "--format=json"]

2016-09-22 03:59:11 INFO worker.uniter.jujuc server.go:174 running hook tool "juju-log" ["-l" "DEBUG" "DNS HA: Hostname setting os-admin-hostname is None. Ignoring."]

2016-09-22 03:59:11 DEBUG juju-log ha:9: DNS HA: Hostname setting os-admin-hostname is None. Ignoring.

2016-09-22 03:59:11 INFO worker.uniter.jujuc server.go:174 running hook tool "juju-log" ["-l" "DEBUG" "DNS HA: Hostname setting os-internal-hostname is None. Ignoring."]

2016-09-22 03:59:11 DEBUG juju-log ha:9: DNS HA: Hostname setting os-internal-hostname is None. Ignoring.

2016-09-22 03:59:11 INFO worker.uniter.jujuc server.go:174 running hook tool "juju-log" ["-l" "DEBUG" "DNS HA: Hostname setting os-public-hostname is None. Ignoring."]

2016-09-22 03:59:11 DEBUG juju-log ha:9: DNS HA: Hostname setting os-public-hostname is None. Ignoring.

2016-09-22 03:59:11 INFO ha-relation-joined Traceback (most recent call last):

2016-09-22 03:59:11 INFO ha-relation-joined File "/var/lib/juju/agents/unit-percona-cluster2-0/charm/hooks/ha-relation-joined", line 722, in <module>

2016-09-22 03:59:11 INFO ha-relation-joined main()

2016-09-22 03:59:11 INFO ha-relation-joined File "/var/lib/juju/agents/unit-percona-cluster2-0/charm/hooks/ha-relation-joined", line 715, in main

2016-09-22 03:59:11 INFO ha-relation-joined hooks.execute(sys.argv)

2016-09-22 03:59:11 INFO ha-relation-joined File "/var/lib/juju/agents/unit-percona-cluster2-0/charm/hooks/charmhelpers/core/hookenv.py", line 715, in execute

2016-09-22 03:59:11 INFO ha-relation-joined self._hooks[hook_name]()

2016-09-22 03:59:11 INFO ha-relation-joined File "/var/lib/juju/agents/unit-percona-cluster2-0/charm/hooks/ha-relation-joined", line 622, in ha_relation_joined

2016-09-22 03:59:11 INFO ha-relation-joined resource_params=resource_params)

2016-09-22 03:59:11 INFO ha-relation-joined File "/var/lib/juju/agents/unit-percona-cluster2-0/charm/hooks/charmhelpers/contrib/openstack/ha/utils.py", line 105, in update_dns_ha_resource_para

ms

2016-09-22 03:59:11 INFO ha-relation-joined override=False)))

2016-09-22 03:59:11 INFO ha-relation-joined File "/var/lib/juju/agents/unit-percona-cluster2-0/charm/hooks/charmhelpers/contrib/openstack/ip.py", line 131, in resolve_address

2016-09-22 03:59:11 INFO ha-relation-joined net_type = ADDRESS_MAP[endpoint_type]['config']

2016-09-22 03:59:11 INFO ha-relation-joined KeyError: 'access'

2016-09-22 03:59:11 ERROR juju.worker.uniter.operation runhook.go:107 hook "ha-relation-joined" failed: exit status 1

2016-09-22 03:59:11 INFO juju.worker.uniter resolver.go:100 awaiting error resolution for "relation-joined" hook

Looking in the source file, ip.py, I see that ACCESS is not defined within ADDRESS_MAP at the start of the file, so I added it, updated some settings for os-access-network, but then it failed again at a network-get call, as I assume the rest of the properties, which I copied from PUBLIC, are incorrect.

[James Page (james-page)]

OK - so percona is a bit of an odditity in that it does not have an explicit extra-binding for the access networking; its use the OS helper that assumes this exists; we'll have to refactor a little to fix this.

[David Ames (thedac)]

https://review.openstack.org/#/c/375065/1
https://code.launchpad.net/~thedac/charm-helpers/bug1626434/+merge/306541

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/375065
Committed: https://git.openstack.org/cgit/openstack/charm-percona-cluster/commit/?id=7c68006bc5bf9645c044d0637b566c22e0271b89
Submitter: Jenkins
Branch: master

commit 7c68006bc5bf9645c044d0637b566c22e0271b89
Author: David Ames <email address hidden>
Date: Thu Sep 22 12:04:51 2016 -0700

    Enable access network for DNS HA

    DNS HA was not working due to missing configuration for the access
    network. This change adds those missing configurations including the
    extra bindings for the access network.

    Change-Id: I04813488c844318bea7f9c0a33657ea7fc6f4b98
    Closes-Bug: 1626434