openvswitch requires service restart after charm upgrade

[David Ames]

While doing

After upgrade-charm the nova-compute, neutron-gateway and neutron-openvswitch charms error out when calling ovs-vsctl

2016-01-20 19:24:52 INFO juju-log Creating bridge br-int
2016-01-20 19:24:52 INFO update-status 2016-01-20T19:24:52Z|00002|reconnect|WARN|unix:/var/run/openvswitch/db.sock: connection attempt failed (Protocol error)
2016-01-20 19:24:52 INFO update-status ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (Protocol error)
2016-01-20 19:24:52 INFO update-status Traceback (most recent call last):
2016-01-20 19:24:52 INFO update-status File "/var/lib/juju/agents/unit-nova-compute-0/charm/hooks/update-status", line 418, in <module>
2016-01-20 19:24:52 INFO update-status main()
2016-01-20 19:24:52 INFO update-status File "/var/lib/juju/agents/unit-nova-compute-0/charm/hooks/update-status", line 414, in main
2016-01-20 19:24:52 INFO update-status charm_func=check_optional_relations)
2016-01-20 19:24:52 INFO update-status File "/var/lib/juju/agents/unit-nova-compute-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 793, in set_os_workload_status
2016-01-20 19:24:52 INFO update-status incomplete_rel_data = incomplete_relation_data(configs, required_interfaces)
2016-01-20 19:24:52 INFO update-status File "/var/lib/juju/agents/unit-nova-compute-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 925, in incomplete_relation_data
2016-01-20 19:24:52 INFO update-status complete_ctxts = configs.complete_contexts()
2016-01-20 19:24:52 INFO update-status File "/var/lib/juju/agents/unit-nova-compute-0/charm/hooks/charmhelpers/contrib/openstack/templating.py", line 295, in complete_contexts
2016-01-20 19:24:52 INFO update-status for i in six.itervalues(self.templates)]
2016-01-20 19:24:52 INFO update-status File "/var/lib/juju/agents/unit-nova-compute-0/charm/hooks/charmhelpers/contrib/openstack/templating.py", line 120, in complete_contexts
2016-01-20 19:24:52 INFO update-status self.context()
2016-01-20 19:24:52 INFO update-status File "/var/lib/juju/agents/unit-nova-compute-0/charm/hooks/charmhelpers/contrib/openstack/templating.py", line 105, in context
2016-01-20 19:24:52 INFO update-status _ctxt = context()
2016-01-20 19:24:52 INFO update-status File "/var/lib/juju/agents/unit-nova-compute-0/charm/hooks/nova_compute_context.py", line 493, in __call__
2016-01-20 19:24:52 INFO update-status ctxt = super(NeutronComputeContext, self).__call__()
2016-01-20 19:24:52 INFO update-status File "/var/lib/juju/agents/unit-nova-compute-0/charm/hooks/charmhelpers/contrib/openstack/context.py", line 978, in __call__
2016-01-20 19:24:52 INFO update-status ctxt.update(self.ovs_ctxt())
2016-01-20 19:24:52 INFO update-status File "/var/lib/juju/agents/unit-nova-compute-0/charm/hooks/nova_compute_context.py", line 485, in ovs_ctxt
2016-01-20 19:24:52 INFO update-status self._ensure_bridge()
2016-01-20 19:24:52 INFO update-status File "/var/lib/juju/agents/unit-nova-compute-0/charm/hooks/nova_compute_context.py", line 473, in _ensure_bridge
2016-01-20 19:24:52 INFO update-status add_bridge(OVS_BRIDGE)
2016-01-20 19:24:52 INFO update-status subprocess.CalledProcessError: Command '['ovs-vsctl', '--', '--may-exist', 'add-br', 'br-int']' returned non-zero exit status 1

OVS has lost its mysql configuration.

# ovs-vsctl show
2016-01-20T19:25:46Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock: connection attempt failed (Protocol error)
ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (Protocol error)

It is unclear yet which charm is at fault.

[David Ames (thedac)]

sudo restart openvswitch-switch and sudo restart neutron-plugin-openvswitch-agent with juju resolved --retries fixes the issue.

[David Ames (thedac)]

This turned out to be DNS reverse resolution issues.

https://bugs.launchpad.net/charms/+source/quantum-gateway/+bug/1405588

The mojo tests pass when reverse DNS is working.