Deploy the Charmed Kubernetes bundle on an OpenStack cloud, with the OpenStack overlay and the Calico CNI overlay (overlays are probably not relevant to the issue). Using the Kube API Load Balancer instead of Octavia as LB in front of the Kubernetes API Server.
$ juju add-model k8s
$ juju deploy charmed-kubernetes --overlay openstack.yaml --trust --overlay calico.yaml
Kubernetes cluster gets deployed successfullly, and I can access all pods.
Try to cleanup by removing applications and destroying model
$ juju destroy-model k8s
Applications start being removed, but etcd, kubernetes-master and kubeapi-load-balancer are not. Juju status shows:
$ juju status
Model Controller Cloud/Region Version SLA Timestamp Notes
k8s ctrl serverstack/serverstack 2.9.17 unsupported 09:21:55Z attempt 7 to destroy model failed (will retry): model not empty, found 5 machines, 8 applications (model not empty)
App Version Status Scale Charm Store Channel Rev OS Message
calico unknown 0 calico charmstore stable 838 ubuntu
containerd unknown 0 containerd charmstore stable 175 ubuntu
easyrsa unknown 0 easyrsa charmstore stable 417 ubuntu
etcd 3.4.5 error 2 etcd charmstore stable 630 ubuntu hook failed: "cluster-relation-broken"
kubeapi-load-balancer 1.18.0 error 1 kubeapi-load-balancer charmstore stable 841 ubuntu hook failed: "lb-consumers-relation-broken"
kubernetes-master 1.22.3 error 2 kubernetes-master charmstore stable 1074 ubuntu hook failed: "openstack-relation-departed"
kubernetes-worker unknown 0 kubernetes-worker charmstore stable 812 ubuntu
openstack-integrator unknown 0 openstack-integrator charmstore stable 182 ubuntu
Unit Workload Agent Machine Public address Ports Message
etcd/1 error idle 2 10.5.1.31 2379/tcp hook failed: "cluster-relation-broken"
etcd/2* error idle 3 10.5.2.253 2379/tcp hook failed: "cluster-relation-broken"
kubeapi-load-balancer/0* error idle 4 10.5.0.139 443/tcp,6443/tcp hook failed: "lb-consumers-relation-broken"
kubernetes-master/0* error idle 5 10.5.1.38 6443/tcp hook failed: "openstack-relation-departed"
kubernetes-master/1 error idle 6 10.5.0.242 6443/tcp hook failed: "loadbalancer-external-relation-broken"
Machine State DNS Inst id Series AZ Message
2 stopped 10.5.1.31 84f91e53-dc4e-48d5-9e49-36f026d9d6fa focal nova ACTIVE
3 stopped 10.5.2.253 f6cd1715-542c-4bc6-91e1-f5dde1fdcbab focal nova ACTIVE
4 stopped 10.5.0.139 b047eaf1-198f-4ce9-a491-20be4b1fc0a1 focal nova ACTIVE
5 stopped 10.5.1.38 4b6bb8df-5d32-4051-942d-09ce2c9f73e6 focal nova ACTIVE
6 stopped 10.5.0.242 063641d9-20ce-41fa-9cd3-dec3005de20d focal nova ACTIVE
Also, I can see the following logs from the kubeapi-load-balancer unit:
ubuntu@juju:~$ juju debug-log --include kubeapi-load-balancer/0 --lines 100
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken subprocess.CalledProcessError: Command '('/var/lib/juju/tools/unit-kubeapi-load-balancer-0/relation-get', '-r', '4', '-', '', '--app', '--format=json')' returned non-zero exit status 1.
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken During handling of the above exception, another exception occurred:
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken Traceback (most recent call last):
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/lb-consumers-relation-broken", line 22, in <module>
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken main()
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 73, in main
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken hookenv._run_atstart()
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/charmhelpers/core/hookenv.py", line 1351, in _run_atstart
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken callback(*args, **kwargs)
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops_reactive_interface.py", line 98, in _startup
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken cls._manage_automatic_flags(relation_name, relation_api)
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops_reactive_interface.py", line 140, in _manage_automatic_flags
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken if hasattr(relation_api, 'is_changed'):
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/provides.py", line 131, in is_changed
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken return bool(self.new_requests or self.removed_requests)
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/provides.py", line 87, in new_requests
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken for request in self.all_requests
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/cached_property.py", line 36, in __get__
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken value = obj.__dict__[self.func.__name__] = self.func(obj)
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/provides.py", line 58, in all_requests
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken for relation in self.relations:
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/cached_property.py", line 36, in __get__
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken value = obj.__dict__[self.func.__name__] = self.func(obj)
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/base.py", line 32, in relations
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken return [
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/base.py", line 35, in <listcomp>
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken if self._schema(relation)
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/base.py", line 44, in _schema
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken if "version" not in data:
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 391, in __contains__
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken return key in self._data
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 384, in _data
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken data = self._lazy_data = self._load()
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 748, in _load
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken return self._backend.relation_get(self.relation.id, self._entity.name, self._is_app)
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 1351, in relation_get
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken return self._run(*args, return_output=True, use_json=True)
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 1286, in _run
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken raise ModelError(e.stderr)
unit-kubeapi-load-balancer-0: 09:15:25 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken ops.model.ModelError: b'ERROR "" is not a valid unit or application\n'
unit-kubeapi-load-balancer-0: 09:15:25 ERROR juju.worker.uniter.operation hook "lb-consumers-relation-broken" (via explicit, bespoke hook script) failed: exit status 1
unit-kubeapi-load-balancer-0: 09:15:25 INFO juju.worker.uniter awaiting error resolution for "relation-broken" hook
unit-kubeapi-load-balancer-0: 09:16:48 INFO juju.worker.uniter awaiting error resolution for "relation-broken" hook
unit-kubeapi-load-balancer-0: 09:18:07 INFO juju.worker.uniter awaiting error resolution for "relation-broken" hook
unit-kubeapi-load-balancer-0: 09:18:07 INFO unit.kubeapi-load-balancer/0.juju-log lb-consumers:4: Reactive main running for hook lb-consumers-relation-broken
unit-kubeapi-load-balancer-0: 09:18:07 ERROR unit.kubeapi-load-balancer/0.juju-log lb-consumers:4: Hook error:
Traceback (most recent call last):
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 1284, in _run
result = run(args, **kwargs)
File "/usr/lib/python3.8/subprocess.py", line 516, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('/var/lib/juju/tools/unit-kubeapi-load-balancer-0/relation-get', '-r', '4', '-', '', '--app', '--format=json')' returned non-zero exit status 1.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 73, in main
hookenv._run_atstart()
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/charmhelpers/core/hookenv.py", line 1351, in _run_atstart
callback(*args, **kwargs)
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops_reactive_interface.py", line 98, in _startup
cls._manage_automatic_flags(relation_name, relation_api)
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops_reactive_interface.py", line 140, in _manage_automatic_flags
if hasattr(relation_api, 'is_changed'):
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/provides.py", line 131, in is_changed
return bool(self.new_requests or self.removed_requests)
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/provides.py", line 87, in new_requests
for request in self.all_requests
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/cached_property.py", line 36, in __get__
value = obj.__dict__[self.func.__name__] = self.func(obj)
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/provides.py", line 58, in all_requests
for relation in self.relations:
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/cached_property.py", line 36, in __get__
value = obj.__dict__[self.func.__name__] = self.func(obj)
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/base.py", line 32, in relations
return [
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/base.py", line 35, in <listcomp>
if self._schema(relation)
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/base.py", line 44, in _schema
if "version" not in data:
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 391, in __contains__
return key in self._data
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 384, in _data
data = self._lazy_data = self._load()
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 748, in _load
return self._backend.relation_get(self.relation.id, self._entity.name, self._is_app)
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 1351, in relation_get
return self._run(*args, return_output=True, use_json=True)
File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 1286, in _run
raise ModelError(e.stderr)
ops.model.ModelError: b'ERROR "" is not a valid unit or application\n'
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken Traceback (most recent call last):
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 1284, in _run
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken result = run(args, **kwargs)
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/usr/lib/python3.8/subprocess.py", line 516, in run
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken raise CalledProcessError(retcode, process.args,
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken subprocess.CalledProcessError: Command '('/var/lib/juju/tools/unit-kubeapi-load-balancer-0/relation-get', '-r', '4', '-', '', '--app', '--format=json')' returned non-zero exit status 1.
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken During handling of the above exception, another exception occurred:
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken Traceback (most recent call last):
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/lb-consumers-relation-broken", line 22, in <module>
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken main()
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 73, in main
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken hookenv._run_atstart()
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/charmhelpers/core/hookenv.py", line 1351, in _run_atstart
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken callback(*args, **kwargs)
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops_reactive_interface.py", line 98, in _startup
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken cls._manage_automatic_flags(relation_name, relation_api)
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops_reactive_interface.py", line 140, in _manage_automatic_flags
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken if hasattr(relation_api, 'is_changed'):
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/provides.py", line 131, in is_changed
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken return bool(self.new_requests or self.removed_requests)
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/provides.py", line 87, in new_requests
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken for request in self.all_requests
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/cached_property.py", line 36, in __get__
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken value = obj.__dict__[self.func.__name__] = self.func(obj)
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/provides.py", line 58, in all_requests
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken for relation in self.relations:
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/cached_property.py", line 36, in __get__
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken value = obj.__dict__[self.func.__name__] = self.func(obj)
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/base.py", line 32, in relations
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken return [
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/base.py", line 35, in <listcomp>
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken if self._schema(relation)
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/loadbalancer_interface/base.py", line 44, in _schema
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken if "version" not in data:
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 391, in __contains__
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken return key in self._data
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 384, in _data
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken data = self._lazy_data = self._load()
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 748, in _load
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken return self._backend.relation_get(self.relation.id, self._entity.name, self._is_app)
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 1351, in relation_get
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken return self._run(*args, return_output=True, use_json=True)
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken File "/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages/ops/model.py", line 1286, in _run
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken raise ModelError(e.stderr)
unit-kubeapi-load-balancer-0: 09:18:07 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-broken ops.model.ModelError: b'ERROR "" is not a valid unit or application\n'
unit-kubeapi-load-balancer-0: 09:18:08 ERROR juju.worker.uniter.operation hook "lb-consumers-relation-broken" (via explicit, bespoke hook script) failed: exit status 1
