Solutions QA found an 500 internal error in our test run, https://solutions.qa.canonical.com/testruns/f10de597-90e1-4d00-b613-ec84ad8a8277
Additional log could be found from https://oil-jenkins.canonical.com/artifacts/f10de597-90e1-4d00-b613-ec84ad8a8277/generated/generated/metallb_microk8s/juju-crashdump-juju-system-microk8s-2023-10-27-03.21.04.tar.gz
logs message
unit-metallb-0: 2023-10-27 03:20:15 INFO unit.metallb/0.juju-log HTTP Request: PATCH https://10.152.183.1/apis/metallb.io/v1beta1/namespaces/metallb-system/ipaddresspools/juju-system-microk8s-metallb?force=true&fieldManager=metallb "HTTP/1.1 201 Created"
unit-metallb-0: 2023-10-27 03:20:25 INFO unit.metallb/0.juju-log HTTP Request: PATCH https://10.152.183.1/apis/metallb.io/v1beta1/namespaces/metallb-system/l2advertisements/juju-system-microk8s-metallb?force=true&fieldManager=metallb "HTTP/1.1 500 Internal Server Error"
unit-metallb-0: 2023-10-27 03:20:25 ERROR unit.metallb/0.juju-log Uncaught exception while in charm code:
Traceback (most recent call last):
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/lightkube/core/generic_client.py", line 188, in raise_for_status
resp.raise_for_status()
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/httpx/_models.py", line 749, in raise_for_status
raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Server error '500 Internal Server Error' for url 'https://10.152.183.1/apis/metallb.io/v1beta1/namespaces/metallb-system/l2advertisements/juju-system-microk8s-metallb?force=true&fieldManager=metallb'
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/500
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/var/lib/juju/agents/unit-metallb-0/charm/./src/charm.py", line 202, in <module>
main(MetallbCharm)
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/ops/main.py", line 441, in main
_emit_charm_event(charm, dispatcher.event_name)
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/ops/main.py", line 149, in _emit_charm_event
event_to_emit.emit(*args, **kwargs)
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/ops/framework.py", line 344, in emit
framework._emit(event)
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/ops/framework.py", line 841, in _emit
self._reemit(event_path)
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/ops/framework.py", line 930, in _reemit
custom_handler(event)
File "/var/lib/juju/agents/unit-metallb-0/charm/./src/charm.py", line 174, in _on_config_changed
self._update_l2_adv()
File "/var/lib/juju/agents/unit-metallb-0/charm/./src/charm.py", line 198, in _update_l2_adv
self.client.apply(l2_adv, force=True)
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/lightkube/core/client.py", line 457, in apply
return self.patch(type(obj), name, obj, namespace=namespace,
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/lightkube/core/client.py", line 325, in patch
return self._client.request("patch", res=res, name=name, namespace=namespace, obj=obj,
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/lightkube/core/generic_client.py", line 245, in request
return self.handle_response(method, resp, br)
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/lightkube/core/generic_client.py", line 196, in handle_response
self.raise_for_status(resp)
File "/var/lib/juju/agents/unit-metallb-0/charm/venv/lightkube/core/generic_client.py", line 190, in raise_for_status
raise transform_exception(e)
lightkube.core.exceptions.ApiError: Internal error occurred: failed calling webhook "l2advertisementvalidationwebhook.metallb.io": failed to call webhook: Post "https://webhook-service.metallb-system.svc:443/validate-metallb-io-v1beta1-l2advertisement?timeout=10s": context deadline exceeded
unit-metallb-0: 2023-10-27 03:20:26 ERROR juju.worker.uniter.operation hook "config-changed" (via hook dispatching script: dispatch) failed: exit status 1
unit-metallb-0: 2023-10-27 03:20:26 INFO juju.worker.uniter awaiting error resolution for "config-changed" hook
