k8s can disconnect watchers after a time. Juju restarts the watcher clients it may have created, but spams the logs with errors. It also looks like it is done as a worker restart instead o restarting just the watcher, so the error is leaking somehow.
application-gitlab-runner-k8s: 15:32:10 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:32:10 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:32:10 ERROR juju.worker.dependency "unit-init-worker" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:32:10 ERROR juju.worker.dependency "operator" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:33:09 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:33:09 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:33:09 ERROR juju.worker.dependency "unit-init-worker" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:33:09 ERROR juju.worker.dependency "operator" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:34:08 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:34:08 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:34:08 ERROR juju.worker.dependency "unit-init-worker" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:34:08 ERROR juju.worker.dependency "operator" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:35:08 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:35:08 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
PR: https:/ /github. com/juju/ juju/pull/ 11161