k8s watcher restarts noisy

Bug #1859894 reported by Ian Booth
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Canonical Juju
Fix Released
High
Thomas Miller

Bug Description

k8s can disconnect watchers after a time. Juju restarts the watcher clients it may have created, but spams the logs with errors. It also looks like it is done as a worker restart instead o restarting just the watcher, so the error is leaking somehow.

application-gitlab-runner-k8s: 15:32:10 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:32:10 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:32:10 ERROR juju.worker.dependency "unit-init-worker" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:32:10 ERROR juju.worker.dependency "operator" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:33:09 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:33:09 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:33:09 ERROR juju.worker.dependency "unit-init-worker" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:33:09 ERROR juju.worker.dependency "operator" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:34:08 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:34:08 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:34:08 ERROR juju.worker.dependency "unit-init-worker" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:34:08 ERROR juju.worker.dependency "operator" manifold worker returned unexpected error: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:35:08 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting
application-gitlab-runner-k8s: 15:35:08 ERROR juju.api.watcher error trying to stop watcher: k8s event watcher closed, restarting

Tags: k8s
Changed in juju:
assignee: nobody → Yang Kelvin Liu (kelvin.liu)
status: Triaged → In Progress
Ian Booth (wallyworld)
Changed in juju:
assignee: Yang Kelvin Liu (kelvin.liu) → Thomas Miller (tlmiller)
Revision history for this message
Thomas Miller (tlmiller) wrote :
Changed in juju:
milestone: 2.7.2 → 2.7.3
Ian Booth (wallyworld)
Changed in juju:
status: In Progress → Fix Committed
Changed in juju:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.