Sporadic hang on installing agent
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Canonical Juju |
Fix Released
|
High
|
Yang Kelvin Liu |
Bug Description
It has been observed multiple times that deploying charms hangs sporadically. This is hard to reproduce. It happens with many different charms. When it happens Juju status typically shows something like this
Model Controller Cloud/Region Version SLA Timestamp
lma microk8s microk8s/localhost 2.9.15 unsupported 14:06:05+01:00
App Version Status Scale Charm Store Channel Rev OS Address Message
prometheus-k8s active 1 prometheus-k8s local 0 kubernetes 10.152.183.100
prometheus-tester waiting 0/1 prometheus-tester local 7 kubernetes installing agent
Unit Workload Agent Address Ports Message
prometheus-k8s/0* active idle 10.1.252.97
prometheus-tester/6 waiting allocating installing agent
In this case the prometheus-tester charm failed to deploy. Actually there was even a failure to deploy any pod for the Prometheus tester charm as can be seen below
$ kubectl get all --all-namespaces | grep prometheus
lma pod/prometheus-
lma service/
lma service/
lma statefulset.
Attached to this bug report is output of "juju debug-log -m controller --replay".
Changed in juju: | |
milestone: | none → 2.9.17 |
status: | New → Triaged |
importance: | Undecided → High |
Changed in juju: | |
milestone: | 2.9.17 → 2.9.18 |
Changed in juju: | |
milestone: | 2.9.18 → 2.9.19 |
Changed in juju: | |
milestone: | 2.9.19 → 2.9.20 |
Changed in juju: | |
milestone: | 2.9.20 → 2.9.21 |
Changed in juju: | |
milestone: | 2.9.21 → 2.9.22 |
Changed in juju: | |
status: | In Progress → Fix Committed |
Changed in juju: | |
status: | Fix Committed → Fix Released |
Based on observed log output, we seem not to be getting our worker started here: /github. com/juju/ juju/blob/ ff8bae62fd08e8f e3c5ea42162d187 3363179cca/ cmd/containerag ent/unit/ agent.go# L342
https:/
This looks similar to the failure observed here: /bugs.launchpad .net/juju/ +bug/1945999
https:/