grafana agent config not rendered completely

[Nishant Dash]

when deployed charmed k8s control plane, we notice that after adding the grafana-agent and k-c-p integration, grafana agent gets properly rendered only on some units. (sometimes 1/3, or sometimes 2/3).

The mterics config section is missing a lot information. The authorization section is not present. The charm seems to only do [1] once? Or rather, there no clear retry logic for that/ So if it ever gets an invalid token from cos or cos token isnt ready, it never gets to a point where it seems to retry rendering that config.

Workaround is to just remove and re-add the integration until all 3 k-c-p unit's grafana-agent.yaml are configured.

[1] https://github.com/charmed-kubernetes/charm-kubernetes-control-plane/blob/aae31b5f02d0a5761d5b14b472b01381efa63edb/src/charm.py#L58

[Mateo Florido (mateoflorido)]

KCP PR: https://github.com/charmed-kubernetes/charm-kubernetes-control-plane/pull/338
KW PR: https://github.com/charmed-kubernetes/charm-kubernetes-worker/pull/167