updated juju credentials on o7k isn't passed to cdk-addons

[Jeff Hillman]

k8s 1.19
substrate = openstack ussuri on focal
charms = stable/latest

In a scenario where juju is bootstrapped into an environment, and a cluster is built with the above specifications using openstack-integrator, if that password for that openstack account expires and needs to be reset, juju has an `update-credentials` options to update both the client and controller. This is working as expected.

However, in the case of cdk-addons for openstack-cloud-conf, the new credentials aren't getting propagated to the occm pods. They are failing with a CrashLoopBackOff due to invalid credentials.

decoding the base64 for openstack-cloud-conf shows that the old o7k password is still present. `sudo snap get cdk-addons`.

[Jeff Hillman (jhillman)]

subscribed field-high. some customers will require rotating passwords for their security requirements.

[George Kraft (cynerva)]

The openstack-integrator charm isn't propagating the change to kubernetes-master. I've confirmed that, once openstack-integrator sends the new info, the change makes it all the way through to the openstack-cloud-controller-manager secret. If the pods are in CrashLoopBackOff then we shouldn't have any issues with pods using stale secret data, so, getting the secret updated should be sufficient.

Unfortunately, Juju doesn't notify the charm when cloud credentials have changed. We can check for changes in the update-status hook, but that could mean up to 5 minutes delay before the changes are propagated automatically. We can add a "refresh-credentials" action to allow the user to propagate the credentials more quickly, but that of course requires user action.

We'll have to do both, I think. Have the charm check in update-status so we get slow but automatic recovery. Add an action so users can recover more quickly if needed.

[George Kraft (cynerva)]

PR: https://github.com/juju-solutions/charm-openstack-integrator/pull/52

[George Kraft (cynerva)]

Cherry-pick to stable branch: https://github.com/charmed-kubernetes/charm-openstack-integrator/commit/3c2eadfbb1d28d873e1c366628bb318acd6b652b