1.21: k8s-keystone-auth pods stuck in Pending with: secret "keystone-auth-certs" not found

[George Kraft]

On Charmed Kubernetes 1.21, running Kubernetes 1.21.

test_keystone failed, with k8s-keystone-auth pods stuck in pending:

Warning FailedMount 104s (x82 over 152m) kubelet MountVolume.SetUp failed for volume "certs" : secret "keystone-auth-certs" not found

The keystone-auth-certs secret is missing from cdk-addons 1.21.0. The file is there, but incomplete, and no secret named keystone-auth-certs is ever applied.

[George Kraft (cynerva)]

The secret was removed from the upstream cloud-provider-openstack repo[1], but unfortunately, the cdk-addons build accidentally produced a file from nothing[2] and continued on.

[1]: https://github.com/kubernetes/cloud-provider-openstack/pull/1153
[2]: https://github.com/charmed-kubernetes/cdk-addons/blob/9df68b75d272428d4dc96da07a8d3e7c2fdc8b29/get-addon-templates#L282

[George Kraft (cynerva)]

We are treating this as field critical since major functionality (keystone auth) does not work with k8s 1.21.

[George Kraft (cynerva)]

PR: https://bugs.launchpad.net/cdk-addons/+bug/1926973

[George Kraft (cynerva)]

Nice. Let me try that again.

PR: https://github.com/charmed-kubernetes/cdk-addons/pull/205

[George Kraft (cynerva)]

Cherry-pick to release-1.21 branch: https://github.com/charmed-kubernetes/cdk-addons/commit/8c7b3a009c79f91c5e0c6c4ba0490c1e1a9b7214