kubernetes-master stuck at Waiting to retry addon deployment
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Kubernetes Control Plane Charm |
New
|
Undecided
|
Unassigned |
Bug Description
I have CDK1.19 installation on manual cloud/lxd (with ceph bundle as CMR) - for a couple of days now, and today I found that the current master unit was waiting with "Waiting to retry addon deployment" message on juju status screen. The only thing that i was able to find was that today there was some snap activities and cdk-addons version was refreshed to 1.19.4 rev.4723, while the rest was sitting on 1.19.3. I was able to resolved that by reinstalling cdk-addons package with 1.19.3 version.
Here are some entries from juju debug-log:
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
unit-kubernetes
And that particular change from snap.
snap change 891
Status Spawn Ready Summary
Done today at 09:06 UTC today at 09:06 UTC Ensure prerequisites for "cdk-addons" are available
Done today at 09:06 UTC today at 09:06 UTC Download snap "cdk-addons" (4723) from channel "1.19/stable"
Done today at 09:06 UTC today at 09:06 UTC Fetch and check assertions for snap "cdk-addons" (4723)
Done today at 09:06 UTC today at 09:07 UTC Mount snap "cdk-addons" (4723)
Done today at 09:06 UTC today at 09:07 UTC Run pre-refresh hook of "cdk-addons" snap if present
Done today at 09:06 UTC today at 09:07 UTC Stop snap "cdk-addons" services
Done today at 09:06 UTC today at 09:07 UTC Remove aliases for snap "cdk-addons"
Done today at 09:06 UTC today at 09:07 UTC Make current revision for snap "cdk-addons" unavailable
Done today at 09:06 UTC today at 09:07 UTC Copy snap "cdk-addons" data
Done today at 09:06 UTC today at 09:07 UTC Setup snap "cdk-addons" (4723) security profiles
Done today at 09:06 UTC today at 09:07 UTC Make snap "cdk-addons" (4723) available to the system
Done today at 09:06 UTC today at 09:07 UTC Automatically connect eligible plugs and slots of snap "cdk-addons"
Done today at 09:06 UTC today at 09:07 UTC Set automatic aliases for snap "cdk-addons"
Done today at 09:06 UTC today at 09:07 UTC Setup snap "cdk-addons" aliases
Done today at 09:06 UTC today at 09:07 UTC Run post-refresh hook of "cdk-addons" snap if present
Done today at 09:06 UTC today at 09:07 UTC Start snap "cdk-addons" (4723) services
Done today at 09:06 UTC today at 09:07 UTC Remove data for snap "cdk-addons" (4695)
Done today at 09:06 UTC today at 09:07 UTC Remove snap "cdk-addons" (4695) from the system
Done today at 09:06 UTC today at 09:07 UTC Clean up "cdk-addons" (4723) install
Done today at 09:06 UTC today at 09:07 UTC Run configure hook of "cdk-addons" snap if present
Done today at 09:06 UTC today at 09:07 UTC Run health check of "cdk-addons" snap
Done today at 09:06 UTC today at 09:07 UTC Consider re-refresh of "cdk-addons"
.......
Consider re-refresh of "cdk-addons"
The relevant error is this bit:
__main_ _.MissingSnapCo nfig: cephfs-mounter is required
That error was caused by a broken release of cdk-addons 1.19.4 that we accidentally put out to stable on 2020-11-12. We released a fix later the same day, and fixed our release process to ensure it doesn't happen again. It should be safe for you to run the latest cdk-addons 1.19 now.
Details here: https:/ /bugs.launchpad .net/cdk- addons/ +bug/1904063