destroying a caas model gets stuck

Bug #1964124 reported by Peter Jose De Sousa
14
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Canonical Juju
Triaged
High
Unassigned

Bug Description

Hi,

When deploying kubeflow on a manual central controller running 2.9.22 juju gets stuck indefinitely removing the model. trying --force, --release-storage, and deleting the namespace in Kubernetes all proved ineffective. The only workaround I could find was to login to the mongodb leader, and restart jujud. After this the model will resume removing.

We have tried leaving the model for a day or so, and the model will still fail to destroy.

Bundle exhibiting this issue: juju deploy kubeflow-lite --trust
Juju controller version: 2.9.22
model crashdump (before juju destroy-model): https://private-fileshare.canonical.com/~pjds/dsv/caas-delete-issue/juju-crashdump-4690ea05-7a61-4c25-b3f3-d7414c3cea01.tar.xz
controller logs: https://private-fileshare.canonical.com/~pjds/dsv/caas-delete-issue/k8s-model-issues/
destroy model was intiated on Monday 8-03-2022 around 13:00
Other notable details:

Central controller, in a different controller, manual machine (VM) controller.

Steps to reproduce:
1. Add kubeflow model: juju add-model kubeflow k8s-cloud
2. deploy kubeflow: juju deploy kubeflow-lite --trust
3. destroy model: juju destroy-model kubeflow --destroy-storage.

Accept and start the deletion.

Many thanks,

Peter

description: updated
Revision history for this message
Vitaly Antonenko (anvial) wrote :

Hi, Peter

I've reproduced this bug on juju 2.9.27

juju output: https://pastebin.canonical.com/p/vGvwDRp8XM/
juju debug-log output: https://pastebin.canonical.com/p/gzjnhfVs4V/

Thx for the report.

Changed in juju:
status: New → Triaged
importance: Undecided → High
Revision history for this message
Leon (sed-i) wrote :

This is has always been an issue for me and it still is with Juju 3.1.7:
I try to delete models using `--destroy-model --destroy-storage`, but they remain "forever" in `destroying` status:

Controller: j31

Model Cloud/Region Type Status Units Access Last connection
controller microk8s/localhost kubernetes available 1 admin just now
test-cert-handler-v1-dum2 microk8s/localhost kubernetes destroying - admin 27 minutes ago
test-cert-handler-v1-fh5x microk8s/localhost kubernetes destroying - admin 31 minutes ago
test-machine-agent-1f79 microk8s/localhost kubernetes destroying - admin 2024-03-26
test-machine-agent-kwxm microk8s/localhost kubernetes destroying - admin 2024-03-26
test-machine-agent-owwb microk8s/localhost kubernetes destroying - admin 2024-03-26
test-machine-agent-yzvh* microk8s/localhost kubernetes destroying - admin 39 minutes ago

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.