storageclasses with cdk-addons=true label are not pruned

[Adam Dyess]

storage classes created by cdk-addons are not pruned when the storage class is no longer enabled or should be ignored.

This storage class for instance is still in the cluster in 1.29 although it should have been relabeled by cdk-addonds with

    cdk-addons-retired: "true"

--------------------------------------------------------------

allowVolumeExpansion: true
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  labels:
    cdk-addons: "true"
  name: ceph-xfs
mountOptions:
- discard
parameters:
  clusterID: f6919f00-439e-11ef-b69b-f5443f2fdd5f
  csi.storage.k8s.io/controller-expand-secret-name: csi-rbd-secret
  csi.storage.k8s.io/controller-expand-secret-namespace: default
  csi.storage.k8s.io/fstype: xfs
  csi.storage.k8s.io/node-stage-secret-name: csi-rbd-secret
  csi.storage.k8s.io/node-stage-secret-namespace: default
  csi.storage.k8s.io/provisioner-secret-name: csi-rbd-secret
  csi.storage.k8s.io/provisioner-secret-namespace: default
  imageFeatures: layering
  pool: xfs-pool
provisioner: rbd.csi.ceph.com
reclaimPolicy: Delete
volumeBindingMode: Immediate

[Adam Dyess (addyess)]

Will need to be fixed in cdk-addons 1.30 and 1.29

[Adam Dyess (addyess)]

https://github.com/charmed-kubernetes/cdk-addons/pull/234