[RFE] vsphere integrator support multiple datastores

[Zachary Zehring]

We have an environment with multiple datastores in the same cluster. Due to increased PVC usage, we are running low on space in the 1 datastore (configured via "datastore" charm config). It would be good to allow the vsphere-integrator to specify multiple datastores to spread the load.

[Peter Jose De Sousa (pjds)]

I'm not sure this is required. The provider will configure a default datastore: https://vmware.github.io/vsphere-storage-for-kubernetes/documentation/existing.html#supported-parameters

This is the datastore used when creating PVCs for which no alternative datastore has been configured in the Storage Class for the volume.

To configure volumes on additional datastores it should be possible to configure the Storage Class with a different datastore: https://kubernetes.io/docs/concepts/storage/storage-classes/#vcp-provisioner.

[Peter Jose De Sousa (pjds)]

Upon second thought, I see the issue with migration - we need to be able to remount the volumes, this is supported officially on the newer (out of tree provider): https://vsphere-csi-driver.sigs.k8s.io/features/vsphere_csi_migration.html

A question that I believe still stands is can we unmount the PVCs, move them to a new datastore, and re-mount them as static PVs. We would need to test this.