[RFE] Support switching from DBUS API to Ceph Mgr API when using CephFS NFS

[Goutham Pacha Ravi]

Manila's CephFS/NFS driver can work with a standalone NFS-Ganesha service or a cephadm deployed NFS-Ganesha service. The advantage of a standalone NFS service is the flexibility it provides to isolate the NFS service from the ceph cluster; however, high availablity isn't configurable natively - one would have to use an external service such as pacemaker to configure Active/Passive HA. The Manila driver uses DBUS to communicate with such a service, and that doesn't lend itself to active/active configurations of the NFS-Ganesha service.

Cephadm deployed NFS-Ganesha is capable of active/active HA. Cephadm can help setup the service as a ceph daemon on the ceph cluster nodes.

Manila must provide a way to move exports between these two configurations.

[Goutham Pacha Ravi (gouthamr)]

Partial fix: https://review.opendev.org/c/openstack/manila/+/879013

[Goutham Pacha Ravi (gouthamr)]

Another partial fix: https://review.opendev.org/c/openstack/manila/+/878551

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/manila/+/879013
Committed: https://opendev.org/openstack/manila/commit/ee8af90109cc41d1c22f2e0cd1718f7cfd2fdfe7
Submitter: "Zuul (22348)"
Branch: master

commit ee8af90109cc41d1c22f2e0cd1718f7cfd2fdfe7
Author: Goutham Pacha Ravi <email address hidden>
Date: Wed Mar 29 22:19:19 2023 -0700

    Implement Ensure Shares in the CephFS driver

    This allows switching between NFS protocol helpers
    that the driver currently supports and avoids
    unnecessary ensuring of driver resources on restarts
    unless a small set of config opts are toggled.

    Use of either NFS protocol helper in the driver
    will trigger access rules to be reapplied when
    ensuring shares.

    Implements: bp use-cephadm-nfs-ganesha
    Partial-Bug: #2035137
    Change-Id: I93c4e8616a1cfb5ab713b420aff69464969f28d5
    Signed-off-by: Goutham Pacha Ravi <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/manila/+/878551
Committed: https://opendev.org/openstack/manila/commit/3eb34c3ce7feaf51012c3338a03882b0d103138a
Submitter: "Zuul (22348)"
Branch: master

commit 3eb34c3ce7feaf51012c3338a03882b0d103138a
Author: silvacarloss <email address hidden>
Date: Fri Mar 24 15:02:21 2023 -0300

    Add preferred info to ceph nfs export locations

    Change the Ceph NFS helpers to update the export locations
    preferred field based on the configuration. The preferred export
    location will always relate to the Ceph ADM deployed Ganesha
    cluster.

    Partial-Bug: #2035137
    Change-Id: I9b05a6444b8ac98f79f297fec9c74a45ef11429d

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/2023.1
Review: https://review.opendev.org/c/openstack/manila/+/895034

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/2023.1
Review: https://review.opendev.org/c/openstack/manila/+/895368

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/manila/+/895368
Committed: https://opendev.org/openstack/manila/commit/f823331c5184ee9641d78fc8523cd4c963a4af57
Submitter: "Zuul (22348)"
Branch: stable/2023.1

commit f823331c5184ee9641d78fc8523cd4c963a4af57
Author: silvacarloss <email address hidden>
Date: Fri Mar 24 15:02:21 2023 -0300

    Add preferred info to ceph nfs export locations

    Change the Ceph NFS helpers to update the export locations
    preferred field based on the configuration. The preferred export
    location will always relate to the Ceph ADM deployed Ganesha
    cluster.

    Partial-Bug: #2035137
    Change-Id: I9b05a6444b8ac98f79f297fec9c74a45ef11429d
    (cherry picked from commit 3eb34c3ce7feaf51012c3338a03882b0d103138a)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/manila/+/895034
Committed: https://opendev.org/openstack/manila/commit/4c6ec625660f2e88a760a86a2ce521e49c353b7d
Submitter: "Zuul (22348)"
Branch: stable/2023.1

commit 4c6ec625660f2e88a760a86a2ce521e49c353b7d
Author: Goutham Pacha Ravi <email address hidden>
Date: Wed Mar 29 22:19:19 2023 -0700

    Implement Ensure Shares in the CephFS driver

    This allows switching between NFS protocol helpers
    that the driver currently supports and avoids
    unnecessary ensuring of driver resources on restarts
    unless a small set of config opts are toggled.

    Use of either NFS protocol helper in the driver
    will trigger access rules to be reapplied when
    ensuring shares.

    Implements: bp use-cephadm-nfs-ganesha
    Partial-Bug: #2035137
    Change-Id: I93c4e8616a1cfb5ab713b420aff69464969f28d5
    Signed-off-by: Goutham Pacha Ravi <email address hidden>
    (cherry picked from commit ee8af90109cc41d1c22f2e0cd1718f7cfd2fdfe7)