Manila Share Service failed to start. Config opt 'driver_handles_share_servers' has improper value - 'None'

[Dominik Bender]

After fresh deployment of cephfs, manila and manila-genesha on jammy/zed stable all charms comes up active whitout error messages.

But on manila units the manila-share.service failed to start with log entry:

---
CRITICAL manila [None req-b1d84846-ce2e-4dff-bb67-26268a000305 - - - - - -] Unhandled error: manila.exception.ManilaException: Config opt 'driver_handles_share_servers' has improper value - 'None'. Please define it as boolean.
---

I tried "juju config manila config-flags="driver_handles_share_servers=false" but without luck.

---
× manila-share.service - OpenStack Manila Share
     Loaded: loaded (/lib/systemd/system/manila-share.service; enabled; vendor preset: enabled)
     Active: failed (Result: exit-code) since Wed 2023-03-22 03:49:52 UTC; 11min ago
       Docs: man:manila-share(1)
   Main PID: 88685 (code=exited, status=1/FAILURE)
        CPU: 1.479s

Mar 22 03:49:52 juju-b9f7b8-2-lxd-25 systemd[1]: manila-share.service: Scheduled restart job, restart counter is at 5.
Mar 22 03:49:52 juju-b9f7b8-2-lxd-25 systemd[1]: Stopped OpenStack Manila Share.
Mar 22 03:49:52 juju-b9f7b8-2-lxd-25 systemd[1]: manila-share.service: Consumed 1.479s CPU time.
Mar 22 03:49:52 juju-b9f7b8-2-lxd-25 systemd[1]: manila-share.service: Start request repeated too quickly.
Mar 22 03:49:52 juju-b9f7b8-2-lxd-25 systemd[1]: manila-share.service: Failed with result 'exit-code'.
Mar 22 03:49:52 juju-b9f7b8-2-lxd-25 systemd[1]: Failed to start OpenStack Manila Share.
---

---
Controller/Model Version: 2.9.42
Series: jammy
Openstack-Origin/Source: cloud:jammy-zed

App Version Status Scale Charm Channel Rev Exposed Message
manila 15.1.0 active 3 manila zed/stable 92 no Unit is ready
manila-hacluster active 3 hacluster 2.4/stable 117 no Unit is ready and clustered
manila-mysql-router 8.0.32 active 3 mysql-router 8.0/stable 35 no Unit is ready

Unit Workload Agent Machine Public address Ports Message
manila/6* active idle 0/lxd/25 10.104.121.34 8786/tcp Unit is ready
  manila-hacluster/7* active idle 10.104.121.34 Unit is ready and clustered
  manila-mysql-router/7 active idle 10.104.121.34 Unit is ready
manila/7 active idle 1/lxd/27 10.104.121.43 8786/tcp Unit is ready
  manila-hacluster/8 active idle 10.104.121.43 Unit is ready and clustered
  manila-mysql-router/8* active idle 10.104.121.43 Unit is ready
manila/8 active idle 2/lxd/25 10.104.121.35 8786/tcp Unit is ready
  manila-hacluster/6 active idle 10.104.121.35 Unit is ready and clustered
  manila-mysql-router/6 active idle 10.104.121.35 Unit is ready
---

[Nobuto Murata (nobuto)]

I wonder if you executed the post deployment steps or not described in the charm guide:
https://docs.openstack.org/charm-guide/latest/admin/storage/shared-filesystem-services.html#configuration

[Dominik Bender (ephermeral)]

My post deployment steps:

manila type-create nfs-sc1 false
manila type-key nfs-sc1 set share_backend_name=CEPHFSNFS1 storage_protocol=NFS
manila create --share-type nfs-sc1 --name sc1-test nfs 1

+---------------------------------------+--------------------------------------+
| Property | Value |
+---------------------------------------+--------------------------------------+
| id | cae8e1be-ea67-4df9-b7b2-ce74e59983e6 |
| size | 1 |
| availability_zone | None |
| created_at | 2023-03-22T02:56:58.586046 |
| status | creating |
| name | sc1-test |
| description | None |
| project_id | ec101c020cd94de3bdc7ef514021e0e2 |
| snapshot_id | None |
| share_network_id | None |
| share_proto | NFS |
| metadata | {} |
| share_type | 37d4c44a-4b17-4dd6-ab0e-f8f3691c3c25 |
| is_public | False |
| snapshot_support | False |
| task_state | None |
| share_type_name | nfs-sc1 |
| access_rules_status | active |
| replication_type | None |
| has_replicas | False |
| user_id | a6c7ceede9af466089380c141428d439 |
| create_share_from_snapshot_support | False |
| revert_to_snapshot_support | False |
| share_group_id | None |
| source_share_group_snapshot_member_id | None |
| mount_snapshot_support | False |
| progress | None |
| is_soft_deleted | False |
| scheduled_to_be_deleted_at | None |
| share_server_id | None |
| host | |
+---------------------------------------+--------------------------------------+

after some minutes:

+---------------------------------------+--------------------------------------+
| Property | Value ...

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/charm-manila/+/896643

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/charm-manila/+/896643
Committed: https://opendev.org/openstack/charm-manila/commit/d0ad23950ffbbc87c176c008cd0180a0d579ddcd
Submitter: "Zuul (22348)"
Branch: master

commit d0ad23950ffbbc87c176c008cd0180a0d579ddcd
Author: Alex Kavanagh <email address hidden>
Date: Mon Sep 18 15:01:41 2023 +0100

    Fix local/remote assumptions in manila charm

    When the remote plugin was developed it made the assumption that the
    `enabled_share_backends` included the remote backends. This assumption
    is wrong, and it should only contain the locally defined drivers; i.e.
    ones that have a [driver] section in the manila.conf file. The cephfsnfs
    driver doesn't have a local configuration as the share-server is runs on
    the manila-ganesha unit and so shouldn't be local.

    This patch splits the config in local/remote and then uses the local and
    remote config in the correct places.

    Closes-Bug: #2012457
    Change-Id: I436452208aaeaf08d1655da4fccbd7a89549b404

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/2023.1
Review: https://review.opendev.org/c/openstack/charm-manila/+/896854

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/zed
Review: https://review.opendev.org/c/openstack/charm-manila/+/896855

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/yoga
Review: https://review.opendev.org/c/openstack/charm-manila/+/896856

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/charm-manila/+/896854
Committed: https://opendev.org/openstack/charm-manila/commit/6ec78dd3dbfbe0963a3f11f58562966ddb8248a9
Submitter: "Zuul (22348)"
Branch: stable/2023.1

commit 6ec78dd3dbfbe0963a3f11f58562966ddb8248a9
Author: Alex Kavanagh <email address hidden>
Date: Mon Sep 18 15:01:41 2023 +0100

    Fix local/remote assumptions in manila charm

    When the remote plugin was developed it made the assumption that the
    `enabled_share_backends` included the remote backends. This assumption
    is wrong, and it should only contain the locally defined drivers; i.e.
    ones that have a [driver] section in the manila.conf file. The cephfsnfs
    driver doesn't have a local configuration as the share-server is runs on
    the manila-ganesha unit and so shouldn't be local.

    This patch splits the config in local/remote and then uses the local and
    remote config in the correct places.

    Closes-Bug: #2012457
    Change-Id: I436452208aaeaf08d1655da4fccbd7a89549b404
    (cherry picked from commit d0ad23950ffbbc87c176c008cd0180a0d579ddcd)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/charm-manila/+/896855
Committed: https://opendev.org/openstack/charm-manila/commit/5cc75e1ff6936eb960ba8ad297091a5f8cfd5a69
Submitter: "Zuul (22348)"
Branch: stable/zed

commit 5cc75e1ff6936eb960ba8ad297091a5f8cfd5a69
Author: Alex Kavanagh <email address hidden>
Date: Mon Sep 18 15:01:41 2023 +0100

    Fix local/remote assumptions in manila charm

    When the remote plugin was developed it made the assumption that the
    `enabled_share_backends` included the remote backends. This assumption
    is wrong, and it should only contain the locally defined drivers; i.e.
    ones that have a [driver] section in the manila.conf file. The cephfsnfs
    driver doesn't have a local configuration as the share-server is runs on
    the manila-ganesha unit and so shouldn't be local.

    This patch splits the config in local/remote and then uses the local and
    remote config in the correct places.

    Closes-Bug: #2012457
    Change-Id: I436452208aaeaf08d1655da4fccbd7a89549b404
    (cherry picked from commit d0ad23950ffbbc87c176c008cd0180a0d579ddcd)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/charm-manila/+/896856
Committed: https://opendev.org/openstack/charm-manila/commit/a752d596a0c5fb43b193d9a337d7082e74097e00
Submitter: "Zuul (22348)"
Branch: stable/yoga

commit a752d596a0c5fb43b193d9a337d7082e74097e00
Author: Alex Kavanagh <email address hidden>
Date: Mon Sep 18 15:01:41 2023 +0100

    Fix local/remote assumptions in manila charm

    When the remote plugin was developed it made the assumption that the
    `enabled_share_backends` included the remote backends. This assumption
    is wrong, and it should only contain the locally defined drivers; i.e.
    ones that have a [driver] section in the manila.conf file. The cephfsnfs
    driver doesn't have a local configuration as the share-server is runs on
    the manila-ganesha unit and so shouldn't be local.

    This patch splits the config in local/remote and then uses the local and
    remote config in the correct places.

    Closes-Bug: #2012457
    Change-Id: I436452208aaeaf08d1655da4fccbd7a89549b404
    (cherry picked from commit d0ad23950ffbbc87c176c008cd0180a0d579ddcd)