kolla-ansible

Manila cephfs nfs driver could not be used

Bug #1807298 reported by Zijian Guo on 2018-12-07

This bug affects 3 people

Affects		Status	Importance	Assigned to	Milestone
	kolla-ansible	Invalid	Undecided	Unassigned

Bug Description

Bug details:
Kolla: 7.0.1(Rocky)
Kolla-Ansible: Rocky
System: Cent-OS 7

When i try add access to a cephfsnfs share, An error occurred.

The reason may be that the container has isolated the process and cannot send a dbus message.It works on a physical machine.

2018-12-04 09:41:47.430 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf sh -c echo 'EXPORT {
    CLIENT {
        Clients = openstack;
        Access_Type = "rw";
    }

    SecType = "sys";
    Pseudo = "/volumes/_nogroup/720e6998-9789-42c1-a249-a34da819fa8d";
    Squash = "None";
    FSAL {
        User_Id = "ganesha-720e6998-9789-42c1-a249-a34da819fa8d";
        Secret_Access_Key = "AQBa2wVcfFgfNhAATsqEDKM2jGnL91x+EigE5g==";
        Name = "Ceph";
    }
    Tag = "share-720e6998-9789-42c1-a249-a34da819fa8d";
    Path = "/volumes/_nogroup/720e6998-9789-42c1-a249-a34da819fa8d";
    Export_Id = 101;
}
' > /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf.Qkx04b" returned: 0 in 0.250s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:409
2018-12-04 09:41:47.432 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf mv /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf.Qkx04b /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:372
2018-12-04 09:41:47.676 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf mv /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf.Qkx04b /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf" returned: 0 in 0.245s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:409
2018-12-04 09:41:47.678 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf string:EXPORT(Export_Id=101) execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:372
2018-12-04 09:41:47.962 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf string:EXPORT(Export_Id=101)" returned: 1 in 0.284s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:409
2018-12-04 09:41:47.964 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] u'sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf string:EXPORT(Export_Id=101)' failed. Not Retrying. execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:457
2018-12-04 09:41:47.964 24 ERROR manila.share.drivers.ganesha.manager [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] Error while executing management command on Ganesha node <no name>: dbus call exportmgr.AddExport.: ProcessExecutionError: Unexpected error while running command.

2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] Exception during message handling: GaneshaCommandFailure: Ganesha management command failed.
Command: sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf string:EXPORT(Export_Id=101)
Exit code: 1
Stdout: u''
Stderr: u'Error org.freedesktop.DBus.Error.InvalidFileContent: Error while parsing /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf because of (token scan) errors. Details:\nConfig File (<unknown file>:0): new file (/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf) open error (No such file or directory), ignored\n\n'
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 265, in dispatch
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/manager.py", line 187, in wrapped
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server return f(self, *args, **kwargs)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/utils.py", line 589, in wrapper
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server return func(self, *args, **kwargs)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/manager.py", line 3358, in update_access
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server share_server=share_server)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/access.py", line 283, in update_access_rules
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server share_server=share_server)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/access.py", line 322, in _update_access_rules
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server share_server)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/access.py", line 390, in _update_rules_through_share_driver
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server share_server=share_server
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/drivers/cephfs/driver.py", line 257, in update_access
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server share_server=share_server)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/drivers/ganesha/__init__.py", line 282, in update_access
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server self.ganesha.add_export(share['name'], confdict)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/drivers/ganesha/manager.py", line 491, in add_export
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server cmd=e.cmd)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server GaneshaCommandFailure: Ganesha management command failed.
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server Command: sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf string:EXPORT(Export_Id=101)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server Exit code: 1
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server Stdout: u''
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server Stderr: u'Error org.freedesktop.DBus.Error.InvalidFileContent: Error while parsing /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf because of (token scan) errors. Details:\nConfig File (<unknown file>:0): new file (/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf) open error (No such file or directory), ignored\n\n'
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server

See original description

Zijian Guo (zijianguo) on 2018-12-07

description:	updated
description:	updated

Revision history for this message

Pierre Riteau (priteau) wrote on 2019-03-12:

Are you using Kolla-Ansible's Ceph role or an external Ceph cluster? I am using the latter and it looks like Kolla-Ansible excepts to have an NFS-Ganesha service available on the controllers, but doesn't deploy any itself.

Revision history for this message

Jacolex (jacolex) wrote on 2022-02-16:

Hello
I decided to update this htread than create new, because the error is corelated somehow. I deployed Xena with Ceph (external of course).

The share is created successfully (conf file is created inside /etc/ganesha/export.d/ folder). But when adding access rule, manila throws error:

2022-02-16 16:14:30.068 22 ERROR oslo_messaging.rpc.server [req-9867bf13-c53c-4657-ae0a-8df89527eabb 7a8ec6fc4ec12049bb7f243a354430b4b5ecc5a3fedcdc1c555f1f1a5ce70eb5 00fef844a8ac47a698b63d6b4acdaaea - - -] Exception during message handling: manila.exception.GaneshaCommandFailure: Ganesha management command failed.
Command: sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-cb6b45cc-bd51-4af4-8297-e6f4f174742a.conf string:EXPORT(Export_Id=106)
Exit code: 1
Stdout: ''
Stderr: 'Error org.freedesktop.DBus.Error.ServiceUnknown: The name org.ganesha.nfsd was not provided by any .service files\n'

How it should be deployed properly?

Michal Nasiadka (mnasiadka) on 2023-05-09

Changed in kolla-ansible:
status:	New → Invalid

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.