Bug details:
Kolla: 7.0.1(Rocky)
Kolla-Ansible: Rocky
System: Cent-OS 7
When i try add access to a cephfsnfs share, An error occurred.
The reason may be that the container has isolated the process and cannot send a dbus message.It works on a physical machine.
2018-12-04 09:41:47.430 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf sh -c echo 'EXPORT {
CLIENT {
Clients = openstack;
Access_Type = "rw";
}
SecType = "sys";
Pseudo = "/volumes/_nogroup/720e6998-9789-42c1-a249-a34da819fa8d";
Squash = "None";
FSAL {
User_Id = "ganesha-720e6998-9789-42c1-a249-a34da819fa8d";
Secret_Access_Key = "AQBa2wVcfFgfNhAATsqEDKM2jGnL91x+EigE5g==";
Name = "Ceph";
}
Tag = "share-720e6998-9789-42c1-a249-a34da819fa8d";
Path = "/volumes/_nogroup/720e6998-9789-42c1-a249-a34da819fa8d";
Export_Id = 101;
}
' > /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf.Qkx04b" returned: 0 in 0.250s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:409
2018-12-04 09:41:47.432 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf mv /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf.Qkx04b /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:372
2018-12-04 09:41:47.676 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf mv /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf.Qkx04b /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf" returned: 0 in 0.245s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:409
2018-12-04 09:41:47.678 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf string:EXPORT(Export_Id=101) execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:372
2018-12-04 09:41:47.962 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf string:EXPORT(Export_Id=101)" returned: 1 in 0.284s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:409
2018-12-04 09:41:47.964 24 DEBUG oslo_concurrency.processutils [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] u'sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf string:EXPORT(Export_Id=101)' failed. Not Retrying. execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:457
2018-12-04 09:41:47.964 24 ERROR manila.share.drivers.ganesha.manager [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] Error while executing management command on Ganesha node <no name>: dbus call exportmgr.AddExport.: ProcessExecutionError: Unexpected error while running command.
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server [req-68f10dd4-8016-4f04-9d5f-c9cc2468d35f 4306dad4c0b34175940a09b68075f1ef 005f6ce66fc94679b5d77d734e6db030 - - -] Exception during message handling: GaneshaCommandFailure: Ganesha management command failed.
Command: sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf string:EXPORT(Export_Id=101)
Exit code: 1
Stdout: u''
Stderr: u'Error org.freedesktop.DBus.Error.InvalidFileContent: Error while parsing /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf because of (token scan) errors. Details:\nConfig File (<unknown file>:0): new file (/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf) open error (No such file or directory), ignored\n\n'
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 265, in dispatch
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/manager.py", line 187, in wrapped
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server return f(self, *args, **kwargs)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/utils.py", line 589, in wrapper
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server return func(self, *args, **kwargs)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/manager.py", line 3358, in update_access
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server share_server=share_server)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/access.py", line 283, in update_access_rules
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server share_server=share_server)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/access.py", line 322, in _update_access_rules
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server share_server)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/access.py", line 390, in _update_rules_through_share_driver
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server share_server=share_server
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/drivers/cephfs/driver.py", line 257, in update_access
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server share_server=share_server)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/drivers/ganesha/__init__.py", line 282, in update_access
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server self.ganesha.add_export(share['name'], confdict)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/manila/share/drivers/ganesha/manager.py", line 491, in add_export
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server cmd=e.cmd)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server GaneshaCommandFailure: Ganesha management command failed.
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server Command: sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf string:EXPORT(Export_Id=101)
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server Exit code: 1
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server Stdout: u''
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server Stderr: u'Error org.freedesktop.DBus.Error.InvalidFileContent: Error while parsing /etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf because of (token scan) errors. Details:\nConfig File (<unknown file>:0): new file (/etc/ganesha/export.d/share-720e6998-9789-42c1-a249-a34da819fa8d.conf) open error (No such file or directory), ignored\n\n'
2018-12-04 09:41:49.216 24 ERROR oslo_messaging.rpc.server
Are you using Kolla-Ansible's Ceph role or an external Ceph cluster? I am using the latter and it looks like Kolla-Ansible excepts to have an NFS-Ganesha service available on the controllers, but doesn't deploy any itself.