Glusterfs / Ganesha driver: Manila created shares not exported to secondary ganesha nodes in HA mode

[Surya Ghatty]

 I have an Active Active Ganesha setup with glusterfs backend. I am using manila to create and allow access to shares. The manila ganesha driver seems to use ssh to create a share directory on the remote ganesha host and then issue a dbus signal to addexport.

The following command is executed on the first Ganesha node to add the export:

2015-11-23 21:06:35.474 DEBUG oslo_concurrency.processutils [^[[01;36mreq-6765c104-b8a9-4f93-9dac-bbe8ae490d2b ^[[00;36m0c9b8ff1232e464d966bdc9e569281cf 0ea74c5da20e44df8bf8b68b22b7e167] ^[[01;35mRunning cmd (SSH): dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-6fb0b276-9385-4d31-a21e-c9267df12024--fdb1878a-e73c-404e-8253-689a42c493ea.conf 'string:EXPORT(Export_Id=145)'^[[00m ^[[00;33mfrom (pid=21806) ssh_execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:377^[[00m

Manila ganesha driver reports this as successful and returns a 0 error.

2015-11-23 21:06:35.621 DEBUG oslo_concurrency.processutils [^[[01;36mreq-6765c104-b8a9-4f93-9dac-bbe8ae490d2b ^[[00;36m0c9b8ff1232e464d966bdc9e569281cf 0ea74c5da20e44df8bf8b68b22b7e167] ^[[01;35mResult was 0^[[00m ^[[00;33mfrom (pid=21806) ssh_execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:408^[[00m

However, this export is not being replicated to the second ganesha node.

I also see the following errors on ganesha each time I create a share.: It complains about syntax error in the share-<id>.conf file.

epoch 56547c5f : conv-gls001 : ganesha.nfsd-29621[dbus_heartbeat] ganesha_yyerror :CONFIG :CRIT :Config file (/etc/ganesha/export.d/share-6fb0b276-9385-4d31-a21e-c9267df12024--fdb1878a-e73c-404e-8253-689a42c493ea.conf :15) error: syntax error'

When I issue a showmount -e on the primary ganesha node, I can see the newly created share was exported.
[root@conv-gls001 export.d]# showmount -e
Export list for conv-gls001:
/gvol0 (everyone)
/gvol1 (everyone)
/share-6fb0b276-9385-4d31-a21e-c9267df12024 169.55.151.216

However, it does not appear on the secondary node:
[root@conv-gls002 ~]# showmount -e
Export list for conv-gls002:
/gvol1 (everyone)
/gvol0 (everyone)

[Jason Grosso (jgrosso)]

closing no current gluster work is being maintained