I created a snapshot of the available state and failed to create an instance with this snapshot
Environment =========== 1. What happened instead of the expected result? Victoria
2. Which storage backend did you use? Glusetrfs
Configs:
glusterfs_share_layout = layout_volume.GlusterfsVolumeMappedLayout glusterfs_nfs_server_type = Gluster
Logs
2021-03-31 01:59:15.503 117291 INFO paramiko.transport [-] Connected (version 2.0, client OpenSSH_8.0) 2021-03-31 01:59:15.576 117291 INFO paramiko.transport [-] Authentication (password) successful! 2021-03-31 01:59:21.764 117291 INFO paramiko.transport [-] Connected (version 2.0, client OpenSSH_8.0) 2021-03-31 01:59:21.832 117291 INFO paramiko.transport [-] Authentication (password) successful! 2021-03-31 01:59:22.054 117291 ERROR manila.share.manager [req-30f36f55-f773-4a83-be74-27a0b0c49c41 63a560d401fb41adac0333ab6e5aecdd 964f97eb3c044495874b08c5de2207e8 - - -] Share instance cd9eafc1-83a1-413f-8673-86b09f1dda96 failed on creation.: manila.exception.GlusterfsException: GlusterFS management command 'volume set manila-cd9eafc1-83a1-413f-8673-86b09f1dda96 nfs.rpc-auth-reject *' failed with details as follows: 2021-03-31 01:59:22.066 117291 WARNING manila.share.manager [req-30f36f55-f773-4a83-be74-27a0b0c49c41 63a560d401fb41adac0333ab6e5aecdd 964f97eb3c044495874b08c5de2207e8 - - -] Share instance information in exception can not be written to db because it contains {} and it is not a dictionary.: manila.exception.GlusterfsException: GlusterFS management command 'volume set manila-cd9eafc1-83a1-413f-8673-86b09f1dda96 nfs.rpc-auth-reject *' failed with details as follows: 2021-03-31 01:59:22.130 117291 INFO manila.message.api [req-30f36f55-f773-4a83-be74-27a0b0c49c41 63a560d401fb41adac0333ab6e5aecdd 964f97eb3c044495874b08c5de2207e8 - - -] Creating message record for request_id = req-30f36f55-f773-4a83-be74-27a0b0c49c41 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server [req-30f36f55-f773-4a83-be74-27a0b0c49c41 63a560d401fb41adac0333ab6e5aecdd 964f97eb3c044495874b08c5de2207e8 - - -] Exception during message handling: manila.exception.GlusterfsException: GlusterFS management command 'volume set manila-cd9eafc1-83a1-413f-8673-86b09f1dda96 nfs.rpc-auth-reject *' failed with details as follows: Unexpected error while running command. Command: gluster volume set manila-cd9eafc1-83a1-413f-8673-86b09f1dda96 nfs.rpc-auth-reject '*' Exit code: 1 Stdout: '' Stderr: 'volume set: failed: Commit failed on localhost. Please check the log file for more details.\n'. 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/share/drivers/glusterfs/common.py", line 198, in _gluster_call 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server return gluster_execf(*(('gluster',) + args), **kwargs) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/share/drivers/ganesha/utils.py", line 79, in __call__ 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server ret = processutils.ssh_execute(ssh, cmd, **kwargs) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_concurrency/processutils.py", line 586, in ssh_execute 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server cmd=sanitized_cmd) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server Command: gluster volume set manila-cd9eafc1-83a1-413f-8673-86b09f1dda96 nfs.rpc-auth-reject '*' 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server Exit code: 1 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server Stdout: '' 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server Stderr: 'volume set: failed: Commit failed on localhost. Please check the log file for more details.\n' 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/share/manager.py", line 193, in wrapped 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server return f(self, *args, **kwargs) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/utils.py", line 568, in wrapper 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server return func(self, *args, **kwargs) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/share/manager.py", line 1954, in create_share_instance 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server exception=e) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server self.force_reraise() 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/six.py", line 703, in reraise 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server raise value 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/share/manager.py", line 1896, in create_share_instance 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server share_server=share_server, parent_share=parent_share_dict) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/share/drivers/glusterfs/layout.py", line 171, in create_share_from_snapshot 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server return self.layout.create_share_from_snapshot(context, share, *a, **kw) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/share/drivers/glusterfs/layout_volume.py", line 508, in create_share_from_snapshot 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server {'share': snapshot['share_instance'], 'manager': old_gmgr}) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/share/drivers/glusterfs/__init__.py", line 110, in _setup_via_manager 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server gluster_manager.set_vol_option(*setting) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/share/drivers/glusterfs/common.py", line 57, in wrapper 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server return f(self, *args, **kwargs) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/share/drivers/glusterfs/common.py", line 327, in set_vol_option 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server 'volume', args[0], self.volume, *args[1], error_policy=policy) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/manila/share/drivers/glusterfs/common.py", line 214, in _gluster_call 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server 'details': exc}) 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server manila.exception.GlusterfsException: GlusterFS management command 'volume set manila-cd9eafc1-83a1-413f-8673-86b09f1dda96 nfs.rpc-auth-reject *' failed with details as follows: 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server Unexpected error while running command. 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server Command: gluster volume set manila-cd9eafc1-83a1-413f-8673-86b09f1dda96 nfs.rpc-auth-reject '*' 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server Exit code: 1 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server Stdout: '' 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server Stderr: 'volume set: failed: Commit failed on localhost. Please check the log file for more details.\n'. 2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.rpc.server 2021-03-31 01:59:44.271 117291 INFO manila.share.manager [req-2c022031-572f-44f4-b102-162e50a4acb4 - - - - -] Updating share status
I created a snapshot of the available state and failed to create an instance with this snapshot
Environment
===========
1. What happened instead of the expected result?
Victoria
2. Which storage backend did you use?
Glusetrfs
Configs:
glusterfs_ share_layout = layout_ volume. GlusterfsVolume MappedLayout nfs_server_ type = Gluster
glusterfs_
Logs
2021-03-31 01:59:15.503 117291 INFO paramiko.transport [-] Connected (version 2.0, client OpenSSH_8.0) share.manager [req-30f36f55- f773-4a83- be74-27a0b0c49c 41 63a560d401fb41a dac0333ab6e5aec dd 964f97eb3c04449 5874b08c5de2207 e8 - - -] Share instance cd9eafc1- 83a1-413f- 8673-86b09f1dda 96 failed on creation.: manila. exception. GlusterfsExcept ion: GlusterFS management command 'volume set manila- cd9eafc1- 83a1-413f- 8673-86b09f1dda 96 nfs.rpc-auth-reject *' failed with details as follows: share.manager [req-30f36f55- f773-4a83- be74-27a0b0c49c 41 63a560d401fb41a dac0333ab6e5aec dd 964f97eb3c04449 5874b08c5de2207 e8 - - -] Share instance information in exception can not be written to db because it contains {} and it is not a dictionary.: manila. exception. GlusterfsExcept ion: GlusterFS management command 'volume set manila- cd9eafc1- 83a1-413f- 8673-86b09f1dda 96 nfs.rpc-auth-reject *' failed with details as follows: f773-4a83- be74-27a0b0c49c 41 63a560d401fb41a dac0333ab6e5aec dd 964f97eb3c04449 5874b08c5de2207 e8 - - -] Creating message record for request_id = req-30f36f55- f773-4a83- be74-27a0b0c49c 41 rpc.server [req-30f36f55- f773-4a83- be74-27a0b0c49c 41 63a560d401fb41a dac0333ab6e5aec dd 964f97eb3c04449 5874b08c5de2207 e8 - - -] Exception during message handling: manila. exception. GlusterfsExcept ion: GlusterFS management command 'volume set manila- cd9eafc1- 83a1-413f- 8673-86b09f1dda 96 nfs.rpc-auth-reject *' failed with details as follows: cd9eafc1- 83a1-413f- 8673-86b09f1dda 96 nfs.rpc-auth-reject '*' rpc.server Traceback (most recent call last): rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ share/drivers/ glusterfs/ common. py", line 198, in _gluster_call rpc.server return gluster_ execf(* (('gluster' ,) + args), **kwargs) rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ share/drivers/ ganesha/ utils.py" , line 79, in __call__ rpc.server ret = processutils. ssh_execute( ssh, cmd, **kwargs) rpc.server File "/usr/lib/ python3. 6/site- packages/ oslo_concurrenc y/processutils. py", line 586, in ssh_execute rpc.server cmd=sanitized_cmd) rpc.server oslo_concurrenc y.processutils. ProcessExecutio nError: Unexpected error while running command. rpc.server Command: gluster volume set manila- cd9eafc1- 83a1-413f- 8673-86b09f1dda 96 nfs.rpc-auth-reject '*' rpc.server Exit code: 1 rpc.server Stdout: '' rpc.server Stderr: 'volume set: failed: Commit failed on localhost. Please check the log file for more details.\n' rpc.server rpc.server During handling of the above exception, another exception occurred: rpc.server rpc.server Traceback (most recent call last): rpc.server File "/usr/lib/ python3. 6/site- packages/ oslo_messaging/ rpc/server. py", line 165, in _process_incoming rpc.server res = self.dispatcher .dispatch( message) rpc.server File "/usr/lib/ python3. 6/site- packages/ oslo_messaging/ rpc/dispatcher. py", line 309, in dispatch rpc.server return self._do_ dispatch( endpoint, method, ctxt, args) rpc.server File "/usr/lib/ python3. 6/site- packages/ oslo_messaging/ rpc/dispatcher. py", line 229, in _do_dispatch rpc.server result = func(ctxt, **new_args) rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ share/manager. py", line 193, in wrapped rpc.server return f(self, *args, **kwargs) rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ utils.py" , line 568, in wrapper rpc.server return func(self, *args, **kwargs) rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ share/manager. py", line 1954, in create_ share_instance rpc.server exception=e) rpc.server File "/usr/lib/ python3. 6/site- packages/ oslo_utils/ excutils. py", line 220, in __exit__ rpc.server self.force_ reraise( ) rpc.server File "/usr/lib/ python3. 6/site- packages/ oslo_utils/ excutils. py", line 196, in force_reraise rpc.server six.reraise( self.type_ , self.value, self.tb) rpc.server File "/usr/lib/ python3. 6/site- packages/ six.py" , line 703, in reraise rpc.server raise value rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ share/manager. py", line 1896, in create_ share_instance rpc.server share_server= share_server, parent_ share=parent_ share_dict) rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ share/drivers/ glusterfs/ layout. py", line 171, in create_ share_from_ snapshot rpc.server return self.layout. create_ share_from_ snapshot( context, share, *a, **kw) rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ share/drivers/ glusterfs/ layout_ volume. py", line 508, in create_ share_from_ snapshot rpc.server {'share': snapshot[ 'share_ instance' ], 'manager': old_gmgr}) rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ share/drivers/ glusterfs/ __init_ _.py", line 110, in _setup_via_manager rpc.server gluster_ manager. set_vol_ option( *setting) rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ share/drivers/ glusterfs/ common. py", line 57, in wrapper rpc.server return f(self, *args, **kwargs) rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ share/drivers/ glusterfs/ common. py", line 327, in set_vol_option rpc.server 'volume', args[0], self.volume, *args[1], error_policy= policy) rpc.server File "/usr/lib/ python3. 6/site- packages/ manila/ share/drivers/ glusterfs/ common. py", line 214, in _gluster_call rpc.server 'details': exc}) rpc.server manila. exception. GlusterfsExcept ion: GlusterFS management command 'volume set manila- cd9eafc1- 83a1-413f- 8673-86b09f1dda 96 nfs.rpc-auth-reject *' failed with details as follows: rpc.server Unexpected error while running command. rpc.server Command: gluster volume set manila- cd9eafc1- 83a1-413f- 8673-86b09f1dda 96 nfs.rpc-auth-reject '*' rpc.server Exit code: 1 rpc.server Stdout: '' rpc.server Stderr: 'volume set: failed: Commit failed on localhost. Please check the log file for more details.\n'. rpc.server share.manager [req-2c022031- 572f-44f4- b102-162e50a4ac b4 - - - - -] Updating share status
2021-03-31 01:59:15.576 117291 INFO paramiko.transport [-] Authentication (password) successful!
2021-03-31 01:59:21.764 117291 INFO paramiko.transport [-] Connected (version 2.0, client OpenSSH_8.0)
2021-03-31 01:59:21.832 117291 INFO paramiko.transport [-] Authentication (password) successful!
2021-03-31 01:59:22.054 117291 ERROR manila.
2021-03-31 01:59:22.066 117291 WARNING manila.
2021-03-31 01:59:22.130 117291 INFO manila.message.api [req-30f36f55-
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
Unexpected error while running command.
Command: gluster volume set manila-
Exit code: 1
Stdout: ''
Stderr: 'volume set: failed: Commit failed on localhost. Please check the log file for more details.\n'.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:22.220 117291 ERROR oslo_messaging.
2021-03-31 01:59:44.271 117291 INFO manila.