OpenStack Shared File Systems Service (Manila)

VNX manila driver: Exception during message handling: KeyError: <type 'NoneType'>

Bug #1697372 reported by Sam Wan on 2017-06-12

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	OpenStack Shared File Systems Service (Manila)	Fix Released	Medium	EMC VNX OpenStack

Bug Description

below errors logged in manila share service log.
------
Jun 08 04:53:35.683508 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.683 27895 DEBUG manila.share.drivers.dell_emc.plugins.vnx.utils [req-d344c1ca-ec82-4472-8be4-5662c7675a92 a80bad43817b4826b781966ef92286bc ffe0517c493a479ab73907082ef6e6bc - - -] Entering FileSystem.get. inner /opt/stack/new/manila/manila/share/drivers/dell_emc/plugins/vnx/utils.py:49
Jun 08 04:53:35.709546 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server [req-d344c1ca-ec82-4472-8be4-5662c7675a92 a80bad43817b4826b781966ef92286bc ffe0517c493a479ab73907082ef6e6bc - - -] Exception during message handling: KeyError: <type 'NoneType'>
Jun 08 04:53:35.709649 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jun 08 04:53:35.709737 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 157, in _process_incoming
Jun 08 04:53:35.709829 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
Jun 08 04:53:35.709913 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
Jun 08 04:53:35.709994 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
Jun 08 04:53:35.710076 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
Jun 08 04:53:35.710158 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
Jun 08 04:53:35.710241 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/opt/stack/new/manila/manila/share/manager.py", line 169, in wrapped
Jun 08 04:53:35.710321 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server return f(self, *args, **kwargs)
Jun 08 04:53:35.710406 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/opt/stack/new/manila/manila/utils.py", line 548, in wrapper
Jun 08 04:53:35.710487 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server return func(self, *args, **kwargs)
Jun 08 04:53:35.710568 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/opt/stack/new/manila/manila/share/manager.py", line 2649, in create_snapshot
Jun 08 04:53:35.710649 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server {'status': constants.STATUS_ERROR})
Jun 08 04:53:35.710729 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Jun 08 04:53:35.710818 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server self.force_reraise()
Jun 08 04:53:35.710899 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Jun 08 04:53:35.710984 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
Jun 08 04:53:35.711064 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/opt/stack/new/manila/manila/share/manager.py", line 2642, in create_snapshot
Jun 08 04:53:35.711144 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server context, snapshot_instance, share_server=share_server) or {}
Jun 08 04:53:35.711225 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/opt/stack/new/manila/manila/share/drivers/dell_emc/driver.py", line 101, in create_snapshot
Jun 08 04:53:35.711305 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server self.plugin.create_snapshot(context, snapshot, share_server)
Jun 08 04:53:35.711386 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/opt/stack/new/manila/manila/share/drivers/dell_emc/plugins/vnx/utils.py", line 51, in inner
Jun 08 04:53:35.711465 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server ret = func(self, *args, **kwargs)
Jun 08 04:53:35.711546 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/opt/stack/new/manila/manila/share/drivers/dell_emc/plugins/vnx/connection.py", line 238, in create_snapshot
Jun 08 04:53:35.711630 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server status, filesystem = self._get_context('FileSystem').get(share_name)
Jun 08 04:53:35.711710 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/opt/stack/new/manila/manila/share/drivers/dell_emc/plugins/vnx/utils.py", line 51, in inner
Jun 08 04:53:35.711791 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server ret = func(self, *args, **kwargs)
Jun 08 04:53:35.711872 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/opt/stack/new/manila/manila/share/drivers/dell_emc/plugins/vnx/object_manager.py", line 273, in get
Jun 08 04:53:35.711954 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server self.elt_maker.Alias(name=name)
Jun 08 04:53:35.712527 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/lxml/builder.py", line 206, in __call__
Jun 08 04:53:35.712672 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server get(dict)(elem, attrib)
Jun 08 04:53:35.712794 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/lxml/builder.py", line 193, in add_dict
Jun 08 04:53:35.712918 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server attrib[k] = typemap[type(v)](None, v)
Jun 08 04:53:35.713036 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server KeyError: <type 'NoneType'>
Jun 08 04:53:35.713156 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:35.708 27895 ERROR oslo_messaging.rpc.server
Jun 08 04:53:38.997281 vnxmanila2 manila-share[26429]: 2017-06-08 04:53:38.996 27895 DEBUG manila.share.drivers.dell_emc.plugins.vnx.utils [req-c9ebf50e-ec6f-4c13-bc04-f7f99299705e a80bad43817b4826b781966ef92286bc ffe0517c493a479ab73907082ef6e6bc - - -] Entering VNXStorageConnection.delete_snapshot. inner /opt/stack/new/manila/manila/share/drivers/dell_emc/plugins/vnx/utils.py:49
------

for detailed logs, please check screen-m-shr.txt.gz at below links:
http://publiclogs.emc.com/vnx_ostack/EMC_VNX_Manila/

build# 248 - 258.

Tags:

Revision history for this message

Xing Yang (xing-yang) wrote on 2017-06-12:

Please coordinate with the refactor effort: https://review.openstack.org/#/c/463106/

Changed in manila:
assignee:	nobody → EMC VNX OpenStack (emc-vnx-openstack)
status:	New → Triaged
importance:	Undecided → Medium

Revision history for this message

Peter Wang (peter.wang) wrote on 2017-06-13:

This is caused by another bug: https://bugs.launchpad.net/manila/+bug/1697581

Changed in manila:
status:	Triaged → Confirmed

Revision history for this message

Tom Barron (tpb) wrote on 2018-06-19:

This root issue (1697581) was fixed in the openstack/manila 5.0.0.0b3 development milestone.

tags:	added: driver vnx
Changed in manila:
status:	Confirmed → Fix Released

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.