GPFS manila share service fails while performing certain operations as 'root'

Bug #1413544 reported by Nilesh Bhosale
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Shared File Systems Service (Manila)
Fix Released
Critical
Nilesh Bhosale

Bug Description

With a recent change (https://review.openstack.org/#/c/144859), while merging "volume" and "share" rootwrap filters into one file, some of the filters from volume.filters were removed considering those to be unused. But, GPFS manila driver uses those and fails while performing certain operations, in their absence.
Like the below one:
===============================================================================================
2015-01-22 15:56:56.40 ERROR manila.share.drivers.ibm.gpfs [-] (u'Error running SSH command: %(cmd)s. Error: %(excmsg)s.', {'cmd': 'df -P -B 1 /gpfs0/OpenStack/ma
nila', 'excmsg': u"Error connecting via ssh: 'RSAKey' object has no attribute 'startswith'"})
2015-01-22 15:56:57.556 ERROR root [-] Original exception being dropped: ['Traceback (most recent call last):\n', ' File "/opt/stack/manila/manila/share/drivers/ibm/gpfs.py", line 182, in _run_ssh\n with self.sshpool.item() as ssh:\n', ' File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__\n return self.gen.next()\n', ' File "/usr/local/lib/python2.7/dist-packages/eventlet/pools.py", line 109, in item\n obj = self.get()\n', ' File "/opt/stack/manila/manila/utils.py", line 136, in get\n created = self.create()\n', ' File "/opt/stack/manila/manila/utils.py", line 118, in create\n raise paramiko.SSHException(msg)\n', "SSHException: Error connecting via ssh: 'RSAKey' object has no attribute 'startswith'\n"]
2015-01-22 15:56:57.828 ERROR manila.manager [-] Error during ShareManager._report_driver_status: (u'Error running SSH command: %(cmd)s. Error: %(excmsg)s.', {'cmd': 'df -P -B 1 /gpfs0/OpenStack/manila', 'excmsg': u"Error connecting via ssh: 'RSAKey' object has no attribute 'startswith'"})
2015-01-22 15:56:57.828 TRACE manila.manager Traceback (most recent call last):
2015-01-22 15:56:57.828 TRACE manila.manager File "/opt/stack/manila/manila/manager.py", line 159, in periodic_tasks
2015-01-22 15:56:57.828 TRACE manila.manager task(self, context)
2015-01-22 15:56:57.828 TRACE manila.manager File "/opt/stack/manila/manila/share/manager.py", line 416, in _report_driver_status
2015-01-22 15:56:57.828 TRACE manila.manager share_stats = self.driver.get_share_stats(refresh=True)
2015-01-22 15:56:57.828 TRACE manila.manager File "/opt/stack/manila/manila/share/driver.py", line 273, in get_share_stats
2015-01-22 15:56:57.828 TRACE manila.manager self._update_share_stats()
2015-01-22 15:56:57.828 TRACE manila.manager File "/opt/stack/manila/manila/share/drivers/ibm/gpfs.py", line 516, in _update_share_stats
2015-01-22 15:56:57.828 TRACE manila.manager self.configuration.gpfs_mount_point_base)
2015-01-22 15:56:57.828 TRACE manila.manager File "/opt/stack/manila/manila/share/drivers/ibm/gpfs.py", line 348, in _get_available_capacity
2015-01-22 15:56:57.828 TRACE manila.manager out, __ = self._gpfs_execute('df', '-P', '-B', '1', path)
2015-01-22 15:56:57.828 TRACE manila.manager File "/opt/stack/manila/manila/share/drivers/ibm/gpfs.py", line 159, in _gpfs_remote_execute
2015-01-22 15:56:57.828 TRACE manila.manager return self._run_ssh(host, cmd, check_exit_code)
2015-01-22 15:56:57.828 TRACE manila.manager File "/opt/stack/manila/manila/share/drivers/ibm/gpfs.py", line 194, in _run_ssh
2015-01-22 15:56:57.828 TRACE manila.manager raise exception.GPFSException(msg)
2015-01-22 15:56:57.828 TRACE manila.manager GPFSException: (u'Error running SSH command: %(cmd)s. Error: %(excmsg)s.', {'cmd': 'df -P -B 1 /gpfs0/OpenStack/manila', 'excmsg': u"Error connecting via ssh: 'RSAKey' object has no attribute 'startswith'"})
2015-01-22 15:56:57.828 TRACE manila.manager
===============================================================================================

Need to add the required rootwrap filters back to shares.filters

Tags: driver gpfs
Changed in manila:
assignee: nobody → Nilesh Bhosale (nilesh-bhosale)
Changed in manila:
status: New → In Progress
Changed in manila:
milestone: none → kilo-2
importance: Undecided → Critical
tags: added: driver gpfs
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to manila (master)

Reviewed: https://review.openstack.org/149194
Committed: https://git.openstack.org/cgit/openstack/manila/commit/?id=9e77994c9f2ea0fe68b33abeabdb080e50f788f1
Submitter: Jenkins
Branch: master

commit 9e77994c9f2ea0fe68b33abeabdb080e50f788f1
Author: Nilesh Bhosale <email address hidden>
Date: Thu Jan 22 14:55:19 2015 +0530

    Adding required rootwrap filters for GPFS driver

    The rootwrap filters for commands 'df' and 'stat', which were part
    of the volume.filters before, were recently removed considering those
    to be unused. But, GPFS manila driver uses those and fails while
    performing certain operations, in their absence.
    Hence, adding those back.

    Change-Id: Ib736385f15058028b2bc0e38d325d0c256f6dd93
    Closes-Bug: #1413544

Changed in manila:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in manila:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in manila:
milestone: kilo-2 → 2015.1.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.