Container driver fails to start up/report capabilities when using Ubuntu 18.04/DevStack

[Goutham Pacha Ravi]

How to reproduce:

Setup Devstack with the container driver on an Ubuntu Bionic Beaver (18.04 LTS)
Sample local.conf here: http://paste.openstack.org/show/730911/

The stack completes fine, but manila-share goes into a restart loop because the driver errors on on collecting share stats:

Sep 26 00:45:36.471087 devstack-bionic2 manila-share[20282]: INFO manila.share.manager [None req-62e9309c-906f-4553-8b50-9c4f0706be1f None None] Updating share status
Sep 26 00:45:36.472197 devstack-bionic2 manila-share[20282]: DEBUG oslo_concurrency.processutils [None req-62e9309c-906f-4553-8b50-9c4f0706be1f None None] Running cmd (subprocess): sudo manila-rootwrap /etc/manila/rootwrap.conf vgs manila_docker_volumes --rows {{(pid=21597) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:372}}
Sep 26 00:45:36.686075 devstack-bionic2 manila-share[20282]: DEBUG oslo_concurrency.processutils [None req-62e9309c-906f-4553-8b50-9c4f0706be1f None None] CMD "sudo manila-rootwrap /etc/manila/rootwrap.conf vgs manila_docker_volumes --rows" returned: 0 in 0.214s {{(pid=21597) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:409}}
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service [None req-62e9309c-906f-4553-8b50-9c4f0706be1f None None] Error starting thread.: IndexError: list index out of range
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service Traceback (most recent call last):
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/usr/local/lib/python2.7/dist-packages/oslo_service/service.py", line 796, in run_service
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service service.start()
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/opt/stack/manila/manila/service.py", line 128, in start
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service self.manager.init_host()
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/opt/stack/manila/manila/share/manager.py", line 187, in wrapped
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service return f(self, *args, **kwargs)
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/opt/stack/manila/manila/share/manager.py", line 322, in init_host
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service self.publish_service_capabilities(ctxt)
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/opt/stack/manila/manila/share/manager.py", line 187, in wrapped
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service return f(self, *args, **kwargs)
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/opt/stack/manila/manila/utils.py", line 589, in wrapper
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service return func(self, *args, **kwargs)
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/opt/stack/manila/manila/share/manager.py", line 3400, in publish_service_capabilities
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service self._report_driver_status(context)
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/opt/stack/manila/manila/utils.py", line 589, in wrapper
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service return func(self, *args, **kwargs)
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/opt/stack/manila/manila/share/manager.py", line 3364, in _report_driver_status
Sep 26 00:45:36.688781 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service share_stats = self.driver.get_share_stats(refresh=True)
Sep 26 00:45:36.689692 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/opt/stack/manila/manila/share/driver.py", line 809, in get_share_stats
Sep 26 00:45:36.689692 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service self._update_share_stats()
Sep 26 00:45:36.689692 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/opt/stack/manila/manila/share/drivers/container/driver.py", line 115, in _update_share_stats
Sep 26 00:45:36.689692 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service 'pools': self.storage.get_share_server_pools()
Sep 26 00:45:36.689692 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service File "/opt/stack/manila/manila/share/drivers/container/storage_helper.py", line 56, in get_share_server_pools
Sep 26 00:45:36.689692 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service total_size = re.findall("VSize\s[0-9.]+g", out)[0][6:-1]
Sep 26 00:45:36.689692 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service IndexError: list index out of range
Sep 26 00:45:36.689692 devstack-bionic2 manila-share[20282]: ERROR oslo_service.service

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/605291

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/605291
Committed: https://git.openstack.org/cgit/openstack/manila/commit/?id=53d15d3bbe8ae5327f3c4ff1752e969afddf8d1b
Submitter: Zuul
Branch: master

commit 53d15d3bbe8ae5327f3c4ff1752e969afddf8d1b
Author: Goutham Pacha Ravi <email address hidden>
Date: Tue Sep 25 17:57:50 2018 -0700

    [Container driver] Fix volume group data collection

    On different distros, the vgs command may have a
    different format. So, lets ask very specific questions
    about the total and free size, and use that response.

    Change-Id: I36e5e3ba7be562846687c7cc989028371efae2fc
    Needed-By: https://review.openstack.org/#/c/604929/
    Closes-Bug: #1794402

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/manila 8.0.0.0rc1 release candidate.