CI: manila-tempest-dsvm-postgres-container job is failing

Bug #1876820 reported by Goutham Pacha Ravi
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Shared File Systems Service (Manila)
Fix Released
High
Goutham Pacha Ravi

Bug Description

Description
===========
manila-tempest-dsvm-postgres-container job started failing ~May 4th 2020, on the master branch of manila and manila-tempest-plugin.

This is a legacy Zuulv3 job that sets up manila with the Container driver (creating filesystems on the host and exporting them via CIFS from the Samba server running inside a docker container).

Steps to reproduce
==================

To locally reproduce the issue, create a devstack with the container driver with the master branch of manila and create a share on a share network. Check the share service logs, share server provisioning fails, which leads to the share creation failing.

The server creation fails while executing:

    sudo manila-rootwrap /etc/manila/rootwrap.conf brctl show docker0

on the host running the manila-share service

Expected result
===============
share creation succeeds

Actual result
=============
share creation fails

Environment
===========
1. Manila master branch (Victoria development cycle) on Ubuntu 18.04 LTS

2. Which storage backend did you use?
   Container driver

3. Which networking type did you use?
   Neutron with OpenVSwitch

Logs & Configs
==============

Error in manila's share manager service logs: http://paste.openstack.org/show/793082/

Full log file is attached to the bug report

https://zuul.opendev.org/t/openstack/builds?job_name=manila-tempest-dsvm-postgres-container&project=openstack%2Fmanila#

Revision history for this message
Goutham Pacha Ravi (gouthamr) wrote :
Revision history for this message
Goutham Pacha Ravi (gouthamr) wrote :

We were relying on Devstack installing the package "bridge_utils". This was removed from DevStack via: https://review.opendev.org/#/c/724443/

Revision history for this message
Goutham Pacha Ravi (gouthamr) wrote :

Neutron replaced the use of brctl with ip commands in this review: https://review.opendev.org/#/c/617836/

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to manila (master)

Fix proposed to branch: master
Review: https://review.opendev.org/725407

Changed in manila:
assignee: nobody → Goutham Pacha Ravi (gouthamr)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to manila (master)

Reviewed: https://review.opendev.org/725407
Committed: https://git.openstack.org/cgit/openstack/manila/commit/?id=3b509399e3c4c95f0cc6cf1b0e2fc80fe315b9ba
Submitter: Zuul
Branch: master

commit 3b509399e3c4c95f0cc6cf1b0e2fc80fe315b9ba
Author: Goutham Pacha Ravi <email address hidden>
Date: Mon May 4 14:48:52 2020 -0700

    [ci][devstack] Install bridge-utils for Container driver

    Devstack no longer installs this package after [1]. The driver
    needs to replace the use of brctl to completely remove this
    package from our test environments.

    [1] https://review.opendev.org/724443/
    Partial-Bug: #1876820

    Change-Id: Id6094827341bf6ef8856cd4e7af11b36e9afb560
    Signed-off-by: Goutham Pacha Ravi <email address hidden>

Changed in manila:
milestone: none → victoria-1
importance: Undecided → High
Revision history for this message
Vida Haririan (vhariria) wrote :
Revision history for this message
Goutham Pacha Ravi (gouthamr) wrote :

A workaround has been merged to fix the CI job. Please use https://bugs.launchpad.net/manila/+bug/1877410 to track changes to the driver to get rid of the use of brctl.

Changed in manila:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to manila (stable/ussuri)

Fix proposed to branch: stable/ussuri
Review: https://review.opendev.org/c/openstack/manila/+/793571

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to manila (stable/ussuri)

Reviewed: https://review.opendev.org/c/openstack/manila/+/793571
Committed: https://opendev.org/openstack/manila/commit/a853b0cc91ccad5581cc19bc851cf8e16c04a031
Submitter: "Zuul (22348)"
Branch: stable/ussuri

commit a853b0cc91ccad5581cc19bc851cf8e16c04a031
Author: Goutham Pacha Ravi <email address hidden>
Date: Mon May 4 14:48:52 2020 -0700

    [ci][devstack] Install bridge-utils for Container driver

    Devstack no longer installs this package after [1]. The driver
    needs to replace the use of brctl to completely remove this
    package from our test environments.

    [1] https://review.opendev.org/724443/
    Partial-Bug: #1876820

    Depends-On: I6c7db2286d544ff8156926e07efd57628cfdc9ff
    Change-Id: Id6094827341bf6ef8856cd4e7af11b36e9afb560
    Signed-off-by: Goutham Pacha Ravi <email address hidden>
    (cherry picked from commit 3b509399e3c4c95f0cc6cf1b0e2fc80fe315b9ba)

tags: added: in-stable-ussuri
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.