CI: manila-tempest-dsvm-postgres-container job is failing

Bug #1876820 reported by Goutham Pacha Ravi
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Shared File Systems Service (Manila)
High
Goutham Pacha Ravi

Bug Description

Description
===========
manila-tempest-dsvm-postgres-container job started failing ~May 4th 2020, on the master branch of manila and manila-tempest-plugin.

This is a legacy Zuulv3 job that sets up manila with the Container driver (creating filesystems on the host and exporting them via CIFS from the Samba server running inside a docker container).

Steps to reproduce
==================

To locally reproduce the issue, create a devstack with the container driver with the master branch of manila and create a share on a share network. Check the share service logs, share server provisioning fails, which leads to the share creation failing.

The server creation fails while executing:

    sudo manila-rootwrap /etc/manila/rootwrap.conf brctl show docker0

on the host running the manila-share service

Expected result
===============
share creation succeeds

Actual result
=============
share creation fails

Environment
===========
1. Manila master branch (Victoria development cycle) on Ubuntu 18.04 LTS

2. Which storage backend did you use?
   Container driver

3. Which networking type did you use?
   Neutron with OpenVSwitch

Logs & Configs
==============

Error in manila's share manager service logs: http://paste.openstack.org/show/793082/

Full log file is attached to the bug report

https://zuul.opendev.org/t/openstack/builds?job_name=manila-tempest-dsvm-postgres-container&project=openstack%2Fmanila#

Revision history for this message
Goutham Pacha Ravi (gouthamr) wrote :
Revision history for this message
Goutham Pacha Ravi (gouthamr) wrote :

We were relying on Devstack installing the package "bridge_utils". This was removed from DevStack via: https://review.opendev.org/#/c/724443/

Revision history for this message
Goutham Pacha Ravi (gouthamr) wrote :

Neutron replaced the use of brctl with ip commands in this review: https://review.opendev.org/#/c/617836/

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to manila (master)

Fix proposed to branch: master
Review: https://review.opendev.org/725407

Changed in manila:
assignee: nobody → Goutham Pacha Ravi (gouthamr)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to manila (master)

Reviewed: https://review.opendev.org/725407
Committed: https://git.openstack.org/cgit/openstack/manila/commit/?id=3b509399e3c4c95f0cc6cf1b0e2fc80fe315b9ba
Submitter: Zuul
Branch: master

commit 3b509399e3c4c95f0cc6cf1b0e2fc80fe315b9ba
Author: Goutham Pacha Ravi <email address hidden>
Date: Mon May 4 14:48:52 2020 -0700

    [ci][devstack] Install bridge-utils for Container driver

    Devstack no longer installs this package after [1]. The driver
    needs to replace the use of brctl to completely remove this
    package from our test environments.

    [1] https://review.opendev.org/724443/
    Partial-Bug: #1876820

    Change-Id: Id6094827341bf6ef8856cd4e7af11b36e9afb560
    Signed-off-by: Goutham Pacha Ravi <email address hidden>

Changed in manila:
milestone: none → victoria-1
importance: Undecided → High
Revision history for this message
Vida Haririan (vhariria) wrote :
Revision history for this message
Goutham Pacha Ravi (gouthamr) wrote :

A workaround has been merged to fix the CI job. Please use https://bugs.launchpad.net/manila/+bug/1877410 to track changes to the driver to get rid of the use of brctl.

Changed in manila:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to manila (stable/ussuri)

Fix proposed to branch: stable/ussuri
Review: https://review.opendev.org/c/openstack/manila/+/793571

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to manila (stable/ussuri)

Reviewed: https://review.opendev.org/c/openstack/manila/+/793571
Committed: https://opendev.org/openstack/manila/commit/a853b0cc91ccad5581cc19bc851cf8e16c04a031
Submitter: "Zuul (22348)"
Branch: stable/ussuri

commit a853b0cc91ccad5581cc19bc851cf8e16c04a031
Author: Goutham Pacha Ravi <email address hidden>
Date: Mon May 4 14:48:52 2020 -0700

    [ci][devstack] Install bridge-utils for Container driver

    Devstack no longer installs this package after [1]. The driver
    needs to replace the use of brctl to completely remove this
    package from our test environments.

    [1] https://review.opendev.org/724443/
    Partial-Bug: #1876820

    Depends-On: I6c7db2286d544ff8156926e07efd57628cfdc9ff
    Change-Id: Id6094827341bf6ef8856cd4e7af11b36e9afb560
    Signed-off-by: Goutham Pacha Ravi <email address hidden>
    (cherry picked from commit 3b509399e3c4c95f0cc6cf1b0e2fc80fe315b9ba)

tags: added: in-stable-ussuri
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers