nwfilters must be optional in devops

Bug #1578280 reported by Sergey Yudin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Anton Studenov

Bug Description

Starting from 2.9.20 devops creates empty nwfilter for every interface. In case of heavily loaded node if creates significant load on libvirt. When one of environments being erased it looks for every single nwfilter for quite a long time and libvirt at this time is not resposive.

Having about 7k of nwfilters we ended with 'dos.py erase env' takes about 10 minutes and libvirt was not able to do something else.

We want to be able to pass the parameter which will skip nwfilter creation when it is not needed.

Tags: area-qa
Sergey Yudin (tsipa740)
description: updated
description: updated
Changed in fuel:
milestone: none → 10.0
assignee: nobody → Fuel DevOps (fuel-devops)
importance: Undecided → Medium
status: New → Confirmed
tags: added: area-devops
Andrey Nikitin (heos)
Changed in fuel:
assignee: Fuel DevOps (fuel-devops) → Fuel QA Team (fuel-qa)
assignee: Fuel QA Team (fuel-qa) → Fuel DevOps (fuel-devops)
Revision history for this message
Igor Shishkin (teran) wrote :

Assigning to QA team since they're maintaining python-devops.

Changed in fuel:
assignee: Fuel DevOps (fuel-devops) → Fuel QA Team (fuel-qa)
tags: added: area-qa
removed: area-devops
Changed in fuel:
status: Confirmed → New
Changed in fuel:
importance: Medium → High
Changed in fuel:
status: New → Confirmed
Changed in fuel:
assignee: Fuel QA Team (fuel-qa) → Dennis Dmitriev (ddmitriev)
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix proposed to fuel-infra/jenkins-jobs (master)

Related fix proposed to branch: master
Change author: Dennis Dmitriev <email address hidden>
Review: https://review.fuel-infra.org/20352

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-devops (release/2.9)

Fix proposed to branch: release/2.9
Review: https://review.openstack.org/313082

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix merged to fuel-infra/jenkins-jobs (master)

Reviewed: https://review.fuel-infra.org/20352
Submitter: Aleksandra Fedorova <email address hidden>
Branch: master

Commit: da51b81fb75bbe1f7c2a8d6b1d2e94d658342aed
Author: Dennis Dmitriev <email address hidden>
Date: Thu May 5 10:29:26 2016

Enable nwfilters only for 'network_outage' test group

Adding libvirt nwfilters will be disabled by default in fuel-devops.
- enable nwfilters only for a specific job.
- enable PATCHING_RUN_RALLY=true (according to the job requirements)

Change-Id: I30084645acbb6feaf57e7e84b5de0b1350cf9489
Related-Bug:#1578280

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-devops (release/2.9)

Reviewed: https://review.openstack.org/313082
Committed: https://git.openstack.org/cgit/openstack/fuel-devops/commit/?id=b5db07b959cb2a453df741931b7aeea87c9f759c
Submitter: Jenkins
Branch: release/2.9

commit b5db07b959cb2a453df741931b7aeea87c9f759c
Author: Dennis Dmitriev <email address hidden>
Date: Thu May 5 20:35:15 2016 +0300

    Disable creation of nwfilters by default

    - Add environment variable ENABLE_LIBVIRT_NWFILTERS, default=False.
      It will enable creation of nwfilters for network and interfaces.
    - Suppress error messages from libvirt that are printed via printf.

    Change-Id: I233b991a22a8b34a7a642df1baedac51ff0273c4
    Closes-Bug:#1578280

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-devops (master)

Fix proposed to branch: master
Review: https://review.openstack.org/333501

Changed in fuel:
assignee: Dennis Dmitriev (ddmitriev) → Anton Studenov (astudenov)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-devops (master)

Reviewed: https://review.openstack.org/333328
Committed: https://git.openstack.org/cgit/openstack/fuel-devops/commit/?id=cbbab44b57c28e6d3fd861fd9facd23eb47ea1be
Submitter: Jenkins
Branch: master

commit cbbab44b57c28e6d3fd861fd9facd23eb47ea1be
Author: Anton Studenov <email address hidden>
Date: Thu Jun 30 14:40:46 2016 +0300

    Redirect error messages from libvirt to debug logger

    - Add debug level to devops logger. Without this debug messages
      are skipped

    Related-Bug: #1578280
    Change-Id: I72dee9c2072da7d2658c1f159696c583184839b8

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-devops (master)

Reviewed: https://review.openstack.org/333501
Committed: https://git.openstack.org/cgit/openstack/fuel-devops/commit/?id=56d265181de911ad04c4fd970fd0b8b3f00fad7e
Submitter: Jenkins
Branch: master

commit 56d265181de911ad04c4fd970fd0b8b3f00fad7e
Author: Anton Studenov <email address hidden>
Date: Mon Jun 27 14:32:17 2016 +0300

    Disable creation of nwfilters by default

    - Add environment variable ENABLE_LIBVIRT_NWFILTERS, default=False.
      It will enable creation of nwfilters for network and interfaces.

    Change-Id: I9d7596927933b0bc3597633d86093c3d1e417314
    Closes-Bug: #1578280

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-devops (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/338123

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-devops (master)

Reviewed: https://review.openstack.org/338123
Committed: https://git.openstack.org/cgit/openstack/fuel-devops/commit/?id=ad989662d2b239d46e3e3000f6241744797d7e10
Submitter: Jenkins
Branch: master

commit ad989662d2b239d46e3e3000f6241744797d7e10
Author: Dennis Dmitriev <email address hidden>
Date: Wed Jul 6 12:01:13 2016 +0300

    Disable creation of nwfilters by default (hotfix)

    - do not create reference to nwfilter from node interface.
    - skip block/unblock for networks and interfaces
      if self.driver.enable_nwfilters is disabled.

    Change-Id: I77ca34ebd2633d2c445269232683786aeddd3bed
    Related-Bug: #1578280

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.