Compute restart causes period of network ‘blackout’

Bug #1034401 reported by David McNally
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
Undecided
David McNally

Bug Description

When a compute service is restarted each instance running on the host has its iptables rules built and applied sequentially during the host init stage. The impact of this, especially on a host running many instances, can be observed as a period where some instances are not accessible as the existing iptables rules have been torn down and not yet re-applied.

A suggested work-around for this would be a configurable/flagged deferred mode that would prevent the application of the iptables rules until all instances on the host had been initialised then the rules for all instances would be applied at once preventing a ‘blackout’ period.

description: updated
Changed in nova:
assignee: nobody → David McNally (dave-mcnally)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (master)

Fix proposed to branch: master
Review: https://review.openstack.org/11029

Changed in nova:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.openstack.org/11029
Committed: http://github.com/openstack/nova/commit/8f1c54ce98fed9cb7384be9cbb9f28eba2f12c2d
Submitter: Jenkins
Branch: master

commit 8f1c54ce98fed9cb7384be9cbb9f28eba2f12c2d
Author: David McNally <email address hidden>
Date: Wed Aug 8 16:20:23 2012 +0100

    Compute restart causes period of network 'blackout'

    Fixes bug 1034401

    When a compute service is restarted each instance running on the
    host has its iptables rules built and applied sequentially during
    the host init stage. The impact of this, especially on a host
    running many instances, can be observed as a period where some
    instances are not accessible as the existing iptables rules have
    been torn down and not yet re-applied.

    The presented work-around for this is a configurable/flagged deferred
    mode that prevents the application of the iptables rules until all
    instances on the host had been initialised then the rules for all
    instances are applied all at once preventing a 'blackout' period.

    Change-Id: I0da90d07e54225fb63f3884897fb00a6027cd537

Changed in nova:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in nova:
milestone: none → folsom-3
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in nova:
milestone: folsom-3 → 2012.2
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.