OpenStack Compute (nova)

Bug #1334142
Comment #1

Comment 1 for bug 1334142

Revision history for this message

Ken'ichi Ohmichi (oomichi) wrote on 2014-06-25: Re: A server creation fails due to ERROR state

nova-network failed with the following log:

2014-06-25 06:45:13.093 ERROR oslo.messaging.rpc.dispatcher [req-96792db6-1f4b-4582-a5a0-4b921af6f02d DeleteServersTestXML-119298985 DeleteServersTestXML-772603528] Exception during message handling: Failed
to add interface: Dump was interrupted and may be inconsistent.
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher incoming.message))
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/network/floating_ips.py", line 118, in allocate_for_instance
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher **kwargs)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/network/manager.py", line 525, in allocate_for_instance
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher requested_networks=requested_networks)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/network/manager.py", line 213, in _allocate_fixed_ips
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher vpn=vpn, address=address)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/network/manager.py", line 945, in allocate_fixed_ip
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher exc_info=True)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/openstack/common/excutils.py", line 82, in __exit__
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/network/manager.py", line 927, in allocate_fixed_ip
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher self._setup_network_on_host(context, network)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/network/manager.py", line 1746, in _setup_network_on_host
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher self.l3driver.initialize_gateway(network)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/network/l3.py", line 104, in initialize_gateway
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher gateway=(network_ref['gateway'] is not None))
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/network/linux_net.py", line 1380, in plug
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher return _get_interface_driver().plug(network, mac_address, gateway)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/network/linux_net.py", line 1428, in plug
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher network, gateway)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/openstack/common/lockutils.py", line 249, in inner
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher return f(*args, **kwargs)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher File "/opt/stack/new/nova/nova/network/linux_net.py", line 1571, in ensure_bridge
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher raise exception.NovaException(msg)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher NovaException: Failed to add interface: Dump was interrupted and may be inconsistent.

nova-network failed with the following log:

2014-06-25 06:45:13.093 ERROR oslo.messaging.rpc.dispatcher [req-96792db6-1f4b-4582-a5a0-4b921af6f02d DeleteServersTestXML-119298985 DeleteServersTestXML-772603528] Exception during message handling: Failed
to add interface: Dump was interrupted and may be inconsistent.
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/network/floating_ips.py", line 118, in allocate_for_instance
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     **kwargs)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/network/manager.py", line 525, in allocate_for_instance
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     requested_networks=requested_networks)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/network/manager.py", line 213, in _allocate_fixed_ips
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     vpn=vpn, address=address)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/network/manager.py", line 945, in allocate_fixed_ip
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     exc_info=True)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/openstack/common/excutils.py", line 82, in __exit__
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/network/manager.py", line 927, in allocate_fixed_ip
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     self._setup_network_on_host(context, network)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/network/manager.py", line 1746, in _setup_network_on_host
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     self.l3driver.initialize_gateway(network)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/network/l3.py", line 104, in initialize_gateway
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     gateway=(network_ref['gateway'] is not None))
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/network/linux_net.py", line 1380, in plug
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     return _get_interface_driver().plug(network, mac_address, gateway)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/network/linux_net.py", line 1428, in plug
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     network, gateway)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/openstack/common/lockutils.py", line 249, in inner
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     return f(*args, **kwargs)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher   File "/opt/stack/new/nova/nova/network/linux_net.py", line 1571, in ensure_bridge
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher     raise exception.NovaException(msg)
2014-06-25 06:45:13.093 22817 TRACE oslo.messaging.rpc.dispatcher NovaException: Failed to add interface: Dump was interrupted and may be inconsistent.