bridge not set up correctly with LXC and all-in-one system

[Scott Moser]

I'm attempting to demo/use LXC backend for nova in EC2, all on a single system.
When doing so, I get the trace below. It appears that we can get further by doing:
 $ sudo brctl addbr br0
 $ sudo ifconfig br0 up
 $ sudo vconfig add br0 100

However, doing so just gets us further along to fail at bug 812553.

Trace from nova-compute.log:

2011-07-18 20:31:20,962 DEBUG nova.utils [-] Running cmd (subprocess): sudo vconfig add None 100 from (pid=20109) execute /usr/lib/pymodules/python2.7/nova/utils.py:143
2011-07-18 20:31:20,994 DEBUG nova.utils [-] Result was 3 from (pid=20109) execute /usr/lib/pymodules/python2.7/nova/utils.py:161
2011-07-18 20:31:20,995 ERROR nova.exception [-] Uncaught exception
(nova.exception): TRACE: Traceback (most recent call last):
(nova.exception): TRACE: File "/usr/lib/pymodules/python2.7/nova/exception.py", line 87, in _wrap
(nova.exception): TRACE: return f(*args, **kw)
(nova.exception): TRACE: File "/usr/lib/pymodules/python2.7/nova/compute/manager.py", line 334, in run_instance
(nova.exception): TRACE: self._run_instance(context, instance_id, **kwargs)
(nova.exception): TRACE: File "/usr/lib/pymodules/python2.7/nova/compute/manager.py", line 297, in _run_instance
(nova.exception): TRACE: instance_id)
(nova.exception): TRACE: File "/usr/lib/pymodules/python2.7/nova/network/manager.py", line 827, in setup_compute_network
(nova.exception): TRACE: network['bridge_interface'])
(nova.exception): TRACE: File "/usr/lib/pymodules/python2.7/nova/network/linux_net.py", line 456, in ensure_vlan_bridge
(nova.exception): TRACE: interface = ensure_vlan(vlan_num, bridge_interface)
(nova.exception): TRACE: File "/usr/lib/pymodules/python2.7/nova/utils.py", line 613, in inner
(nova.exception): TRACE: retval = f(*args, **kwargs)
(nova.exception): TRACE: File "/usr/lib/pymodules/python2.7/nova/network/linux_net.py", line 467, in ensure_vlan
(nova.exception): TRACE: _execute('sudo', 'vconfig', 'add', bridge_interface, vlan_num)
(nova.exception): TRACE: File "/usr/lib/pymodules/python2.7/nova/network/linux_net.py", line 689, in _execute
(nova.exception): TRACE: return utils.execute(*cmd, **kwargs)
(nova.exception): TRACE: File "/usr/lib/pymodules/python2.7/nova/utils.py", line 169, in execute
(nova.exception): TRACE: cmd=' '.join(cmd))
(nova.exception): TRACE: ProcessExecutionError: Unexpected error while running command.
(nova.exception): TRACE: Command: sudo vconfig add None 100
(nova.exception): TRACE: Exit code: 3
(nova.exception): TRACE: Stdout: ''
(nova.exception): TRACE: Stderr: 'ERROR: trying to add VLAN #100 to IF -:None:- error: No such device\n'

ProblemType: Bug
DistroRelease: Ubuntu 11.10
Package: nova-network 2011.3~d3~20110708.1251-0ubuntu1
ProcVersionSignature: User Name 3.0.0-5.6-virtual 3.0.0-rc7
Uname: Linux 3.0.0-5-virtual x86_64
Architecture: amd64
Date: Mon Jul 18 20:45:23 2011
PackageArchitecture: all
ProcEnviron:
 PATH=(custom, user)
 LANG=en_US.UTF-8
 SHELL=/bin/bash
SourcePackage: nova
UpgradeStatus: No upgrade log present (probably fresh install)

[Scott Moser (smoser)]

I'm adding an attachment with all of the setup that I did.
The commands were run on a m1.large instance of latest oneiric.
us-east-1 ami-3d965154 ebs/ubuntu-oneiric-daily-amd64-server-20110718

[Adam Gandelman (gandelman-a)]

Scott-

There is no network manager defined in nova.conf, so nova-network is defaulting to the VLAN manager which, IIRC, requires a separate physical interface to be available on which it builds bridges and VLANs, as well as some config flags in nova.conf. I've attached a modified version of your script that configures the appropriate flags for using the FlatManager instead, deletes + re-migrates the sqlite database as it needs and sets up a bridge to use (I'd suggest using 11.0.0.0 or a subnet other than ec2's 10.0.0.0)

This should at least get your networking provisioned, images delivered and built and instance launched.

Keep in mind, there is an pending bug that effects the current oneiric build and will prevent you from launching anything ATM. See: https://bugs.launchpad.net/nova/+bug/807764

[Scott Moser (smoser)]

I'm marking this as invalid. It was mostly user error on my part.
I've got an improved version of the script here at https://gist.github.com/1169889