| 2017-11-22 14:46:06 |
Merlijn Sebrechts |
description |
Our network setup is the following: We have two networks: a `primary-network`, running a dhcp server with ddns, and a `external-network` where users need to add an IP address manually. This is because public ip's are very scarce in our organization and we can't just give Juju an entire range.
With the current network setup, creating an LXD container on a VM makes the VM unreachable. If we remove the `external-network` from the setup, LXD containers never come up. Let me know if you need more logs. I might also be able to give you access to this cluster, if that's necessary.
# With external network
$ juju bootstrap vmware1 test-with-ext --config primary-network=V31_TENGU --config datastore=NFSSTORE1 --config external-network=V28_IBBTDMZ
$ juju add-machine
$ juju deploy ubuntu --to lxd:0
$ juju status
Model Controller Cloud/Region Version SLA
default test-with-ext vmware1/ILABT 2.3-rc2 unsupported
App Version Status Scale Charm Store Rev OS Notes
ubuntu waiting 0/1 ubuntu jujucharms 10 ubuntu
Unit Workload Agent Machine Public address Ports Message
ubuntu/0 waiting allocating 0/lxd/0 waiting for machine
Machine State DNS Inst id Series AZ Message
0 down 10.10.139.129 juju-b96dff-0 xenial poweredOn
0/lxd/0 pending pending xenial starting
ifconfig: http://paste.ubuntu.com/26020431/
interfaces-cloud-init: http://paste.ubuntu.com/26020432/
interfaces: http://paste.ubuntu.com/26020433/
machine-0.log: http://paste.ubuntu.com/26020434/
# Without external network
$ juju bootstrap vmware1 test-no-ext --config primary-network=V31_TENGU --config datastore=NFSSTORE1
$ juju add-machine
$ juju deploy ubuntu --to lxd:0
$ juju status
Model Controller Cloud/Region Version SLA
default test-no-ext vmware1/ILABT 2.3-rc2 unsupported
App Version Status Scale Charm Store Rev OS Notes
ubuntu waiting 0/1 ubuntu jujucharms 10 ubuntu
Unit Workload Agent Machine Public address Ports Message
ubuntu/0 waiting allocating 0/lxd/0 waiting for machine
Machine State DNS Inst id Series AZ Message
0 started 10.10.139.127 juju-7a3bcd-0 xenial poweredOn
0/lxd/0 pending juju-7a3bcd-0-lxd-0 xenial Container started
Logs of machine 0: http://paste.ubuntu.com/26020258/
$ cat /etc/network/interfaces
auto lo
iface lo inet loopback
auto lo
iface lo inet loopback
auto ens192
iface ens192 inet manual
auto br-ens192
iface br-ens192 inet dhcp
bridge_ports ens192
$ cat /etc/network/interfaces.d/50-cloud-init.cfg
# This file is generated from information provided by
# the datasource. Changes to it will not persist across an instance.
# To disable cloud-init's network configuration capabilities, write a file
# /etc/cloud/cloud.cfg.d/99-disable-network-config.cfg with the following:
# network: {config: disabled}
auto lo
iface lo inet loopback
auto ens192
iface ens192 inet dhcp
$ ifconfig
br-ens192 Link encap:Ethernet HWaddr 00:50:56:a4:f9:8f
inet addr:10.10.139.127 Bcast:10.10.139.255 Mask:255.255.252.0
inet6 addr: fe80::250:56ff:fea4:f98f/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:10730 errors:0 dropped:0 overruns:0 frame:0
TX packets:7053 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:168101174 (168.1 MB) TX bytes:765955 (765.9 KB)
ens192 Link encap:Ethernet HWaddr 00:50:56:a4:f9:8f
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:117180 errors:0 dropped:0 overruns:0 frame:0
TX packets:7086 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:175270310 (175.2 MB) TX bytes:774901 (774.9 KB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:160 errors:0 dropped:0 overruns:0 frame:0
TX packets:160 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1
RX bytes:11840 (11.8 KB) TX bytes:11840 (11.8 KB)
lxdbr0 Link encap:Ethernet HWaddr 1e:0c:08:bd:22:cb
inet addr:10.0.125.1 Bcast:0.0.0.0 Mask:255.255.255.0
inet6 addr: fe80::1c0c:8ff:febd:22cb/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:7 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:570 (570.0 B)
vethDL2BEY Link encap:Ethernet HWaddr fe:00:0c:17:cf:27
inet6 addr: fe80::fc00:cff:fe17:cf27/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:32 errors:0 dropped:0 overruns:0 frame:0
TX packets:39 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:8856 (8.8 KB) TX bytes:7866 (7.8 KB) |
Version: 2.3-rc2-xenial-amd64
VMWare: Version 6.5.0.10000 Build 6816762
Our network setup is the following: We have two networks: a `primary-network`, running a dhcp server with ddns, and a `external-network` where users need to add an IP address manually. This is because public ip's are very scarce in our organization and we can't just give Juju an entire range.
With the current network setup, creating an LXD container on a VM makes the VM unreachable. If we remove the `external-network` from the setup, LXD containers never come up. Let me know if you need more logs. I might also be able to give you access to this cluster, if that's necessary.
# With external network
$ juju bootstrap vmware1 test-with-ext --config primary-network=V31_TENGU --config datastore=NFSSTORE1 --config external-network=V28_IBBTDMZ
$ juju add-machine
$ juju deploy ubuntu --to lxd:0
$ juju status
Model Controller Cloud/Region Version SLA
default test-with-ext vmware1/ILABT 2.3-rc2 unsupported
App Version Status Scale Charm Store Rev OS Notes
ubuntu waiting 0/1 ubuntu jujucharms 10 ubuntu
Unit Workload Agent Machine Public address Ports Message
ubuntu/0 waiting allocating 0/lxd/0 waiting for machine
Machine State DNS Inst id Series AZ Message
0 down 10.10.139.129 juju-b96dff-0 xenial poweredOn
0/lxd/0 pending pending xenial starting
ifconfig: http://paste.ubuntu.com/26020431/
interfaces-cloud-init: http://paste.ubuntu.com/26020432/
interfaces: http://paste.ubuntu.com/26020433/
machine-0.log: http://paste.ubuntu.com/26020434/
# Without external network
$ juju bootstrap vmware1 test-no-ext --config primary-network=V31_TENGU --config datastore=NFSSTORE1
$ juju add-machine
$ juju deploy ubuntu --to lxd:0
$ juju status
Model Controller Cloud/Region Version SLA
default test-no-ext vmware1/ILABT 2.3-rc2 unsupported
App Version Status Scale Charm Store Rev OS Notes
ubuntu waiting 0/1 ubuntu jujucharms 10 ubuntu
Unit Workload Agent Machine Public address Ports Message
ubuntu/0 waiting allocating 0/lxd/0 waiting for machine
Machine State DNS Inst id Series AZ Message
0 started 10.10.139.127 juju-7a3bcd-0 xenial poweredOn
0/lxd/0 pending juju-7a3bcd-0-lxd-0 xenial Container started
Logs of machine 0: http://paste.ubuntu.com/26020258/
$ cat /etc/network/interfaces
auto lo
iface lo inet loopback
auto lo
iface lo inet loopback
auto ens192
iface ens192 inet manual
auto br-ens192
iface br-ens192 inet dhcp
bridge_ports ens192
$ cat /etc/network/interfaces.d/50-cloud-init.cfg
# This file is generated from information provided by
# the datasource. Changes to it will not persist across an instance.
# To disable cloud-init's network configuration capabilities, write a file
# /etc/cloud/cloud.cfg.d/99-disable-network-config.cfg with the following:
# network: {config: disabled}
auto lo
iface lo inet loopback
auto ens192
iface ens192 inet dhcp
$ ifconfig
br-ens192 Link encap:Ethernet HWaddr 00:50:56:a4:f9:8f
inet addr:10.10.139.127 Bcast:10.10.139.255 Mask:255.255.252.0
inet6 addr: fe80::250:56ff:fea4:f98f/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:10730 errors:0 dropped:0 overruns:0 frame:0
TX packets:7053 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:168101174 (168.1 MB) TX bytes:765955 (765.9 KB)
ens192 Link encap:Ethernet HWaddr 00:50:56:a4:f9:8f
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:117180 errors:0 dropped:0 overruns:0 frame:0
TX packets:7086 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:175270310 (175.2 MB) TX bytes:774901 (774.9 KB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:160 errors:0 dropped:0 overruns:0 frame:0
TX packets:160 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1
RX bytes:11840 (11.8 KB) TX bytes:11840 (11.8 KB)
lxdbr0 Link encap:Ethernet HWaddr 1e:0c:08:bd:22:cb
inet addr:10.0.125.1 Bcast:0.0.0.0 Mask:255.255.255.0
inet6 addr: fe80::1c0c:8ff:febd:22cb/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:7 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:570 (570.0 B)
vethDL2BEY Link encap:Ethernet HWaddr fe:00:0c:17:cf:27
inet6 addr: fe80::fc00:cff:fe17:cf27/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:32 errors:0 dropped:0 overruns:0 frame:0
TX packets:39 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:8856 (8.8 KB) TX bytes:7866 (7.8 KB) |
|
