Anbox Cloud

Error anbox-cloud init

Bug #2043927 reported by Eduardo Henrique de Oliveira on 2023-11-19

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Anbox Cloud	Incomplete	High	Unassigned	Anbox Cloud 1.20.1

Bug Description

Hi All,

I'm trying installing anbox-cloud in a OCI instance following this guide https://discourse.ubuntu.com/t/install-the-anbox-cloud-appliance-on-a-dedicated-machine/22681 and getting an error. Can someone help?

root@instance-emu:/home/ubuntu# cat /var/snap/anbox-cloud-appliance/common/logs/bootstrap.log
2023-11-19 13:35:06 LXD network name set to lxdfan0
Since Juju 2 is being run for the first time, it has downloaded the latest public cloud information.
Only clouds with registered credentials are shown.
There are more clouds, use --all to see them.
2023-11-19 13:35:14 Public location: 144.22.143.188
2023-11-19 13:35:14 Public address: 144.22.143.188
2023-11-19 13:35:14 Private address: 10.0.0.241
2023-11-19 13:35:14 Private subnet: 10.0.0.0/24
2023-11-19 13:35:14 Running on OCI, applying firewall rules
iptables v1.8.7 (nf_tables): chain `anbox-ingress' in table `filter' is incompatible, use 'nft' tool.

iptables v1.8.7 (nf_tables): chain `anbox-forward' in table `filter' is incompatible, use 'nft' tool.

run-parts: executing /usr/share/netfilter-persistent/plugins.d/15-ip4tables save
run-parts: executing /usr/share/netfilter-persistent/plugins.d/25-ip6tables save
2023-11-19 13:35:14 Using UA subscription from host
2023-11-19 13:35:14 Successfully extracted credentials from UA subscription
2023-11-19 13:35:15 Starting installation of dependencies

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Hit:1 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy InRelease
Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB]
Get:3 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB]
Hit:4 https://esm.ubuntu.com/apps/ubuntu jammy-apps-security InRelease
Hit:5 https://esm.ubuntu.com/apps/ubuntu jammy-apps-updates InRelease
Hit:6 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy-backports InRelease
Hit:7 https://esm.ubuntu.com/infra/ubuntu jammy-infra-security InRelease
Get:8 https://archive.anbox-cloud.io/stable jammy InRelease [2489 B]
Hit:9 https://esm.ubuntu.com/infra/ubuntu jammy-infra-updates InRelease
Get:10 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1162 kB]
Get:11 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [998 kB]
Fetched 2392 kB in 7s (327 kB/s)
Reading package lists...
Building dependency tree...
Reading state information...
All packages are up to date.
W: Target Packages (main/binary-amd64/Packages) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target Packages (main/binary-all/Packages) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target Translations (main/i18n/Translation-en) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target CNF (main/cnf/Commands-amd64) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target CNF (main/cnf/Commands-all) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target Packages (main/binary-amd64/Packages) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target Packages (main/binary-all/Packages) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target Translations (main/i18n/Translation-en) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target CNF (main/cnf/Commands-amd64) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target CNF (main/cnf/Commands-all) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Reading package lists...
Building dependency tree...
Reading state information...
linux-headers-5.15.0-1047-oracle is already the newest version (5.15.0-1047.53).
linux-headers-5.15.0-1047-oracle set to manually installed.
linux-headers-oracle is already the newest version (5.15.0.1047.42).
linux-modules-extra-5.15.0-1047-oracle is already the newest version (5.15.0-1047.53).
linux-modules-extra-5.15.0-1047-oracle set to manually installed.
The following additional packages will be installed:
  libcpufreq0 tcl-expect
Suggested packages:
  tk8.6
The following NEW packages will be installed:
  cpufrequtils expect libcpufreq0 tcl-expect
0 upgraded, 4 newly installed, 0 to remove and 0 not upgraded.
Need to get 289 kB of archives.
After this operation, 783 kB of additional disk space will be used.
Get:1 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy/universe amd64 libcpufreq0 amd64 008-2build1 [12.3 kB]
Get:2 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy/universe amd64 cpufrequtils amd64 008-2build1 [34.5 kB]
Get:3 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy/universe amd64 tcl-expect amd64 5.45.4-2build1 [105 kB]
Get:4 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy/universe amd64 expect amd64 5.45.4-2build1 [137 kB]
Preconfiguring packages ...
Fetched 289 kB in 1s (211 kB/s)
Selecting previously unselected package libcpufreq0.
(Reading database ... 106260 files and directories currently installed.)
Preparing to unpack .../libcpufreq0_008-2build1_amd64.deb ...
Unpacking libcpufreq0 (008-2build1) ...
Selecting previously unselected package cpufrequtils.
Preparing to unpack .../cpufrequtils_008-2build1_amd64.deb ...
Unpacking cpufrequtils (008-2build1) ...
Selecting previously unselected package tcl-expect:amd64.
Preparing to unpack .../tcl-expect_5.45.4-2build1_amd64.deb ...
Unpacking tcl-expect:amd64 (5.45.4-2build1) ...
Selecting previously unselected package expect.
Preparing to unpack .../expect_5.45.4-2build1_amd64.deb ...
Unpacking expect (5.45.4-2build1) ...
Setting up tcl-expect:amd64 (5.45.4-2build1) ...
Setting up libcpufreq0 (008-2build1) ...
Setting up expect (5.45.4-2build1) ...
Setting up cpufrequtils (008-2build1) ...
update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults
update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults
Processing triggers for man-db (2.10.2-1) ...
Processing triggers for libc-bin (2.35-0ubuntu3.4) ...
NEEDRESTART-VER: 3.5
NEEDRESTART-KCUR: 5.15.0-1047-oracle
NEEDRESTART-KEXP: 5.15.0-1047-oracle
NEEDRESTART-KSTA: 1
Packages installation done in parallel
fs.inotify.max_queued_events = 1048576
fs.inotify.max_user_instances = 1048576
fs.inotify.max_user_watches = 1048576
vm.max_map_count = 262144
kernel.dmesg_restrict = 1
kernel.pid_max = 4194304
net.ipv4.neigh.default.gc_thresh3 = 8192
net.ipv6.neigh.default.gc_thresh3 = 8192
kernel.keys.maxkeys = 2000
kernel.keys.maxbytes = 2000000
fs.aio-max-nr = 524288
net.ipv4.ping_group_range = 0 2147483647
2023-11-19 13:38:16 LXD is ready, continuing with its initialization
2023-11-19 13:38:16 Using the following preseed configuration:
config:
  cluster.https_address: 10.0.0.241:8443
  core.https_address: 10.0.0.241:8443
cluster:
  enabled: true
  server_name: lxd0
networks:
- name: lxdfan0
  type: bridge
  config:
    ipv4.nat: true
    ipv4.dhcp.expiry: infinite
    fan.overlay_subnet: 240.0.0.0/8
    fan.underlay_subnet: 10.0.0.0/24
    bridge.mode: fan
profiles:
- name: default
  devices:
    root:
      path: /
      pool: data
      type: disk
    eth0:
      type: nic
      nictype: bridged
      parent: lxdfan0
storage_pools:
- name: data
  driver: zfs
  config:
    size: 32212254720
Storage volume backups created
Storage volume images created
Restarted.
2023-11-19 13:38:44 Configuring Juju for our LXD cloud
......+.....+.+...+..+................+........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+............+..........+...+.....+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.............+...+.....+....+........+......................+...+...+.....+.+...+...+........+.......+..+.........................+........+...+.......+...+..............+.+..+...+..........+...........+...+.......+.....+......+..........+..+...+....+......+...+.....+................+...+.....+...............+.+...........+.+.........+.....+...+............+.+.....+..................+....+............+..................+...+...+..+....+.....+..........+.....+....+..+...............+.........+.........+......+..........+........+...+.......+...+...+.........+............+...............+..............+.......+........+......+......+.......+........+....+...+...+...+..+..........+.........+.........+..+...............+.............+.....+............+.......+........+.......+...+........+......................+...+.....+.+.............................+....+...+.........+........+......+.......+............+...+........+.........+.......+...+..+...+...+.........+......+...+..........+......+...+...........+.+...........+...+....+..+...+......+................+......+..+...+....+....................+...+..................+...+..........+..+.......+.....+...............+......+.+.....+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
..+...+..+...+....+..+......+.........+....+......+........+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+......+......+.......+......+......+...+............+...+...+.....+.........+..........+..............+....+..+.+..+......+....+..+....+..+..........+..+...+.........+...+.+.........+......+..+.........................+..+.+......+...........+.......+......+...........+.+.........+........+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....................+.......+.....+.+...........+....+.................+..........+...+......+........+.......+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----
2023-11-19 13:38:51 Using following Juju cloud configuration:
clouds:
  appliance:
    type: lxd
    auth-types: [certificate]
    endpoint: https://10.0.0.241:8443
    config:
      ssl-hostname-verification: false
Cloud "appliance" successfully added to your local client.
You will need to add a credential for this cloud (`juju add-credential appliance`)
before you can use it to bootstrap a controller (`juju bootstrap appliance`) or
to create a model (`juju add-model <your model name> appliance`).
Credential "admin" added locally for cloud "appliance".

2023-11-19 13:38:58 Successfully configured Juju
Creating Juju controller "appliance" on appliance/default
Looking for packaged Juju agent version 2.9.42 for amd64
Located Juju agent version 2.9.42-ubuntu-amd64 at https://streams.canonical.com/juju/tools/agent/2.9.42/juju-2.9.42-linux-amd64.tgz
To configure your system to better support LXD containers, please see: https://linuxcontainers.org/lxd/docs/master/explanation/performance_tuning/
Launching controller instance(s) on appliance/default...
ERROR failed to bootstrap model: cannot start bootstrap instance in availability zone "lxd0": write tcp 10.0.0.241:52076->10.0.0.241:8443: i/o timeout

Revision history for this message

Simon Fels (morphis) wrote on 2023-11-20:

Hey Eduardo,

the actual problem seems to be

2023-11-19 13:35:14 Running on OCI, applying firewall rules
iptables v1.8.7 (nf_tables): chain `anbox-ingress' in table `filter' is incompatible, use 'nft' tool.
iptables v1.8.7 (nf_tables): chain `anbox-forward' in table `filter' is incompatible, use 'nft' tool.

We have to apply additional firewall rules as OCI is a bit special in its instance firewalling. As the commands fails we subsequent Juju bootstrap will fail as well as external access on 10.0.0.241:8443 (LXD) is denied.

I will try and reproduce this and come up with a workaround and fix for the next patch release.

Changed in anbox-cloud:
assignee:	nobody → Simon Fels (morphis)
status:	New → Triaged
importance:	Undecided → High
milestone:	none → 1.20.1

Revision history for this message

Simon Fels (morphis) wrote on 2023-11-20:

I tried to reproduce this but on an OCI instance with instance security groups set up (see https://anbox-cloud.io/docs/ref/network-ports#appliance) and latest Ubuntu 22.04 images things went through smoothly.

Can you provide us a few more details:

* Can it be that you tried the initialization multiple times on the same machine?
* Have you configured a security group for the instance allowing all ports as documented on https://anbox-cloud.io/docs/ref/network-ports#appliance?

Next to the answers, can you also share the output of

$ sudo anbox-cloud-appliance.buginfo

Feel free to strip any information from it you don't want to share or share separately.

Changed in anbox-cloud:
status:	Triaged → Incomplete

Revision history for this message

Eduardo Henrique de Oliveira (adviou) wrote on 2023-11-20:

ports.jpg Edit (146.1 KiB, image/jpeg)

Download full text (29.1 KiB)

Hi Simon,

I create a fresh instance and allowed ports documented on https://anbox-cloud.io/docs/ref/network-ports#appliance as attachment.

ubuntu@instance-emu:~$ sudo anbox-cloud-appliance.buginfo
cat: /var/snap/anbox-cloud-appliance/common/logs/upgrade.log: No such file or directory
# Appliance Status

status: error
error: Failed to bootstrap Juju controller
update-available: false
reboot-needed: false
version: 1.20.0

# Appliance Status Flags

total 24K
drwxr-xr-x 5 root root 4.0K Nov 20 13:24 .
drwxr-xr-x 4 root root 4.0K Nov 20 13:12 ..
-rw-r--r-- 1 root root 0 Nov 20 13:24 .bootstrap_failed
-rw------- 1 root root 59 Nov 20 13:16 appliance.conf
drwxr-xr-x 2 root root 4.0K Nov 20 13:16 logs
drwxr-xr-x 2 root root 4.0K Nov 20 13:12 service
drwxr-xr-x 4 root root 4.0K Nov 20 13:12 traefik

# Appliance Bootstrap Log

2023-11-20 13:16:28 LXD network name set to lxdfan0
Since Juju 2 is being run for the first time, it has downloaded the latest public cloud information.
Only clouds with registered credentials are shown.
There are more clouds, use --all to see them.
2023-11-20 13:16:36 Public location: X.X.X.X
2023-11-20 13:16:36 Public address: X.X.X.X
2023-11-20 13:16:36 Private address: 10.0.0.33
2023-11-20 13:16:36 Private subnet: 10.0.0.0/24
2023-11-20 13:16:36 Running on OCI, applying firewall rules
iptables v1.8.7 (nf_tables): chain `anbox-ingress' in table `filter' is incompatible, use 'nft' tool.

iptables v1.8.7 (nf_tables): chain `anbox-forward' in table `filter' is incompatible, use 'nft' tool.

run-parts: executing /usr/share/netfilter-persistent/plugins.d/15-ip4tables save
run-parts: executing /usr/share/netfilter-persistent/plugins.d/25-ip6tables save
2023-11-20 13:16:36 Using UA subscription from host
2023-11-20 13:16:36 Successfully extracted credentials from UA subscription
2023-11-20 13:16:36 Starting installation of dependencies

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Hi Simon,

I create a fresh instance and allowed ports documented on https://anbox-cloud.io/docs/ref/network-ports#appliance as attachment.

ubuntu@instance-emu:~$ sudo anbox-cloud-appliance.buginfo
cat: /var/snap/anbox-cloud-appliance/common/logs/upgrade.log: No such file or directory
# Appliance Status

status: error
error: Failed to bootstrap Juju controller
update-available: false
reboot-needed: false
version: 1.20.0

# Appliance Status Flags

total 24K
drwxr-xr-x 5 root root 4.0K Nov 20 13:24 .
drwxr-xr-x 4 root root 4.0K Nov 20 13:12 ..
-rw-r--r-- 1 root root    0 Nov 20 13:24 .bootstrap_failed
-rw------- 1 root root   59 Nov 20 13:16 appliance.conf
drwxr-xr-x 2 root root 4.0K Nov 20 13:16 logs
drwxr-xr-x 2 root root 4.0K Nov 20 13:12 service
drwxr-xr-x 4 root root 4.0K Nov 20 13:12 traefik

# Appliance Bootstrap Log

iptables v1.8.7 (nf_tables): chain `anbox-forward' in table `filter' is incompatible, use 'nft' tool.

run-parts: executing /usr/share/netfilter-persistent/plugins.d/15-ip4tables save
run-parts: executing /usr/share/netfilter-persistent/plugins.d/25-ip6tables save
2023-11-20 13:16:36 Using UA subscription from host
2023-11-20 13:16:36 Successfully extracted credentials from UA subscription
2023-11-20 13:16:36 Starting installation of dependencies

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Hit:1 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy InRelease
Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease
Hit:3 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy-updates InRelease
Hit:4 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy-backports InRelease
Hit:5 https://esm.ubuntu.com/apps/ubuntu jammy-apps-security InRelease
Get:6 https://archive.anbox-cloud.io/stable jammy InRelease [2489 B]
Hit:7 https://esm.ubuntu.com/apps/ubuntu jammy-apps-updates InRelease
Hit:8 https://esm.ubuntu.com/infra/ubuntu jammy-infra-security InRelease
Hit:9 https://esm.ubuntu.com/infra/ubuntu jammy-infra-updates InRelease
Fetched 2489 B in 6s (451 B/s)
Reading package lists...
Building dependency tree...
Reading state information...
All packages are up to date.
W: Target Packages (main/binary-amd64/Packages) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target Packages (main/binary-all/Packages) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target Translations (main/i18n/Translation-en) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target CNF (main/cnf/Commands-amd64) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target CNF (main/cnf/Commands-all) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target Packages (main/binary-amd64/Packages) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target Packages (main/binary-all/Packages) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target Translations (main/i18n/Translation-en) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target CNF (main/cnf/Commands-amd64) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1
W: Target CNF (main/cnf/Commands-all) is configured multiple times in /etc/apt/sources.list.d/anbox-cloud.list:1 and /etc/apt/sources.list.d/ubuntu-anbox-cloud.list:1

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Reading package lists...
Building dependency tree...
Reading state information...
linux-headers-5.15.0-1047-oracle is already the newest version (5.15.0-1047.53).
linux-headers-5.15.0-1047-oracle set to manually installed.
linux-headers-oracle is already the newest version (5.15.0.1047.42).
linux-modules-extra-5.15.0-1047-oracle is already the newest version (5.15.0-1047.53).
linux-modules-extra-5.15.0-1047-oracle set to manually installed.
The following additional packages will be installed:
  libcpufreq0 tcl-expect
Suggested packages:
  tk8.6
The following NEW packages will be installed:
  cpufrequtils expect libcpufreq0 tcl-expect
0 upgraded, 4 newly installed, 0 to remove and 0 not upgraded.
Need to get 289 kB of archives.
After this operation, 783 kB of additional disk space will be used.
Get:1 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy/universe amd64 libcpufreq0 amd64 008-2build1 [12.3 kB]
Get:2 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy/universe amd64 cpufrequtils amd64 008-2build1 [34.5 kB]
Get:3 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy/universe amd64 tcl-expect amd64 5.45.4-2build1 [105 kB]
Get:4 http://sa-saopaulo-1-ad-1.clouds.archive.ubuntu.com/ubuntu jammy/universe amd64 expect amd64 5.45.4-2build1 [137 kB]
Preconfiguring packages ...
Fetched 289 kB in 1s (211 kB/s)
Selecting previously unselected package libcpufreq0.
(Reading database ... 106242 files and directories currently installed.)
Preparing to unpack .../libcpufreq0_008-2build1_amd64.deb ...
Unpacking libcpufreq0 (008-2build1) ...
Selecting previously unselected package cpufrequtils.
Preparing to unpack .../cpufrequtils_008-2build1_amd64.deb ...
Unpacking cpufrequtils (008-2build1) ...
Selecting previously unselected package tcl-expect:amd64.
Preparing to unpack .../tcl-expect_5.45.4-2build1_amd64.deb ...
Unpacking tcl-expect:amd64 (5.45.4-2build1) ...
Selecting previously unselected package expect.
Preparing to unpack .../expect_5.45.4-2build1_amd64.deb ...
Unpacking expect (5.45.4-2build1) ...
Setting up tcl-expect:amd64 (5.45.4-2build1) ...
Setting up libcpufreq0 (008-2build1) ...
Setting up expect (5.45.4-2build1) ...
Setting up cpufrequtils (008-2build1) ...
update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults
update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults
Processing triggers for man-db (2.10.2-1) ...
Processing triggers for libc-bin (2.35-0ubuntu3.4) ...
NEEDRESTART-VER: 3.5
NEEDRESTART-KCUR: 5.15.0-1047-oracle
NEEDRESTART-KEXP: 5.15.0-1047-oracle
NEEDRESTART-KSTA: 1
Packages installation done in parallel
fs.inotify.max_queued_events = 1048576
fs.inotify.max_user_instances = 1048576
fs.inotify.max_user_watches = 1048576
vm.max_map_count = 262144
kernel.dmesg_restrict = 1
kernel.pid_max = 4194304
net.ipv4.neigh.default.gc_thresh3 = 8192
net.ipv6.neigh.default.gc_thresh3 = 8192
kernel.keys.maxkeys = 2000
kernel.keys.maxbytes = 2000000
fs.aio-max-nr = 524288
net.ipv4.ping_group_range = 0 2147483647
2023-11-20 13:19:35 LXD is ready, continuing with its initialization
2023-11-20 13:19:35 Using the following preseed configuration:
config:
  cluster.https_address: 10.0.0.33:8443
  core.https_address: 10.0.0.33:8443
cluster:
  enabled: true
  server_name: lxd0
networks:
- name: lxdfan0
  type: bridge
  config:
    ipv4.nat: true
    ipv4.dhcp.expiry: infinite
    fan.overlay_subnet: 240.0.0.0/8
    fan.underlay_subnet: 10.0.0.0/24
    bridge.mode: fan
profiles:
- name: default
  devices:
    root:
      path: /
      pool: data
      type: disk
    eth0:
      type: nic
      nictype: bridged
      parent: lxdfan0
storage_pools:
- name: data
  driver: zfs
  config:
    size: 32212254720
Storage volume backups created
Storage volume images created
Restarted.
2023-11-20 13:20:08 Configuring Juju for our LXD cloud
.+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+...+...+..+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+..+..........+...+.....+...+...+....+........+..........+...+.....+...............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+..+.+.....+............+.+...........+......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*................+....+...........+.+.....+....+..+............+.......+...+........+....+........+...+...+..........+......+.....+...+...............+..........+..+.+...+............+..+................+.....+.........+.+......+...+..+.........+......+......+....+...............+.....+.........+....+..+......+....+...........+...+....+.....+......+.+.........+.....+.......+.................+...+..................+.......+..+..................+....+.........+..+...+.+......+.......................+.+.....+................+...+............+..+.+..............+.......+.........+......+...............+......+............+.....+...+...+...................+..+...+..........+......+.........+.....+............+.+....................+...+......+.+.............................+...+.+....................+............+............+......+.......+..+.+...........+.+........+..........+..+.......+..+..........+...+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----
2023-11-20 13:20:15 Using following Juju cloud configuration:
clouds:
  appliance:
    type: lxd
    auth-types: [certificate]
    endpoint: https://10.0.0.33:8443
    config:
      ssl-hostname-verification: false
Cloud "appliance" successfully added to your local client.
You will need to add a credential for this cloud (`juju add-credential appliance`)
before you can use it to bootstrap a controller (`juju bootstrap appliance`) or
to create a model (`juju add-model <your model name> appliance`).
Credential "admin" added locally for cloud "appliance".

2023-11-20 13:20:22 Successfully configured Juju
Creating Juju controller "appliance" on appliance/default
Looking for packaged Juju agent version 2.9.42 for amd64
Located Juju agent version 2.9.42-ubuntu-amd64 at https://streams.canonical.com/juju/tools/agent/2.9.42/juju-2.9.42-linux-amd64.tgz
To configure your system to better support LXD containers, please see: https://linuxcontainers.org/lxd/docs/master/explanation/performance_tuning/
Launching controller instance(s) on appliance/default...
ERROR failed to bootstrap model: cannot start bootstrap instance in availability zone "lxd0": write tcp 10.0.0.33:41174->10.0.0.33:8443: i/o timeout

# Appliance Upgrade Log

n/a

# Appliance System Log

2023-11-20T13:12:49Z systemd[1]: Started Service for snap application anbox-cloud-appliance.traefik.
2023-11-20T13:12:50Z systemd[1]: Starting Service for snap application anbox-cloud-appliance.reboot-checker...
2023-11-20T13:12:50Z systemd[1]: snap.anbox-cloud-appliance.reboot-checker.service: Deactivated successfully.
2023-11-20T13:12:50Z systemd[1]: Finished Service for snap application anbox-cloud-appliance.reboot-checker.
2023-11-20T13:12:50Z systemd[1]: Started Service for snap application anbox-cloud-appliance.telegraf.
2023-11-20T13:12:50Z systemd[1]: Started Service for snap application anbox-cloud-appliance.daemon.
2023-11-20T13:12:50Z anbox-cloud-appliance.telegraf[3657]: INFO: No configuration file, stopping
2023-11-20T13:12:50Z systemd[1]: snap.anbox-cloud-appliance.telegraf.service: Deactivated successfully.
2023-11-20T13:12:52Z anbox-cloud-appliance.daemon[3663]: I1120 13:12:52.049365    3663 service.go:112] Service: internal API running at /var/snap/anbox-cloud-appliance/common/service/internal.socket
2023-11-20T13:12:52Z anbox-cloud-appliance.daemon[3663]: I1120 13:12:52.049499    3663 service.go:163] Service: Serving development UI from /snap/anbox-cloud-appliance/492/web
2023-11-20T13:12:52Z anbox-cloud-appliance.daemon[3663]: I1120 13:12:52.049508    3663 service.go:164] Service: Public API running at 127.0.0.1:4003
2023-11-20T13:12:53Z systemd[1]: Started Service for snap application anbox-cloud-appliance.telegraf.
2023-11-20T13:12:54Z anbox-cloud-appliance.telegraf[3813]: INFO: No configuration file, stopping
2023-11-20T13:12:54Z systemd[1]: snap.anbox-cloud-appliance.telegraf.service: Deactivated successfully.
2023-11-20T13:13:02Z anbox-cloud-appliance.traefik[3781]: ......+....+..+.+..+......+.+......+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.........+.+...+......+.........+...+............+...............+...+.....+...+....+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+.......+.....+......+....+...........+.......+...+.....+.......+...+..+..........+......+.....+.........+.+......+.....+................+.....+............+.......+.....+................+..+............+...+.+..+...+..........+...........+...+.+...........+......+.......+...+........+......+.............+...+...+......+.........+.........+.................................+...+......+...+..+...+......+.+.....+......+...+..........+......+...........+..........+.....+..........+..+.....................+...............+....+...+............+..+...+.+......+.....+......+.......+......+.........+.....................+.....+.+.....................+............+............+...........+....+..................+...+..+......+.+..............+.......+.........+....................+...+.+...........+...+......+.......+.....+.......+.....+............+.+.....+...............+..........+........+......+.............+......+......+......+..+...+....+......+..+................+..+............+..........+...........+............+...............+...+.+...+......+.........+..+...+............+...+.+............+.........+.........+..+..........+...+..+.........+....+.....+.+...+...+...+..+..................+..........+.........+..+..........+.........+..+.......+...+..+.+..+............+.+.........+...+.....+...+.........+.......+..............+.+........+......+....+.................+......+......................+...+.........+.........+......+..................+.................................+...+........................+........+...+.......+........+.+.....+.+.........+...+.....+.......+.....+....+.........+........+..................+.........+.+.........+..................+...+.........+.....+.......+...+......+........................+..+......+....+......+..+.+....................+................+......+..+...+...+......+................+..................+......+...........+...+.+.....+................+........+....+.....+.......+...........+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
2023-11-20T13:13:10Z anbox-cloud-appliance.traefik[3781]: ...........+...+..................+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.......+...........+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+..+......................+...+..+.+....................+.........+...+.......+......+.....................+.........+.....+........................+.............+..+.+..+.........+.+..............+....+..............+.+......+...+...........+...............+....+...+..+.+............+........+............+...+.......+...............+...+...........+...+.+..+..................+................+.....+.+...+......+...+..+......+...+.......+.....+.........+....+...........+....+..+...+..........+.........+............+......+..+...............+.............+.................+...+.......+.....+.+.....+.........+...+..................+.+.....+..........+.....+..........+...+....................+..........+...........+.+......+............+...+..+...............+...+....+...............+......+.....+..........+..+.+..............+......+.......+............+..+....+............+...+.........+...+.....+.........+.............+.....+..........+..+.........+.+...+...+.....+.......+...........+.........+.............+..+.......+...........+..........+..+.+..+..................+....+......+.....+.........+............+.+..+...+...+......+...+................+...........+.+.....+.............+..+...+.+......+..+.......+.........+..............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
2023-11-20T13:13:10Z anbox-cloud-appliance.traefik[3781]: -----
2023-11-20T13:13:32Z anbox-cloud-appliance.traefik[3609]: time="2023-11-20T13:13:32Z" level=info msg="Configuration loaded from file: /var/snap/anbox-cloud-appliance/common/traefik/main.yaml"
2023-11-20T13:16:27Z systemd[1]: Started Service for snap application anbox-cloud-appliance.bootstrapper.
2023-11-20T13:16:28Z anbox-cloud-appliance.bootstrapper[4829]: I1120 13:16:28.251409    4829 bootstrap.go:94] Using public location X.X.X.X
2023-11-20T13:16:28Z anbox-cloud-appliance.bootstrapper[4829]: I1120 13:16:28.251458    4829 bootstrap.go:98] Using public address X.X.X.X
2023-11-20T13:16:28Z anbox-cloud-appliance.bootstrapper[4829]: I1120 13:16:28.251467    4829 bootstrap.go:102] Using private address 10.0.0.33
2023-11-20T13:16:28Z anbox-cloud-appliance.bootstrapper[4829]: I1120 13:16:28.251474    4829 bootstrap.go:106] Using private subnet 10.0.0.0/24
2023-11-20T13:16:28Z anbox-cloud-appliance.bootstrapper[4829]: I1120 13:16:28.251480    4829 bootstrap.go:110] Using network type fan
2023-11-20T13:16:29Z sudo[4913]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=ubuntu ; COMMAND=/snap/anbox-cloud-appliance/492/bin/juju clouds
2023-11-20T13:16:29Z sudo[4913]: pam_unix(sudo:session): session opened for user ubuntu(uid=1001) by (uid=0)
2023-11-20T13:16:35Z sudo[4913]: pam_unix(sudo:session): session closed for user ubuntu
2023-11-20T13:19:26Z sudo[9301]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=root ; COMMAND=/usr/bin/systemctl restart cpufrequtils.service
2023-11-20T13:19:26Z sudo[9301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=0)
2023-11-20T13:19:27Z sudo[9301]: pam_unix(sudo:session): session closed for user root
2023-11-20T13:19:28Z sudo[9337]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=ubuntu ; COMMAND=/snap/bin/lxc info
2023-11-20T13:19:28Z sudo[9337]: pam_unix(sudo:session): session opened for user ubuntu(uid=1001) by (uid=0)
2023-11-20T13:19:31Z sudo[9337]: pam_unix(sudo:session): session closed for user ubuntu
2023-11-20T13:19:31Z sudo[9378]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=ubuntu ; COMMAND=/snap/bin/lxc network ls
2023-11-20T13:19:31Z sudo[9378]: pam_unix(sudo:session): session opened for user ubuntu(uid=1001) by (uid=0)
2023-11-20T13:19:32Z sudo[9378]: pam_unix(sudo:session): session closed for user ubuntu
2023-11-20T13:19:32Z sudo[9419]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=ubuntu ; COMMAND=/snap/bin/lxc storage ls
2023-11-20T13:19:32Z sudo[9419]: pam_unix(sudo:session): session opened for user ubuntu(uid=1001) by (uid=0)
2023-11-20T13:19:32Z sudo[9419]: pam_unix(sudo:session): session closed for user ubuntu
2023-11-20T13:19:46Z sudo[10331]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=ubuntu ; COMMAND=/snap/bin/lxc storage volume create data backups
2023-11-20T13:19:46Z sudo[10331]: pam_unix(sudo:session): session opened for user ubuntu(uid=1001) by (uid=0)
2023-11-20T13:19:48Z sudo[10331]: pam_unix(sudo:session): session closed for user ubuntu
2023-11-20T13:19:48Z sudo[10409]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=ubuntu ; COMMAND=/snap/bin/lxc config set storage.backups_volume data/backups
2023-11-20T13:19:48Z sudo[10409]: pam_unix(sudo:session): session opened for user ubuntu(uid=1001) by (uid=0)
2023-11-20T13:19:49Z sudo[10409]: pam_unix(sudo:session): session closed for user ubuntu
2023-11-20T13:19:49Z sudo[10477]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=ubuntu ; COMMAND=/snap/bin/lxc storage volume create data images
2023-11-20T13:19:49Z sudo[10477]: pam_unix(sudo:session): session opened for user ubuntu(uid=1001) by (uid=0)
2023-11-20T13:19:50Z sudo[10477]: pam_unix(sudo:session): session closed for user ubuntu
2023-11-20T13:19:50Z sudo[10671]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=ubuntu ; COMMAND=/snap/bin/lxc config set storage.images_volume data/images
2023-11-20T13:19:50Z sudo[10671]: pam_unix(sudo:session): session opened for user ubuntu(uid=1001) by (uid=0)
2023-11-20T13:19:51Z sudo[10671]: pam_unix(sudo:session): session closed for user ubuntu
2023-11-20T13:20:15Z sudo[11395]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=ubuntu ; COMMAND=/snap/anbox-cloud-appliance/492/bin/juju add-cloud --client appliance /var/snap/anbox-cloud-appliance/492/.tmp.oxQvE6/clouds.yaml
2023-11-20T13:20:15Z sudo[11395]: pam_unix(sudo:session): session opened for user ubuntu(uid=1001) by (uid=0)
2023-11-20T13:20:21Z sudo[11395]: pam_unix(sudo:session): session closed for user ubuntu
2023-11-20T13:20:21Z sudo[11437]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=ubuntu ; COMMAND=/snap/anbox-cloud-appliance/492/bin/juju add-credential --client appliance -f /var/snap/anbox-cloud-appliance/492/.tmp.oxQvE6/creds.yaml
2023-11-20T13:20:21Z sudo[11437]: pam_unix(sudo:session): session opened for user ubuntu(uid=1001) by (uid=0)
2023-11-20T13:20:22Z sudo[11437]: pam_unix(sudo:session): session closed for user ubuntu
2023-11-20T13:20:22Z sudo[11451]:     root : PWD=/var/snap/anbox-cloud-appliance/492 ; USER=ubuntu ; COMMAND=/snap/anbox-cloud-appliance/492/bin/juju bootstrap appliance appliance --no-gui --no-switch --bootstrap-series=jammy --config container-image-stream=daily
2023-11-20T13:20:22Z sudo[11451]: pam_unix(sudo:session): session opened for user ubuntu(uid=1001) by (uid=0)
2023-11-20T13:24:10Z sudo[11451]: pam_unix(sudo:session): session closed for user ubuntu
2023-11-20T13:24:11Z anbox-cloud-appliance.bootstrapper[4829]: Error: Failed to run bootstrap process, you can find more information at /var/snap/anbox-cloud-appliance/common/logs/bootstrap.log
2023-11-20T13:24:11Z anbox-cloud-appliance.bootstrapper[4829]: Error: exit status 1
2023-11-20T13:24:11Z systemd[1]: snap.anbox-cloud-appliance.bootstrapper.service: Main process exited, code=exited, status=1/FAILURE
2023-11-20T13:24:11Z systemd[1]: snap.anbox-cloud-appliance.bootstrapper.service: Failed with result 'exit-code'.
2023-11-20T13:24:11Z systemd[1]: snap.anbox-cloud-appliance.bootstrapper.service: Consumed 1min 51.573s CPU time.
2023-11-20T13:24:11Z systemd[1]: snap.anbox-cloud-appliance.bootstrapper.service: Scheduled restart job, restart counter is at 1.
2023-11-20T13:24:11Z systemd[1]: Stopped Service for snap application anbox-cloud-appliance.bootstrapper.
2023-11-20T13:24:11Z systemd[1]: snap.anbox-cloud-appliance.bootstrapper.service: Consumed 1min 51.573s CPU time.
2023-11-20T13:24:11Z systemd[1]: Started Service for snap application anbox-cloud-appliance.bootstrapper.
2023-11-20T13:24:13Z anbox-cloud-appliance.bootstrapper[18556]: ERROR: Bootstrap has previously failed, not running again
2023-11-20T13:24:13Z anbox-cloud-appliance.bootstrapper[18574]: Removed /etc/systemd/system/multi-user.target.wants/snap.anbox-cloud-appliance.bootstrapper.service.
2023-11-20T13:24:14Z systemd[1]: snap.anbox-cloud-appliance.bootstrapper.service: Deactivated successfully.
2023-11-20T13:24:14Z systemd[1]: snap.anbox-cloud-appliance.bootstrapper.service: Consumed 1.966s CPU time.

# Juju Status

ERROR No controllers registered.

Please either create a new controller using "juju bootstrap" or connect to
another controller that you have been given access to using "juju register".

n/a
Error: Get "http://unix/1.0/config": dial unix /var/snap/amc/common/server/unix.socket: connect: no such file or directory
Error: failed to retrieve nodes from AMS: Get "http://unix/1.0/nodes?recursion=1": dial unix /var/snap/amc/common/server/unix.socket: connect: no such file or directory
Error: failed to retrieve instances from AMS: Get "http://unix/1.0/containers?recursion=1": dial unix /var/snap/amc/common/server/unix.socket: connect: no such file or directory
Error: failed to retrieve applications from AMS: Get "http://unix/1.0/applications?recursion=1": dial unix /var/snap/amc/common/server/unix.socket: connect: no such file or directory
Error: failed to retrieve addons from AMS: Get "http://unix/1.0/addons?recursion=1": dial unix /var/snap/amc/common/server/unix.socket: connect: no such file or directory
Error: failed to retrieve tasks from AMS: Get "http://unix/1.0/tasks?recursion=1": dial unix /var/snap/amc/common/server/unix.socket: connect: no such file or directory
Error: failed to retrieve operations from AMS: Get "http://unix/1.0/operations?recursion=1": dial unix /var/snap/amc/common/server/unix.socket: connect: no such file or directory

# AMS config

# AMS Nodes

# AMS Containers

# AMS Applications

# AMS Addons

# AMS Tasks

# AMS Operations

Error: failed to retrieve nodes from AMS: Get "http://unix/1.0/nodes?recursion=1": dial unix /var/snap/amc/common/server/unix.socket: connect: no such file or directory
Error: failed to retrieve applications from AMS: Get "http://unix/1.0/applications?recursion=1": dial unix /var/snap/amc/common/server/unix.socket: connect: no such file or directory
Error: failed to retrieve addons from AMS: Get "http://unix/1.0/addons?recursion=1": dial unix /var/snap/amc/common/server/unix.socket: connect: no such file or directory
Error: failed to retrieve instances from AMS: Get "http://unix/1.0/containers?recursion=1": dial unix /var/snap/amc/common/server/unix.socket: connect: no such file or directory
Error: Network ACL not found
Error: Failed loading network: Network not found
/snap/anbox-cloud-appliance/492/bin/buginfo.sh: line 142: /usr/sbin/zpool: No such file or directory
# LXD containers

+------+-------+------+------+------+-----------+----------+
| NAME | STATE | IPV4 | IPV6 | TYPE | SNAPSHOTS | LOCATION |
+------+-------+------+------+------+-----------+----------+

# LXD storage

+------+--------+-------------+---------+---------+
| NAME | DRIVER | DESCRIPTION | USED BY |  STATE  |
+------+--------+-------------+---------+---------+
| data | zfs    |             | 4       | CREATED |
+------+--------+-------------+---------+---------+

# LXD networks

+---------+----------+---------+------+------+-------------+---------+---------+
|  NAME   |   TYPE   | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY |  STATE  |
+---------+----------+---------+------+------+-------------+---------+---------+
| ens3    | physical | NO      |      |      |             | 0       |         |
+---------+----------+---------+------+------+-------------+---------+---------+
| lxdfan0 | bridge   | YES     |      |      |             | 1       | CREATED |
+---------+----------+---------+------+------+-------------+---------+---------+

# LXD Cluster

# LXD Network ACLs

n/a

# LXD Network forwards

n/a

# LXD resources

CPU (x86_64):
  Vendor: AuthenticAMD
  Name: AMD EPYC 7551 32-Core Processor
  Caches:
    - Level 1 (type: Data): 64KiB
    - Level 1 (type: Instruction): 64KiB
    - Level 2 (type: Unified): 512KiB
    - Level 3 (type: Unified): 16MiB
  Cores:
    - Core 0
      Frequency: 0Mhz
      Threads:
        - 0 (id: 0, online: true, NUMA node: 0)
        - 1 (id: 1, online: true, NUMA node: 0)

Memory:
  Free: 515.22MiB
  Used: 508.78MiB
  Total: 1.00GiB

GPU:
  NUMA node: 0
  PCI address: 0000:00:02.0
  Driver: bochs-drm (5.15.0-1047-oracle)
  DRM:
    ID: 0
    Card: card0 (226:0)
    Control: controlD64 (226:0)

NIC:
  NUMA node: 0
  Vendor: Oracle/SUN (108e)
  Product: EBUS (0001)
  PCI address: 0000:00:03.0
  Driver: virtio_net (5.15.0-1047-oracle)
  Ports:
    - Port 0 (ethernet)
      ID: ens3
      Address: 02:00:17:01:69:5e
      Port type: other
      Transceiver type: internal
      Auto negotiation: false
      Link detected: true

Disk:
  NUMA node: 0
  ID: sda
  Device: 8:0
  Model: BlockVolume
  Type: scsi
  Size: 100.00GiB
  Read-Only: false
  Removable: false
  Partitions:
    - Partition 1
      ID: sda1
      Device: 8:1
      Read-Only: false
      Size: 99.89GiB
    - Partition 14
      ID: sda14
      Device: 8:14
      Read-Only: false
      Size: 4.00MiB
    - Partition 15
      ID: sda15
      Device: 8:15
      Read-Only: false
      Size: 106.00MiB

# Zpool status

n/a

Thank you for your time.

Cya.

Revision history for this message

Simon Fels (morphis) wrote on 2023-11-23:

So something is still blocking network traffic to LXD on port 8443:

ERROR failed to bootstrap model: cannot start bootstrap instance in availability zone "lxd0": write tcp 10.0.0.33:41174->10.0.0.33:8443: i/o timeout

Can you give us the output of

$ sudo iptables -S
$ sudo iptables -S -t nat

Thanks!

Simon Fels (morphis) on 2024-04-08

Changed in anbox-cloud:
assignee:	Simon Fels (morphis) → nobody

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Bug attachments

ports.jpg Edit

Add attachment

Remote bug watches

Bug watches keep track of this bug in other bug trackers.