I installed OpenStack with kolla-ansible, all containers are healthy except neutron_server suspended in 'health: starting' state. Below I include:
- main information on the environment and the setup (incl. globals and multinode snippets),
- HttpException: 503 message from running init-runonce,
- docker ps -a from the control node and
- neutron_server: inspect results and log
- attachments: complete files as above
Not sure whether this misbehavior results from bad configurations by me or has another cause. Contacted folks from OpenStack and they do not see clear error symptoms and suggest a problem with deployment.
=================================================
General info
=================================================
The setup is on a Raspberry Pi cluster with 4 Pis (2x4GB RAM + 2x8GB RAM).
Among others, each Pi was configured with $ sudo apt-get install -y qemu-kvm.
=================================================
Environment (from a Raspberry Pi host)
=================================================
* OS (e.g. from /etc/os-release):
ubuntu@ost64:~$ cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
NAME="Debian GNU/Linux"
VERSION_ID="11"
VERSION="11 (bullseye)"
VERSION_CODENAME=bullseye
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
* Kernel (e.g. `uname -a`):
ubuntu@ost64:~$ uname -a
Linux ost64 5.10.0-20-arm64 #1 SMP Debian 5.10.158-2 (2022-12-13) aarch64 GNU/Linux
* Docker version if applicable (e.g. `docker version`):
ubuntu@ost64:~$ sudo docker version
Client: Docker Engine - Community
Version: 24.0.7
API version: 1.43
Go version: go1.20.10
Git commit: afdd53b
Built: Thu Oct 26 09:08:29 2023
OS/Arch: linux/arm64
Context: default
Server: Docker Engine - Community
Engine:
Version: 24.0.7
API version: 1.43 (minimum version 1.12)
Go version: go1.20.10
Git commit: 311b9ff
Built: Thu Oct 26 09:08:29 2023
OS/Arch: linux/arm64
Experimental: false
containerd:
Version: 1.6.24
GitCommit: 61f9fd88f79f081d64d6fa3bb1a0dc71ec870523
runc:
Version: 1.1.9
GitCommit: v1.1.9-0-gccaecfc
docker-init:
Version: 0.19.0
GitCommit: de40ad0
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release):
pip install -U 'ansible>=4,<6'
pip install git+https://opendev.org/openstack/kolla-ansible@stable/zed
* Docker image Install type (source/binary): binary
* Docker image distribution: quay.io, zed-debian-bullseye-aarch64, e.g.
changed: [ost64] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'quay.io/openstack.kolla/fluentd:zed-debian-bullseye-aarch64', 'environment>
* Are you using official images from Docker Hub or self built?
I assume they are from quay (see above).
* Share your inventory file, globals.yml and other configuration files if relevant
see below
=================================================
Basic settings in globals.yml
=================================================
(remaining settings are default, in particular: #neutron_plugin_agent: "openvswitch")
kolla_base_distro: "debian"
#openstack_release: "zed" <==== kolla-ansible has been generated for zed
openstack_tag_suffix: "-aarch64"
kolla_internal_vip_address: "192.168.1.60" <==== ping 192.168.1.60 works well
network_interface: "veth0"
neutron_external_interface: "veth1"
enable_neutron_provider_networks: "yes"
#nova_compute_virt_type: "kvm" <===== default (kvm) is left
================================================
Basic settings in multinode
================================================
(remaining settings are untouched - set to default)
# These initial groups are the only groups required to be modified. The
# additional groups are for more control of the environment.
[control]
# These hostname must be resolvable from your deployment host
#control01
#control02
#control03
ost64 ansible_user=ubuntu ansible_password=ubuntu ansible_become=true
# The above can also be specified as follows:
#control[01:03] ansible_user=kolla
# The network nodes are where your l3-agent and loadbalancers will run
# This can be the same as a host in the control group
[network]
#network01
#network02
ost64
[compute]
#compute01
ost[61:63] ansible_user=ubuntu ansible_password=ubuntu ansible_become=true
ost64
[monitoring]
ost64
# When compute nodes and control nodes use different interfaces,
# you need to comment out "api_interface" and other interfaces from the globals.yml
# and specify like below:
#compute01 neutron_external_interface=eth0 api_interface=em1 tunnel_interface=em1
[storage]
#storage01
#ost61
[deployment]
localhost ansible_connection=local
================================================
Host networking setup
================================================
The host network setup on the Pis is as follows.
Shown is the mapping onto kolla-ansible interfaces.
veth0/1 are ports from veth pairs intended to mimic phy ports to kolla.
(I planned to use this setup for teaching purposes for students.)
network-interface neutron_external_interface
192.168.1.6x/24 (x=1,2,3,4)
+---------+ +---------+
| veth0--| | veth1--|
+---------+ +---------+
| veth pairs |
+---------+ +---------+
| veth0br | | veth1br |
+---------+ +---------+
+-┴-----------------┴-+
|--------brmux--------|
+----------┬----------+
+---------+
| eth0 | <==== physical NIC of raspberry pi
+---------+
ml2_conf.ini is configured as follows
-------------------------------------
(vlans enabled just for any case)
$ sudo tee /etc/kolla/config/neutron/ml2_conf.ini << EOT
[ml2]
type_drivers = flat,vlan
tenant_network_types = vxlan
[ml2_type_vlan]
network_vlan_ranges = physnet1:100:200
[ml2_type_flat]
flat_networks = physnet1
EOT
=================================================
Message from init-runonce on the kolla-nsible node
=================================================
(Note: cirros image has been stored successfully in glance and is reported as 'active' by openstack image list.)
...
Configuring neutron.
HttpException: 503: Server Error for url: http://192.168.1.60:9696/v2.0/routers, No server is available to handle this request.: 503 Service Unavailable
=================================================================================
sudo docker ps -a on the control node
=================================================================================
ubuntu@ost64:~$ sudo docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
4f6598955a8d quay.io/openstack.kolla/horizon:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) horizon
77802d295317 quay.io/openstack.kolla/heat-engine:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) heat_engine
23dcd7083007 quay.io/openstack.kolla/heat-api-cfn:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) heat_api_cfn
3c7d7fb7dd85 quay.io/openstack.kolla/heat-api:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) heat_api
86420274224a quay.io/openstack.kolla/neutron-metadata-agent:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) neutron_metadata_agent
98a0f60fe048 quay.io/openstack.kolla/neutron-l3-agent:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) neutron_l3_agent
359fce2450aa quay.io/openstack.kolla/neutron-dhcp-agent:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) neutron_dhcp_agent
4c5e18147b87 quay.io/openstack.kolla/neutron-openvswitch-agent:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) neutron_openvswitch_agent
b5218aa4fb46 quay.io/openstack.kolla/neutron-server:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 8 seconds (health: starting) neutron_server
aed0c1ec47a4 quay.io/openstack.kolla/openvswitch-vswitchd:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) openvswitch_vswitchd
463c6e360b8d quay.io/openstack.kolla/openvswitch-db-server:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) openvswitch_db
a53f653df1d1 quay.io/openstack.kolla/nova-compute:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) nova_compute
ce794c8d037c quay.io/openstack.kolla/nova-libvirt:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) nova_libvirt
16285faf8013 quay.io/openstack.kolla/nova-ssh:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) nova_ssh
c1e51c6bff9d quay.io/openstack.kolla/nova-novncproxy:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) nova_novncproxy
ca27ffc8d401 quay.io/openstack.kolla/nova-conductor:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) nova_conductor
2ca934ee1aa6 quay.io/openstack.kolla/nova-api:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) nova_api
f168dc3cc91f quay.io/openstack.kolla/nova-scheduler:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) nova_scheduler
690628e6cdb9 quay.io/openstack.kolla/placement-api:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) placement_api
b2676ebcc73a quay.io/openstack.kolla/glance-api:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) glance_api
2d5e935b8d4c quay.io/openstack.kolla/keystone:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) keystone
7a76f857056e quay.io/openstack.kolla/keystone-fernet:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) keystone_fernet
75c27f2df24f quay.io/openstack.kolla/keystone-ssh:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) keystone_ssh
ecbe00610982 quay.io/openstack.kolla/rabbitmq:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) rabbitmq
bfe9f55e263a quay.io/openstack.kolla/memcached:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) memcached
86a6a9a81e8d quay.io/openstack.kolla/mariadb-clustercheck:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours mariadb_clustercheck
b377bd08e204 quay.io/openstack.kolla/mariadb-server:zed-debian-bullseye-aarch64 "dumb-init -- kolla_…" 4 hours ago Up 4 hours (healthy) mariadb
13c6eef85c13 quay.io/openstack.kolla/keepalived:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours keepalived
5f0939c125a8 quay.io/openstack.kolla/haproxy:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours (healthy) haproxy
8539f6ebdc7a quay.io/openstack.kolla/cron:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours cron
1fbe92f1c594 quay.io/openstack.kolla/kolla-toolbox:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours kolla_toolbox
444b3c2dd8b7 quay.io/openstack.kolla/fluentd:zed-debian-bullseye-aarch64 "dumb-init --single-…" 4 hours ago Up 4 hours fluentd
=================================================================================
Log form neutron_server container (opening part of the log and ... the last part of the log)
=================================================================================
{"log":"+ sudo -E kolla_set_configs\n","stream":"stderr","time":"2023-10-31T18:58:44.491606457Z"}
{"log":"INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json\n","stream":"stderr","time":"2023-10-31T18:58:44.781314078Z"}
{"log":"INFO:__main__:Validating config file\n","stream":"stderr","time":"2023-10-31T18:58:44.78187322Z"}
{"log":"INFO:__main__:Kolla config strategy set to: COPY_ALWAYS\n","stream":"stderr","time":"2023-10-31T18:58:44.782026144Z"}
{"log":"INFO:__main__:Copying service configuration files\n","stream":"stderr","time":"2023-10-31T18:58:44.782185198Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/neutron.conf to /etc/neutron/neutron.conf\n","stream":"stderr","time":"2023-10-31T18:58:44.782813414Z"}
{"log":"INFO:__main__:Setting permission for /etc/neutron/neutron.conf\n","stream":"stderr","time":"2023-10-31T18:58:44.785475034Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/neutron_vpnaas.conf to /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T18:58:44.786046564Z"}
{"log":"INFO:__main__:Setting permission for /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T18:58:44.787184775Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/ml2_conf.ini to /etc/neutron/plugins/ml2/ml2_conf.ini\n","stream":"stderr","time":"2023-10-31T18:58:44.787827694Z"}
{"log":"INFO:__main__:Setting permission for /etc/neutron/plugins/ml2/ml2_conf.ini\n","stream":"stderr","time":"2023-10-31T18:58:44.789536231Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/id_rsa to /var/lib/neutron/.ssh/id_rsa\n","stream":"stderr","time":"2023-10-31T18:58:44.790817217Z"}
{"log":"INFO:__main__:Setting permission for /var/lib/neutron/.ssh/id_rsa\n","stream":"stderr","time":"2023-10-31T18:58:44.792049389Z"}
{"log":"INFO:__main__:Writing out command to execute\n","stream":"stderr","time":"2023-10-31T18:58:44.792345849Z"}
{"log":"INFO:__main__:Setting permission for /var/log/kolla/neutron\n","stream":"stderr","time":"2023-10-31T18:58:44.793591095Z"}
{"log":"++ cat /run_command\n","stream":"stderr","time":"2023-10-31T18:58:44.829276197Z"}
{"log":"+ CMD='neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf '\n","stream":"stderr","time":"2023-10-31T18:58:44.83282553Z"}
{"log":"+ ARGS=\n","stream":"stderr","time":"2023-10-31T18:58:44.832910732Z"}
{"log":"+ sudo kolla_copy_cacerts\n","stream":"stderr","time":"2023-10-31T18:58:44.832926473Z"}
{"log":"+ [[ ! -n '' ]]\n","stream":"stderr","time":"2023-10-31T18:58:44.860726196Z"}
{"log":"+ . kolla_extend_start\n","stream":"stderr","time":"2023-10-31T18:58:44.860819065Z"}
{"log":"++ [[ ! -d /var/log/kolla/neutron ]]\n","stream":"stderr","time":"2023-10-31T18:58:44.861096396Z"}
{"log":"+++ stat -c %a /var/log/kolla/neutron\n","stream":"stderr","time":"2023-10-31T18:58:44.862214069Z"}
{"log":"++ [[ 2755 != \\7\\5\\5 ]]\n","stream":"stderr","time":"2023-10-31T18:58:44.865821938Z"}
{"log":"++ chmod 755 /var/log/kolla/neutron\n","stream":"stderr","time":"2023-10-31T18:58:44.865909122Z"}
{"log":"++ [[ ! debian =~ centos|rocky ]]\n","stream":"stderr","time":"2023-10-31T18:58:44.869756748Z"}
{"log":"++ /usr/bin/update-alternatives --display iptables\n","stream":"stderr","time":"2023-10-31T18:58:44.869852747Z"}
{"log":"iptables - auto mode\n","stream":"stdout","time":"2023-10-31T18:58:44.872687939Z"}
{"log":" link best version is /usr/sbin/iptables-nft\n","stream":"stdout","time":"2023-10-31T18:58:44.872798845Z"}
{"log":" link currently points to /usr/sbin/iptables-nft\n","stream":"stdout","time":"2023-10-31T18:58:44.8728219Z"}
{"log":" link iptables is /usr/sbin/iptables\n","stream":"stdout","time":"2023-10-31T18:58:44.872841771Z"}
{"log":" slave iptables-restore is /usr/sbin/iptables-restore\n","stream":"stdout","time":"2023-10-31T18:58:44.872860178Z"}
{"log":" slave iptables-save is /usr/sbin/iptables-save\n","stream":"stdout","time":"2023-10-31T18:58:44.872877826Z"}
{"log":"/usr/sbin/iptables-legacy - priority 10\n","stream":"stdout","time":"2023-10-31T18:58:44.872895455Z"}
{"log":" slave iptables-restore: /usr/sbin/iptables-legacy-restore\n","stream":"stdout","time":"2023-10-31T18:58:44.87297114Z"}
{"log":" slave iptables-save: /usr/sbin/iptables-legacy-save\n","stream":"stdout","time":"2023-10-31T18:58:44.872995028Z"}
{"log":"/usr/sbin/iptables-nft - priority 20\n","stream":"stdout","time":"2023-10-31T18:58:44.87301338Z"}
{"log":" slave iptables-restore: /usr/sbin/iptables-nft-restore\n","stream":"stdout","time":"2023-10-31T18:58:44.87303088Z"}
{"log":" slave iptables-save: /usr/sbin/iptables-nft-save\n","stream":"stdout","time":"2023-10-31T18:58:44.873048509Z"}
{"log":"++ KOLLA_LEGACY_IPTABLES=false\n","stream":"stderr","time":"2023-10-31T18:58:44.873462042Z"}
{"log":"++ [[ false == \\t\\r\\u\\e ]]\n","stream":"stderr","time":"2023-10-31T18:58:44.873539171Z"}
{"log":"++ sudo /usr/bin/update-alternatives --auto iptables\n","stream":"stderr","time":"2023-10-31T18:58:44.873644818Z"}
{"log":"++ sudo /usr/bin/update-alternatives --auto ip6tables\n","stream":"stderr","time":"2023-10-31T18:58:44.914783046Z"}
{"log":"++ . /usr/local/bin/kolla_neutron_extend_start\n","stream":"stderr","time":"2023-10-31T18:58:44.937578804Z"}
{"log":"+++ [[ -n '' ]]\n","stream":"stderr","time":"2023-10-31T18:58:44.937786302Z"}
{"log":"+++ [[ -n '' ]]\n","stream":"stderr","time":"2023-10-31T18:58:44.937911208Z"}
{"log":"Running command: 'neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf '\n","stream":"stdout","time":"2023-10-31T18:58:44.938118372Z"}
{"log":"+ echo 'Running command: '\\''neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf '\\'''\n","stream":"stderr","time":"2023-10-31T18:58:44.93811978Z"}
{"log":"+ exec neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T18:58:44.938184909Z"}
{"log":"+ sudo -E kolla_set_configs\n","stream":"stderr","time":"2023-10-31T18:59:01.075096102Z"}
{"log":"INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json\n","stream":"stderr","time":"2023-10-31T18:59:01.514152342Z"}
{"log":"INFO:__main__:Validating config file\n","stream":"stderr","time":"2023-10-31T18:59:01.515088906Z"}
{"log":"INFO:__main__:Kolla config strategy set to: COPY_ALWAYS\n","stream":"stderr","time":"2023-10-31T18:59:01.51580562Z"}
{"log":"INFO:__main__:Copying service configuration files\n","stream":"stderr","time":"2023-10-31T18:59:01.517138291Z"}
{"log":"INFO:__main__:Deleting /etc/neutron/neutron.conf\n","stream":"stderr","time":"2023-10-31T18:59:01.517242198Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/neutron.conf to /etc/neutron/neutron.conf\n","stream":"stderr","time":"2023-10-31T18:59:01.517763785Z"}
{"log":"INFO:__main__:Setting permission for /etc/neutron/neutron.conf\n","stream":"stderr","time":"2023-10-31T18:59:01.541589939Z"}
{"log":"INFO:__main__:Deleting /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T18:59:01.541798029Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/neutron_vpnaas.conf to /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T18:59:01.541841029Z"}
{"log":"INFO:__main__:Setting permission for /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T18:59:01.541859306Z"}
{"log":"INFO:__main__:Deleting /etc/neutron/plugins/ml2/ml2_conf.ini\n","stream":"stderr","time":"2023-10-31T18:59:01.541879288Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/ml2_conf.ini to /etc/neutron/plugins/ml2/ml2_conf.ini\n","stream":"stderr","time":"2023-10-31T18:59:01.541897898Z"}
{"log":"INFO:__main__:Setting permission for /etc/neutron/plugins/ml2/ml2_conf.ini\n","stream":"stderr","time":"2023-10-31T18:59:01.541914046Z"}
{"log":"INFO:__main__:Deleting /var/lib/neutron/.ssh/id_rsa\n","stream":"stderr","time":"2023-10-31T18:59:01.541930213Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/id_rsa to /var/lib/neutron/.ssh/id_rsa\n","stream":"stderr","time":"2023-10-31T18:59:01.542061323Z"}
{"log":"INFO:__main__:Setting permission for /var/lib/neutron/.ssh/id_rsa\n","stream":"stderr","time":"2023-10-31T18:59:01.542141285Z"}
{"log":"INFO:__main__:Writing out command to execute\n","stream":"stderr","time":"2023-10-31T18:59:01.542160118Z"}
{"log":"INFO:__main__:Setting permission for /var/log/kolla/neutron\n","stream":"stderr","time":"2023-10-31T18:59:01.542176895Z"}
{"log":"INFO:__main__:Setting permission for /var/log/kolla/neutron/neutron-openvswitch-agent.log\n","stream":"stderr","time":"2023-10-31T18:59:01.542193192Z"}
{"log":"INFO:__main__:Setting permission for /var/log/kolla/neutron/neutron-server.log\n","stream":"stderr","time":"2023-10-31T18:59:01.542209265Z"}
{"log":"++ cat /run_command\n","stream":"stderr","time":"2023-10-31T18:59:01.635996731Z"}
{"log":"+ CMD='neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf '\n","stream":"stderr","time":"2023-10-31T18:59:01.636103267Z"}
{"log":"+ ARGS=\n","stream":"stderr","time":"2023-10-31T18:59:01.636126767Z"}
{"log":"+ sudo kolla_copy_cacerts\n","stream":"stderr","time":"2023-10-31T18:59:01.636143915Z"}
{"log":"+ [[ ! -n '' ]]\n","stream":"stderr","time":"2023-10-31T18:59:01.744570947Z"}
{"log":"+ . kolla_extend_start\n","stream":"stderr","time":"2023-10-31T18:59:01.751943036Z"}
{"log":"++ [[ ! -d /var/log/kolla/neutron ]]\n","stream":"stderr","time":"2023-10-31T18:59:01.753357409Z"}
{"log":"+++ stat -c %a /var/log/kolla/neutron\n","stream":"stderr","time":"2023-10-31T18:59:01.758817166Z"}
{"log":"++ [[ 2755 != \\7\\5\\5 ]]\n","stream":"stderr","time":"2023-10-31T18:59:01.783035705Z"}
{"log":"++ chmod 755 /var/log/kolla/neutron\n","stream":"stderr","time":"2023-10-31T18:59:01.783139204Z"}
{"log":"++ [[ ! debian =~ centos|rocky ]]\n","stream":"stderr","time":"2023-10-31T18:59:01.787207531Z"}
{"log":"++ /usr/bin/update-alternatives --display iptables\n","stream":"stderr","time":"2023-10-31T18:59:01.787297123Z"}
{"log":"iptables - auto mode\n","stream":"stdout","time":"2023-10-31T18:59:01.790342164Z"}
{"log":" link best version is /usr/sbin/iptables-nft\n","stream":"stdout","time":"2023-10-31T18:59:01.790466885Z"}
{"log":" link currently points to /usr/sbin/iptables-nft\n","stream":"stdout","time":"2023-10-31T18:59:01.790489903Z"}
{"log":" link iptables is /usr/sbin/iptables\n","stream":"stdout","time":"2023-10-31T18:59:01.790505255Z"}
{"log":" slave iptables-restore is /usr/sbin/iptables-restore\n","stream":"stdout","time":"2023-10-31T18:59:01.790519737Z"}
{"log":" slave iptables-save is /usr/sbin/iptables-save\n","stream":"stdout","time":"2023-10-31T18:59:01.790535662Z"}
{"log":"/usr/sbin/iptables-legacy - priority 10\n","stream":"stdout","time":"2023-10-31T18:59:01.790549792Z"}
{"log":" slave iptables-restore: /usr/sbin/iptables-legacy-restore\n","stream":"stdout","time":"2023-10-31T18:59:01.790563884Z"}
{"log":" slave iptables-save: /usr/sbin/iptables-legacy-save\n","stream":"stdout","time":"2023-10-31T18:59:01.790578384Z"}
{"log":"/usr/sbin/iptables-nft - priority 20\n","stream":"stdout","time":"2023-10-31T18:59:01.790592402Z"}
{"log":" slave iptables-restore: /usr/sbin/iptables-nft-restore\n","stream":"stdout","time":"2023-10-31T18:59:01.790606532Z"}
{"log":" slave iptables-save: /usr/sbin/iptables-nft-save\n","stream":"stdout","time":"2023-10-31T18:59:01.790621032Z"}
{"log":"++ KOLLA_LEGACY_IPTABLES=false\n","stream":"stderr","time":"2023-10-31T18:59:01.791571429Z"}
{"log":"++ [[ false == \\t\\r\\u\\e ]]\n","stream":"stderr","time":"2023-10-31T18:59:01.791669502Z"}
{"log":"++ sudo /usr/bin/update-alternatives --auto iptables\n","stream":"stderr","time":"2023-10-31T18:59:01.791689891Z"}
{"log":"++ sudo /usr/bin/update-alternatives --auto ip6tables\n","stream":"stderr","time":"2023-10-31T18:59:01.842267001Z"}
{"log":"++ . /usr/local/bin/kolla_neutron_extend_start\n","stream":"stderr","time":"2023-10-31T18:59:01.918085825Z"}
{"log":"+++ [[ -n '' ]]\n","stream":"stderr","time":"2023-10-31T18:59:01.918197416Z"}
{"log":"+++ [[ -n '' ]]\n","stream":"stderr","time":"2023-10-31T18:59:01.91821812Z"}
{"log":"+ echo 'Running command: '\\''neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf '\\'''\n","stream":"stderr","time":"2023-10-31T18:59:01.91823349Z"}
{"log":"+ exec neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T18:59:01.918260656Z"}
{"log":"Running command: 'neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf '\n","stream":"stdout","time":"2023-10-31T18:59:01.91830973Z"}
{"log":"+ sudo -E kolla_set_configs\n","stream":"stderr","time":"2023-10-31T18:59:23.212519088Z"}
{"log":"INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json\n","stream":"stderr","time":"2023-10-31T18:59:23.46387364Z"}
.........................
....stuff continues for thousands of lines.....
.........................
{"log":"+ echo 'Running command: '\\''neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf '\\'''\n","stream":"stderr","time":"2023-10-31T22:35:55.692344373Z"}
{"log":"Running command: 'neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf '\n","stream":"stdout","time":"2023-10-31T22:35:55.692753442Z"}
{"log":"+ exec neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T22:35:55.692858108Z"}
{"log":"+ sudo -E kolla_set_configs\n","stream":"stderr","time":"2023-10-31T22:36:07.090514085Z"}
{"log":"INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json\n","stream":"stderr","time":"2023-10-31T22:36:07.271150861Z"}
{"log":"INFO:__main__:Validating config file\n","stream":"stderr","time":"2023-10-31T22:36:07.271543708Z"}
{"log":"INFO:__main__:Kolla config strategy set to: COPY_ALWAYS\n","stream":"stderr","time":"2023-10-31T22:36:07.271797928Z"}
{"log":"INFO:__main__:Copying service configuration files\n","stream":"stderr","time":"2023-10-31T22:36:07.271895982Z"}
{"log":"INFO:__main__:Deleting /etc/neutron/neutron.conf\n","stream":"stderr","time":"2023-10-31T22:36:07.272336977Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/neutron.conf to /etc/neutron/neutron.conf\n","stream":"stderr","time":"2023-10-31T22:36:07.272929489Z"}
{"log":"INFO:__main__:Setting permission for /etc/neutron/neutron.conf\n","stream":"stderr","time":"2023-10-31T22:36:07.274684653Z"}
{"log":"INFO:__main__:Deleting /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T22:36:07.275165685Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/neutron_vpnaas.conf to /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T22:36:07.275610346Z"}
{"log":"INFO:__main__:Setting permission for /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T22:36:07.276535002Z"}
{"log":"INFO:__main__:Deleting /etc/neutron/plugins/ml2/ml2_conf.ini\n","stream":"stderr","time":"2023-10-31T22:36:07.27696796Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/ml2_conf.ini to /etc/neutron/plugins/ml2/ml2_conf.ini\n","stream":"stderr","time":"2023-10-31T22:36:07.27744077Z"}
{"log":"INFO:__main__:Setting permission for /etc/neutron/plugins/ml2/ml2_conf.ini\n","stream":"stderr","time":"2023-10-31T22:36:07.278424036Z"}
{"log":"INFO:__main__:Deleting /var/lib/neutron/.ssh/id_rsa\n","stream":"stderr","time":"2023-10-31T22:36:07.278779069Z"}
{"log":"INFO:__main__:Copying /var/lib/kolla/config_files/id_rsa to /var/lib/neutron/.ssh/id_rsa\n","stream":"stderr","time":"2023-10-31T22:36:07.279450376Z"}
{"log":"INFO:__main__:Setting permission for /var/lib/neutron/.ssh/id_rsa\n","stream":"stderr","time":"2023-10-31T22:36:07.280384365Z"}
{"log":"INFO:__main__:Writing out command to execute\n","stream":"stderr","time":"2023-10-31T22:36:07.280620603Z"}
{"log":"INFO:__main__:Setting permission for /var/log/kolla/neutron\n","stream":"stderr","time":"2023-10-31T22:36:07.281863978Z"}
{"log":"INFO:__main__:Setting permission for /var/log/kolla/neutron/neutron-openvswitch-agent.log\n","stream":"stderr","time":"2023-10-31T22:36:07.282291843Z"}
{"log":"INFO:__main__:Setting permission for /var/log/kolla/neutron/neutron-metadata-agent.log\n","stream":"stderr","time":"2023-10-31T22:36:07.283614031Z"}
{"log":"INFO:__main__:Setting permission for /var/log/kolla/neutron/neutron-l3-agent.log\n","stream":"stderr","time":"2023-10-31T22:36:07.283763918Z"}
{"log":"INFO:__main__:Setting permission for /var/log/kolla/neutron/neutron-server.log\n","stream":"stderr","time":"2023-10-31T22:36:07.283789807Z"}
{"log":"INFO:__main__:Setting permission for /var/log/kolla/neutron/neutron-dhcp-agent.log\n","stream":"stderr","time":"2023-10-31T22:36:07.28380564Z"}
{"log":"++ cat /run_command\n","stream":"stderr","time":"2023-10-31T22:36:07.321341409Z"}
{"log":"+ CMD='neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf '\n","stream":"stderr","time":"2023-10-31T22:36:07.326120187Z"}
{"log":"+ ARGS=\n","stream":"stderr","time":"2023-10-31T22:36:07.326255833Z"}
{"log":"+ sudo kolla_copy_cacerts\n","stream":"stderr","time":"2023-10-31T22:36:07.326304166Z"}
{"log":"+ [[ ! -n '' ]]\n","stream":"stderr","time":"2023-10-31T22:36:07.358277295Z"}
{"log":"+ . kolla_extend_start\n","stream":"stderr","time":"2023-10-31T22:36:07.358424331Z"}
{"log":"++ [[ ! -d /var/log/kolla/neutron ]]\n","stream":"stderr","time":"2023-10-31T22:36:07.359013268Z"}
{"log":"+++ stat -c %a /var/log/kolla/neutron\n","stream":"stderr","time":"2023-10-31T22:36:07.360322253Z"}
{"log":"++ [[ 2755 != \\7\\5\\5 ]]\n","stream":"stderr","time":"2023-10-31T22:36:07.365798153Z"}
{"log":"++ chmod 755 /var/log/kolla/neutron\n","stream":"stderr","time":"2023-10-31T22:36:07.365891929Z"}
{"log":"++ [[ ! debian =~ centos|rocky ]]\n","stream":"stderr","time":"2023-10-31T22:36:07.369402Z"}
{"log":"++ /usr/bin/update-alternatives --display iptables\n","stream":"stderr","time":"2023-10-31T22:36:07.369728162Z"}
{"log":"iptables - auto mode\n","stream":"stdout","time":"2023-10-31T22:36:07.372540315Z"}
{"log":" link best version is /usr/sbin/iptables-nft\n","stream":"stdout","time":"2023-10-31T22:36:07.372638203Z"}
{"log":" link currently points to /usr/sbin/iptables-nft\n","stream":"stdout","time":"2023-10-31T22:36:07.37265648Z"}
{"log":" link iptables is /usr/sbin/iptables\n","stream":"stdout","time":"2023-10-31T22:36:07.372671425Z"}
{"log":" slave iptables-restore is /usr/sbin/iptables-restore\n","stream":"stdout","time":"2023-10-31T22:36:07.372685776Z"}
{"log":" slave iptables-save is /usr/sbin/iptables-save\n","stream":"stdout","time":"2023-10-31T22:36:07.37269985Z"}
{"log":"/usr/sbin/iptables-legacy - priority 10\n","stream":"stdout","time":"2023-10-31T22:36:07.37271385Z"}
{"log":" slave iptables-restore: /usr/sbin/iptables-legacy-restore\n","stream":"stdout","time":"2023-10-31T22:36:07.37272785Z"}
{"log":" slave iptables-save: /usr/sbin/iptables-legacy-save\n","stream":"stdout","time":"2023-10-31T22:36:07.372741776Z"}
{"log":"/usr/sbin/iptables-nft - priority 20\n","stream":"stdout","time":"2023-10-31T22:36:07.372755794Z"}
{"log":" slave iptables-restore: /usr/sbin/iptables-nft-restore\n","stream":"stdout","time":"2023-10-31T22:36:07.372769886Z"}
{"log":" slave iptables-save: /usr/sbin/iptables-nft-save\n","stream":"stdout","time":"2023-10-31T22:36:07.372783775Z"}
{"log":"++ KOLLA_LEGACY_IPTABLES=false\n","stream":"stderr","time":"2023-10-31T22:36:07.373202215Z"}
{"log":"++ [[ false == \\t\\r\\u\\e ]]\n","stream":"stderr","time":"2023-10-31T22:36:07.373258918Z"}
{"log":"++ sudo /usr/bin/update-alternatives --auto iptables\n","stream":"stderr","time":"2023-10-31T22:36:07.373275029Z"}
{"log":"++ sudo /usr/bin/update-alternatives --auto ip6tables\n","stream":"stderr","time":"2023-10-31T22:36:07.402813316Z"}
{"log":"++ . /usr/local/bin/kolla_neutron_extend_start\n","stream":"stderr","time":"2023-10-31T22:36:07.444916402Z"}
{"log":"+++ [[ -n '' ]]\n","stream":"stderr","time":"2023-10-31T22:36:07.445030623Z"}
{"log":"+++ [[ -n '' ]]\n","stream":"stderr","time":"2023-10-31T22:36:07.445049511Z"}
{"log":"+ echo 'Running command: '\\''neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf '\\'''\n","stream":"stderr","time":"2023-10-31T22:36:07.445064233Z"}
{"log":"+ exec neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf\n","stream":"stderr","time":"2023-10-31T22:36:07.445080474Z"}
{"log":"Running command: 'neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/neutron_vpnaas.conf '\n","stream":"stdout","time":"2023-10-31T22:36:07.445154288Z"}
end of the log
========================================================
docker neutron_server inspect
========================================================
[
{
"Id": "b5218aa4fb46da2890272feced28baf0a1aa1b8ef49b9a004d112dfdbd99010d",
"Created": "2023-10-31T18:58:43.689483807Z",
"Path": "dumb-init",
"Args": [
"--single-child",
"--",
"kolla_start"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 540996,
"ExitCode": 0,
"Error": "",
"StartedAt": "2023-10-31T22:58:17.842308172Z",
"FinishedAt": "2023-10-31T22:58:17.505668658Z",
"Health": {
"Status": "starting",
"FailingStreak": 0,
"Log": []
}
},
"Image": "sha256:d097ef6b754990c4029dd03d549c08ab0fc2ebbf431eaacafaa0d5b84b913a72",
"ResolvConfPath": "/var/lib/docker/containers/b5218aa4fb46da2890272feced28baf0a1aa1b8ef49b9a004d112dfdbd99010d/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/b5218aa4fb46da2890272feced28baf0a1aa1b8ef49b9a004d112dfdbd99010d/hostname",
"HostsPath": "/var/lib/docker/containers/b5218aa4fb46da2890272feced28baf0a1aa1b8ef49b9a004d112dfdbd99010d/hosts",
"LogPath": "/var/lib/docker/containers/b5218aa4fb46da2890272feced28baf0a1aa1b8ef49b9a004d112dfdbd99010d/b5218aa4fb46da2890272feced28baf0a1aa1b8ef49b9a004d112dfdbd99010d-json.log",
"Name": "/neutron_server",
"RestartCount": 246,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "docker-default",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro",
"/etc/localtime:/etc/localtime:ro",
"/etc/timezone:/etc/timezone:ro",
"kolla_logs:/var/log/kolla/:rw"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "host",
"PortBindings": null,
"RestartPolicy": {
"Name": "unless-stopped",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": null,
"DnsOptions": null,
"DnsSearch": null,
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": false,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [],
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 0,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": null,
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": null,
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 0,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": [
"/proc/asound",
"/proc/acpi",
"/proc/kcore",
"/proc/keys",
"/proc/latency_stats",
"/proc/timer_list",
"/proc/timer_stats",
"/proc/sched_debug",
"/proc/scsi",
"/sys/firmware",
"/sys/devices/virtual/powercap"
],
"ReadonlyPaths": [
"/proc/bus",
"/proc/fs",
"/proc/irq",
"/proc/sys",
"/proc/sysrq-trigger"
]
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/560561e4d51fb6482aa34314bae8aa532b27734eb5815eb07f06abb44a4100fd-init/diff:/var/lib/docker/overlay2/15224860fb636911465e8baff33408e1d17a920cc5bb1b6955246708e148a6ff/diff:/var/lib/docker/overlay2/f244938b6f53e514f674cf5f0303c94d54115dfd13a1d7720dfcb6c202f051e6/diff:/var/lib/docker/overlay2/f3133fb15439722012334e3ddd7f76d79983fc59cd5f3e031031914df605c14c/diff:/var/lib/docker/overlay2/eb61ae8e99f0109763348b5ad90ec6847df67f1801ec1ee348c5c7bba65020e6/diff:/var/lib/docker/overlay2/68dc0ea4adeebc4c764f468fce9b6eacda7a795d5a334e326e789e2f30ee98fc/diff:/var/lib/docker/overlay2/172321c830276e500ed50fd5fdae5e44232e5cd28dbdd072463efb3f34d086a8/diff:/var/lib/docker/overlay2/d564a1a45f8c15ec24037069e17acd125f5e96b2df311672f8b2ffc9f30f964e/diff:/var/lib/docker/overlay2/338a733976241a4c436ca90176143bce27cd3ea56a462cf6c10133fdac002562/diff:/var/lib/docker/overlay2/13fcdcc8fc7c2c81a9af68fdd36318ec02c6351954d9cd6851de1a72300ac097/diff:/var/lib/docker/overlay2/340d519954bceb244b3dc978352da5d369c5245228ca7dce9688d473a867f7db/diff:/var/lib/docker/overlay2/78a0ae50090135d39c4c8a0c35f96789fcc86a977df5604a4a8ed6a7373560a1/diff:/var/lib/docker/overlay2/879d257aede7a830209215e8ac11f801c14da16269e8e723bfebf88fca62ee83/diff:/var/lib/docker/overlay2/1a9f1e25d394956cf6c68908f07ee7bd59b2c271285245b9ca6107c94763714a/diff:/var/lib/docker/overlay2/6b950d4cd3a64d20e4b5ebb6c7b4dd0f9e6c47e023346de901398056bfa96ca0/diff:/var/lib/docker/overlay2/9cec9250342cc122993c611e3d5909421f7221d2ca89955bfe00d1b71bb19373/diff:/var/lib/docker/overlay2/ae43fb1205d5a5bee91f1f08ddcccfd478fad52a62dca41277d40b545ec777bc/diff:/var/lib/docker/overlay2/90d620d32e51147cacaf64e4990503f752c59cbba0a2e6ad69d1b8196501fee7/diff:/var/lib/docker/overlay2/e63e0f8b4e422134817e1164d5e802acf5f8ea1d495533c17d4efada9998cbed/diff:/var/lib/docker/overlay2/7ef69a2fd38fae3c5918377dbde977de9fd11c8b0579ed04086bc897555d3608/diff:/var/lib/docker/overlay2/a95842230cd5e2a62e82b8975de9065ba2fdb4e94139d2cc0172dfe347eb0d07/diff:/var/lib/docker/overlay2/373b164ba59f23ce9ce4409074f78f56409241a0433639708ebc8fe365b2bab3/diff:/var/lib/docker/overlay2/f4ddfd27106a726e8aa210f4132a3dbee39eb1015783c0cae37300f5c2fdc88a/diff:/var/lib/docker/overlay2/f288dbabfa9aa662f212d00365fb00b04c10d78a858aa17e98fe14215dbca094/diff:/var/lib/docker/overlay2/b9b728f95c62697721fb6643b5d0890131fe4c6c8a757b1c1adadbca83db2ed4/diff:/var/lib/docker/overlay2/e8081319b08a29987f59001330d18d54952963ed611ad8171a13b3daa3f4032b/diff:/var/lib/docker/overlay2/aedae95b7f54056fd96b9edb7b519235cebe42b6e4c3a6486c9f63ecaba3618f/diff:/var/lib/docker/overlay2/5414b6a3e28e72940f6caae4be667bf5a437662a4ddbb1c0ddf5d0c4913db6c0/diff:/var/lib/docker/overlay2/de30697a0a1140219fc47a28906e847e048af660042c3418d178700b353d6ab4/diff:/var/lib/docker/overlay2/ddad4f982b2654e5ff8f8e13cc39a4ad1172716e2545d607494dffd8056c9cb8/diff:/var/lib/docker/overlay2/1523697617a63127db8d447f79b7d25b23b51e6cd2d27a057253d07594167e6f/diff:/var/lib/docker/overlay2/849eb299a6c779f2ad9c576f10bf82ac2f15b0c2931e490d749047dca779215d/diff:/var/lib/docker/overlay2/f97e2376bb445ebd6538589b3af6a4c2a287723ea36e2368c76b46c1e05f1fd4/diff:/var/lib/docker/overlay2/e2c75f1eb33e325253720cb89230f9531dfb601699de1a66b51d9b8bc9a63f64/diff:/var/lib/docker/overlay2/95b4a12702b6d1bb3e12c513e5b08cdb89de3d5c3a6b4e634f08721ba3e591aa/diff:/var/lib/docker/overlay2/9cfcb5882cfaad59014973d94c5ad9f5d8c7f58d0552a45a14ca23a5a7129324/diff:/var/lib/docker/overlay2/39e9af1061f1aa248c166980614a1b73ec381e7227aa9cb63e00074ec2596cea/diff:/var/lib/docker/overlay2/f294142a78ba284eeb64bb90ea58de64205481fb4866327631afa34430b26d80/diff:/var/lib/docker/overlay2/5b2bffebaf685feb81ce6ec96887e7b989de8f370be2b489108eb218f9a5f35a/diff:/var/lib/docker/overlay2/ee4d48e44b15faa80c6bb3dd671a88ac7746e6d1f723b44392eb8e3722dd57fe/diff:/var/lib/docker/overlay2/c67bdd46f6039f9f15d3257ae30b65f1be01ddeff337a617d224e4114996c2de/diff:/var/lib/docker/overlay2/e7a6f65ecb1c925d9fcd4c04ff5d03cdeaaf4077351ee88bad823ba5d4f25d71/diff:/var/lib/docker/overlay2/5de34ea84b3352c1f2a0fe12c5fb8a3b35fc30d58c4978c700fa246ec3d15e5a/diff:/var/lib/docker/overlay2/055fbef7a1493b73fa1ae3ece940aeb9ffe0fa1457af41abb0e739a0b89beab6/diff",
"MergedDir": "/var/lib/docker/overlay2/560561e4d51fb6482aa34314bae8aa532b27734eb5815eb07f06abb44a4100fd/merged",
"UpperDir": "/var/lib/docker/overlay2/560561e4d51fb6482aa34314bae8aa532b27734eb5815eb07f06abb44a4100fd/diff",
"WorkDir": "/var/lib/docker/overlay2/560561e4d51fb6482aa34314bae8aa532b27734eb5815eb07f06abb44a4100fd/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/etc/kolla/neutron-server",
"Destination": "/var/lib/kolla/config_files",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "bind",
"Source": "/etc/localtime",
"Destination": "/etc/localtime",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "bind",
"Source": "/etc/timezone",
"Destination": "/etc/timezone",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "kolla_logs",
"Source": "/var/lib/docker/volumes/kolla_logs/_data",
"Destination": "/var/log/kolla",
"Driver": "local",
"Mode": "rw",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "ost64",
"Domainname": "",
"User": "neutron",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"Tty": false,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"KOLLA_CONFIG_STRATEGY=COPY_ALWAYS",
"KOLLA_SERVICE_NAME=neutron-server",
"PATH=/var/lib/kolla/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
"LANG=en_US.UTF-8",
"KOLLA_BASE_DISTRO=debian",
"KOLLA_DISTRO_PYTHON_VERSION=3.9",
"KOLLA_BASE_ARCH=aarch64",
"PS1=$(tput bold)($(printenv KOLLA_SERVICE_NAME))$(tput sgr0)[$(id -un)@$(hostname -s) $(pwd)]$ ",
"DEBIAN_FRONTEND=noninteractive",
"PIP_INDEX_URL=",
"PIP_TRUSTED_HOST=",
"PIP_EXTRA_INDEX_URL="
],
"Cmd": [
"kolla_start"
],
"Healthcheck": {
"Test": [
"CMD-SHELL",
"healthcheck_curl http://192.168.1.64:9696"
],
"Interval": 30000000000,
"Timeout": 30000000000,
"StartPeriod": 5000000000,
"Retries": 3
},
"Image": "quay.io/openstack.kolla/neutron-server:zed-debian-bullseye-aarch64",
"Volumes": {
"/etc/localtime": {},
"/etc/timezone": {},
"/var/lib/kolla/config_files/": {},
"/var/log/kolla/": {}
},
"WorkingDir": "",
"Entrypoint": [
"dumb-init",
"--single-child",
"--"
],
"OnBuild": null,
"Labels": {
"build-date": "20231030",
"kolla_version": "15.2.1",
"maintainer": "Kolla Project (https://launchpad.net/kolla)",
"name": "neutron-server"
}
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "35db3f04556f345b8a6c4cc1eb975fde72187b6a1e452b4ac8fa1c84a6467c29",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {},
"SandboxKey": "/var/run/docker/netns/default",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"host": {
"IPAMConfig": null,
"Links": null,
"Aliases": null,
"NetworkID": "202f0885c9fd7cdaaa790d8b2531e850983ac3e4829d804c2becb829f56d2bfe",
"EndpointID": "d57c2ba28ae89b38107afa7e07959e818efbad9df4afb800801044edaca2385c",
"Gateway": "",
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "",
"DriverOpts": null
}
}
}
}
]
Hello, can you aleo post contents of /var/log/