Comment 2 for bug 1959582

I quickly looked at logs from the https://logserver.rdoproject.org/74/36374/10/check/periodic-tripleo-ci-centos-9-scenario007-multinode-oooq-container-wallaby/5ec80b4/logs/subnode-1/var/log/extra/errors.txt.gz and IMO the main problem is that haproxy isn't started, so there is no metadata service for instances and ssh-keys aren't configured. The error is:

ERROR neutron.agent.linux.utils [-] Exit code: 127; Cmd: ['ip', 'netns', 'exec', 'qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c', 'haproxy', '-f', '/var/lib/neutron/ns-metadata-proxy/eb9ccbd6-99fb-4bb8-8753-17596910505c.conf']; Stdin: ; Stdout: Starting a new child container neutron-haproxy-qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c
; Stderr: + export DOCKER_HOST=
+ DOCKER_HOST=
+ ARGS='-f /var/lib/neutron/ns-metadata-proxy/eb9ccbd6-99fb-4bb8-8753-17596910505c.conf'
++ ip netns identify
+ NETNS=qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c
+ NAME=neutron-haproxy-qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c
+ HAPROXY_CMD='$(if [ -f /usr/sbin/haproxy-systemd-wrapper ]; then echo "/usr/sbin/haproxy -Ds"; else echo "/usr/sbin/haproxy -Ws"; fi)'
+ CLI='nsenter --net=/run/netns/qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c --preserve-credentials -m -t 1 podman'
+ LOGGING='--log-driver k8s-file --log-opt path=/var/log/containers/stdouts/neutron-haproxy-qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c.log'
+ CMD='$HAPROXY'
++ nsenter --net=/run/netns/qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c --preserve-credentials -m -t 1 podman ps -a --filter name=neutron-haproxy- --format '{{.ID}}:{{.Names}}:{{.Status}}'
++ awk '{print $1}'
+ LIST=
++ printf '%s\n' ''
++ grep -E ':(Exited|Created)'
+ ORPHANTS=
+ '[' -n '' ']'
+ printf '%s\n' ''
+ grep -q 'neutron-haproxy-qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c$'
+ echo 'Starting a new child container neutron-haproxy-qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c'
+ nsenter --net=/run/netns/qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c --preserve-credentials -m -t 1 podman run --detach --log-driver k8s-file --log-opt path=/var/log/containers/stdouts/neutron-haproxy-qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c.log -v /var/lib/config-data/puppet-generated/neutron/etc/neutron:/etc/neutron:ro -v /run/netns:/run/netns:shared -v /var/lib/neutron:/var/lib/neutron:shared -v /dev/log:/dev/log --net host --pid host --cgroupns host --privileged -u root --name neutron-haproxy-qrouter-eb9ccbd6-99fb-4bb8-8753-17596910505c 192.168.24.1:8787/tripleowallabycentos9/openstack-neutron-l3-agent:cf2d49f44be13a2a4df3c6228451f6b2-updated-20220128155406 /bin/bash -c 'HAPROXY="$(if [ -f /usr/sbin/haproxy-systemd-wrapper ]; then echo "/usr/sbin/haproxy -Ds"; else echo "/usr/sbin/haproxy -Ws"; fi)"; exec $HAPROXY -f /var/lib/neutron/ns-metadata-proxy/eb9ccbd6-99fb-4bb8-8753-17596910505c.conf'
Error: create directory `/sys/fs/cgroup/../../libpod-07d282785cdd79c7c62a030b8a84fbe68bf7ca0b54a49714bd72cff05c9edf63.scope`: No such file or directory: OCI runtime attempted to invoke a command that was not found