STX-Openstack apply failed on the openvswitch helm release

[Lucas de Ataides Barreto]

Brief Description
-----------------
The STX-Openstack app is failing to apply on the openvswitch helm release chart.

Severity
--------
Critical: System/Feature is not usable after the defect

Steps to Reproduce
------------------
Apply STX-Openstack

Expected Behavior
------------------
App applies

Actual Behavior
----------------
App fails to apply on the openvswitch chart

Reproducibility
---------------
Seen once

System Configuration
--------------------
Bare metal AIO-DX

Branch/Pull Time/Commit
-----------------------
https://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/20230714T060000Z/

Last Pass
---------
Last STX-Openstack sanity: https://lists.starlingx.io/pipermail/starlingx-discuss/2023-July/014276.html

Timestamp/Logs
--------------
Events:
  Type     Reason             Age                From               Message
  ----     ------             ----               ----               -------
  Normal   Scheduled          49m                default-scheduler  Successfully assigned openstack/openvswitch-vswitchd-87jsn to controller-1
  Normal   Created            49m                kubelet            Created container init
  Normal   Started            49m                kubelet            Started container init
  Normal   Pulled             49m                kubelet            Container image "registry.local:9001/quay.io/airshipit/kubernetes-entrypoint:v1.0.0" already present on machine
  Normal   Pulled             47m                kubelet            Container image "registry.local:9001/docker.io/starlingx/stx-ovs:master-debian-stable-20230714T060000Z.0" already present on machine
  Normal   Created            47m                kubelet            Created container openvswitch-vswitchd-modules
  Normal   Started            47m                kubelet            Started container openvswitch-vswitchd-modules
  Normal   Killing            47m (x2 over 47m)  kubelet            FailedPostStartHook
  Warning  FailedPreStopHook  47m (x2 over 47m)  kubelet            Exec lifecycle hook ([/tmp/openvswitch-vswitchd.sh stop]) for Container "openvswitch-vswitchd" in Pod "openvswitch-vswitchd-87jsn_openstack(19eb7d02-e74d-4296-8a85-3d4641c3617f)" failed - error: command '/tmp/openvswitch-vswitchd.sh stop' exited with 1: + COMMAND=stop
+ OVS_SOCKET=/run/openvswitch/db.sock
+ OVS_PID=/run/openvswitch/ovs-vswitchd.pid
+ stop
++ cat /run/openvswitch/ovs-vswitchd.pid
cat: /run/openvswitch/ovs-vswitchd.pid: No such file or directory
+ PID=
, message: "+ COMMAND=stop\n+ OVS_SOCKET=/run/openvswitch/db.sock\n+ OVS_PID=/run/openvswitch/ovs-vswitchd.pid\n+ stop\n++ cat /run/openvswitch/ovs-vswitchd.pid\ncat: /run/openvswitch/ovs-vswitchd.pid: No such file or directory\n+ PID=\n"
  Normal   Pulled               47m (x3 over 47m)  kubelet  Container image "registry.local:9001/docker.io/starlingx/stx-ovs:master-debian-stable-20230714T060000Z.0" already present on machine
  Warning  FailedPostStartHook  47m (x3 over 47m)  kubelet  Exec lifecycle hook ([/tmp/openvswitch-vswitchd.sh poststart]) for Container "openvswitch-vswitchd" in Pod "openvswitch-vswitchd-87jsn_openstack(19eb7d02-e74d-4296-8a85-3d4641c3617f)" failed - error: command '/tmp/openvswitch-vswitchd.sh poststart' exited with 1: + COMMAND=poststart
+ OVS_SOCKET=/run/openvswitch/db.sock
+ OVS_PID=/run/openvswitch/ovs-vswitchd.pid
+ poststart
++ cat /run/openvswitch/ovs-vswitchd.pid
cat: /run/openvswitch/ovs-vswitchd.pid: No such file or directory
+ PID=
, message: "+ COMMAND=poststart\n+ OVS_SOCKET=/run/openvswitch/db.sock\n+ OVS_PID=/run/openvswitch/ovs-vswitchd.pid\n+ poststart\n++ cat /run/openvswitch/ovs-vswitchd.pid\ncat: /run/openvswitch/ovs-vswitchd.pid: No such file or directory\n+ PID=\n"
  Normal   Started  47m (x3 over 47m)      kubelet  Started container openvswitch-vswitchd
  Normal   Created  47m (x3 over 47m)      kubelet  Created container openvswitch-vswitchd
  Warning  BackOff  4m25s (x228 over 47m)  kubelet  Back-off restarting failed container

Test Activity
-------------
Sanity

Workaround
----------
N/A

[Ghada Khalil (gkhalil)]

screening: marking as stx.9.0 / high as this is causing the stx-openstack sanity to fail

[Thales Elero Cervi (tcervi)]

Fix already merged (launchpad is not updating automatically):
https://review.opendev.org/c/starlingx/integ/+/888781