OVN 22.04.0 - test failures

[James Page]

## ------------------------ ##
## Summary of the failures. ##
## ------------------------ ##
Failed tests:
ovn 21.12.0 test suite test groups:

 NUM: FILE-NAME:LINE TEST-GROUP-NAME
      KEYWORDS

 634: ovn.at:26372 multi-vtep SB Chassis encap updates -- ovn-northd -- dp-groups=yes
 635: ovn.at:26372 multi-vtep SB Chassis encap updates -- ovn-northd -- dp-groups=no

## ---------------------- ##
## Detailed failed tests. ##
## ---------------------- ##

# -*- compilation -*-
634. ovn.at:26372: testing multi-vtep SB Chassis encap updates -- ovn-northd -- dp-groups=yes ...
creating ovn-sb database
ovsdb-server -vjsonrpc --remote=punix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0634/ovn-sb/ovn-sb.sock --remote=db:OVN_Southbound,SB_Global,connections --private-key=/<<PKGBUILDDIR>>/tests/testpki-test-privkey.pem --certificate=/<<PKGBUILDDIR>>/tests/testpki-test-cert.pem --ca-cert=/<<PKGBUILDDIR>>/tests/testpki-cacert.pem /<<PKGBUILDDIR>>/tests/testsuite.dir/0634/ovn-sb/ovn-sb.db -vconsole:off --detach --no-chdir --pidfile --log-file
creating ovn-nb database
ovsdb-server -vjsonrpc --remote=punix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0634/ovn-nb/ovn-nb.sock /<<PKGBUILDDIR>>/tests/testsuite.dir/0634/ovn-nb/ovn-nb.db -vconsole:off --detach --no-chdir --pidfile --log-file
starting northd
ovn-northd -vjsonrpc --ovnnb-db=unix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0634/ovn-nb/ovn-nb.sock --ovnsb-db=unix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0634/ovn-sb/ovn-sb.sock -vconsole:off --detach --no-chdir --pidfile --log-file
starting northd-backup
ovn-northd -vjsonrpc --ovnnb-db=unix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0634/ovn-nb/ovn-nb.sock --ovnsb-db=unix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0634/ovn-sb/ovn-sb.sock -vconsole:off --detach --no-chdir --pidfile --log-file
fdbd4d33-c8f2-4512-a971-708e06073f33
ovn-macros.at:234: waiting until TCP_PORT=`sed -n 's/.*0:.*: listening on port \([0-9]*\)$/\1/p' "$d/ovn-sb/ovsdb-server.log"` && test X != X"$TCP_PORT"...
ovn-macros.at:234: wait succeeded immediately
adding simulator 'main'
ovsdb-server --remote=punix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0634/main/db.sock -vconsole:off --detach --no-chdir --pidfile --log-file
ovs-vswitchd --enable-dummy=system -vvconn -vofproto_dpif -vunixctl -vconsole:off --detach --no-chdir --pidfile --log-file
adding simulator 'hv1'
ovsdb-server --remote=punix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0634/hv1/db.sock -vconsole:off --detach --no-chdir --pidfile --log-file
ovs-vswitchd --enable-dummy=system -vvconn -vofproto_dpif -vunixctl -vconsole:off --detach --no-chdir --pidfile --log-file
ovn-controller --enable-dummy-vif-plug -vconsole:off --detach --no-chdir --pidfile --log-file
ovn-sbctl: no row "hv1" in table Chassis
ovn-sbctl: no row "hv1" in table Chassis
./ovn.at:26372: test "$encap_rec" != "$encap_rec_mvtep"
./ovn.at:26372: exit code was 1, expected 0
634. ovn.at:26372: 634. multi-vtep SB Chassis encap updates -- ovn-northd -- dp-groups=yes (ovn.at:26372): FAILED (ovn.at:26372)

# -*- compilation -*-
635. ovn.at:26372: testing multi-vtep SB Chassis encap updates -- ovn-northd -- dp-groups=no ...
creating ovn-sb database
ovsdb-server -vjsonrpc --remote=punix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0635/ovn-sb/ovn-sb.sock --remote=db:OVN_Southbound,SB_Global,connections --private-key=/<<PKGBUILDDIR>>/tests/testpki-test-privkey.pem --certificate=/<<PKGBUILDDIR>>/tests/testpki-test-cert.pem --ca-cert=/<<PKGBUILDDIR>>/tests/testpki-cacert.pem /<<PKGBUILDDIR>>/tests/testsuite.dir/0635/ovn-sb/ovn-sb.db -vconsole:off --detach --no-chdir --pidfile --log-file
creating ovn-nb database
ovsdb-server -vjsonrpc --remote=punix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0635/ovn-nb/ovn-nb.sock /<<PKGBUILDDIR>>/tests/testsuite.dir/0635/ovn-nb/ovn-nb.db -vconsole:off --detach --no-chdir --pidfile --log-file
starting northd
ovn-northd -vjsonrpc --ovnnb-db=unix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0635/ovn-nb/ovn-nb.sock --ovnsb-db=unix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0635/ovn-sb/ovn-sb.sock -vconsole:off --detach --no-chdir --pidfile --log-file
starting northd-backup
ovn-northd -vjsonrpc --ovnnb-db=unix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0635/ovn-nb/ovn-nb.sock --ovnsb-db=unix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0635/ovn-sb/ovn-sb.sock -vconsole:off --detach --no-chdir --pidfile --log-file
797bf537-6c22-46b3-b643-53d59af2befc
ovn-macros.at:234: waiting until TCP_PORT=`sed -n 's/.*0:.*: listening on port \([0-9]*\)$/\1/p' "$d/ovn-sb/ovsdb-server.log"` && test X != X"$TCP_PORT"...
ovn-macros.at:234: wait succeeded immediately
adding simulator 'main'
ovsdb-server --remote=punix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0635/main/db.sock -vconsole:off --detach --no-chdir --pidfile --log-file
ovs-vswitchd --enable-dummy=system -vvconn -vofproto_dpif -vunixctl -vconsole:off --detach --no-chdir --pidfile --log-file
adding simulator 'hv1'
ovsdb-server --remote=punix:/<<PKGBUILDDIR>>/tests/testsuite.dir/0635/hv1/db.sock -vconsole:off --detach --no-chdir --pidfile --log-file
ovs-vswitchd --enable-dummy=system -vvconn -vofproto_dpif -vunixctl -vconsole:off --detach --no-chdir --pidfile --log-file
ovn-controller --enable-dummy-vif-plug -vconsole:off --detach --no-chdir --pidfile --log-file
ovn-sbctl: no row "hv1" in table Chassis
ovn-sbctl: no row "hv1" in table Chassis
./ovn.at:26372: test "$encap_rec" != "$encap_rec_mvtep"
./ovn.at:26372: exit code was 1, expected 0
635. ovn.at:26372: 635. multi-vtep SB Chassis encap updates -- ovn-northd -- dp-groups=no (ovn.at:26372): FAILED (ovn.at:26372)

[James Page (james-page)]

22.03.0 release:

# 175: policy-based routing IPv6: 1 HVs, 3 LSs, 1 lport/LS, 1 LR -- ovn-northd -- dp-groups=yes
# 176: policy-based routing IPv6: 1 HVs, 3 LSs, 1 lport/LS, 1 LR -- ovn-northd -- dp-groups=no
# 355: ACLs on Port Groups -- ovn-northd -- dp-groups=yes
# 356: ACLs on Port Groups -- ovn-northd -- dp-groups=no
# 638: ovn.at:26372 multi-vtep SB Chassis encap updates -- ovn-northd -- dp-groups=yes
# 639: ovn.at:26372 multi-vtep SB Chassis encap updates -- ovn-northd -- dp-groups=no
# 683: ACL with Port Group conjunction flow efficiency -- ovn-northd -- dp-groups=yes
# 684: ACL with Port Group conjunction flow efficiency -- ovn-northd -- dp-groups=no

all suffer from racey-ness when the builders are under load.