functional tests broken with ovsdbapp 2.7.1

[yatin]

There is new 2.7.1 release for ovsdbapp and is being added to upper-constraints with https://review.opendev.org/c/openstack/requirements/+/920062.

On pro active tests in https://review.opendev.org/c/openstack/neutron/+/919699 functional test job failed, and it's related to the new ovsdbapp release(likely commit [1]).

7 Test fails as:-
ft6.21: neutron.tests.functional.services.ovn_l3.test_plugin.TestRouter.test_gateway_chassis_with_cms_and_not_match_azstesttools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/base.py", line 178, in func
    return f(self, *args, **kwargs)
  File "/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/functional/services/ovn_l3/test_plugin.py", line 255, in test_gateway_chassis_with_cms_and_not_match_azs
    self.del_fake_chassis(self.chassis3)
  File "/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/functional/base.py", line 446, in del_fake_chassis
    self.sb_api.db_destroy(
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
    with self.api.transaction(check_error, log_errors, **kwargs) as t:
  File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
    next(self.gen)
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/ovsdbapp/api.py", line 114, in transaction
    with self.create_transaction(
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/ovsdbapp/api.py", line 71, in __exit__
    self.result = self.commit()
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
    raise result.ex
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 118, in run
    txn.results.put(txn.do_commit())
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 92, in do_commit
    command.run_idl(txn)
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 135, in run_idl
    record = self.api.lookup(self.table, self.record)
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup
    return self._lookup(table, record)
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup
    row = idlutils.row_by_value(self, rl.table, rl.column, record)
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 114, in row_by_value
    raise RowNotFound(table=table, col=column, match=match)
ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Chassis_Private with name=71787aff-3b03-49f7-ac69-22376c2f95db

1 test failed differently:-
ft5.4: neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.test_mech_driver.TestAgentApi.test_agent_listtesttools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/base.py", line 178, in func
    return f(self, *args, **kwargs)
  File "/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/functional/plugins/ml2/drivers/ovn/mech_driver/test_mech_driver.py", line 1240, in test_agent_list
    self.assertTrue(agent_event.wait())
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/ovsdbapp/event.py", line 107, in wait
    return self.event.wait(self.timeout)
  File "/usr/lib/python3.10/threading.py", line 607, in wait
    signaled = self._cond.wait(timeout)
  File "/usr/lib/python3.10/threading.py", line 320, in wait
    waiter.acquire()
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/eventlet/semaphore.py", line 115, in acquire
    hubs.get_hub().switch()
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 310, in switch
    return self.greenlet.switch()
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 362, in run
    self.wait(sleep_time)
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 80, in wait
    presult = self.do_poll(seconds)
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/eventlet/hubs/epolls.py", line 31, in do_poll
    return self.poll.poll(seconds)
  File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.10/site-packages/fixtures/_fixtures/timeout.py", line 52, in signal_handler
    raise TimeoutException()
fixtures._fixtures.timeout.TimeoutException

Example failure:- https://5c83f66e9560507eb64b-bd7468b472e2862cc284264a27887440.ssl.cf5.rackcdn.com/919699/5/check/neutron-functional-with-uwsgi/9022d6b/testr_results.html

The tests needs to fixed to unblock the upper-constraint update patch.

[1] https://github.com/openstack/ovsdbapp/commit/f86a5985e7a309e69fa93658000b8356242b6322

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/neutron/+/920101

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/neutron/+/920101
Committed: https://opendev.org/openstack/neutron/commit/20b9893e34dda0b448ac75c795867cb46de5e127
Submitter: "Zuul (22348)"
Branch: master

commit 20b9893e34dda0b448ac75c795867cb46de5e127
Author: yatinkarel <email address hidden>
Date: Tue May 21 18:36:39 2024 +0530

    [functional tests] compatibility with ovsdbapp>=2.7.0

    ovsdbapp>=2.7.0 handles cleanup of Chassis_Private record
    with chassis delete so we don't need explicit delete.
    The compatibility part can be dropped when we update
    requirements.txt to ovsdbapp>=2.7.0.

    Closes-Bug: #2066263
    Change-Id: I45c6e6a1c3536cf4f2d90b01a3577eec9eaf3743

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/2024.1
Review: https://review.opendev.org/c/openstack/neutron/+/920634

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/2023.2
Review: https://review.opendev.org/c/openstack/neutron/+/920635

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/2023.1
Review: https://review.opendev.org/c/openstack/neutron/+/920730

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/neutron/+/920634
Committed: https://opendev.org/openstack/neutron/commit/4221f706ce269c06e2acb194612c5241dd2c1e83
Submitter: "Zuul (22348)"
Branch: stable/2024.1

commit 4221f706ce269c06e2acb194612c5241dd2c1e83
Author: yatinkarel <email address hidden>
Date: Tue May 21 18:36:39 2024 +0530

    [functional tests] compatibility with ovsdbapp>=2.6.1

    ovsdbapp>=2.6.1 handles cleanup of Chassis_Private record
    with chassis delete so we don't need explicit delete.
    The compatibility part can be dropped when we update
    requirements.txt to ovsdbapp>=2.6.1.

    Closes-Bug: #2066263
    Change-Id: I45c6e6a1c3536cf4f2d90b01a3577eec9eaf3743
    (cherry picked from commit 20b9893e34dda0b448ac75c795867cb46de5e127)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/neutron/+/920635
Committed: https://opendev.org/openstack/neutron/commit/d1c5eac0a8910ded6042422c962ad20ca66b80d8
Submitter: "Zuul (22348)"
Branch: stable/2023.2

commit d1c5eac0a8910ded6042422c962ad20ca66b80d8
Author: yatinkarel <email address hidden>
Date: Tue May 21 18:36:39 2024 +0530

    [functional tests] compatibility with ovsdbapp>=2.4.2

    ovsdbapp>=2.4.2 handles cleanup of Chassis_Private record
    with chassis delete so we don't need explicit delete.
    The compatibility part can be dropped when we update
    requirements.txt to ovsdbapp>=2.4.2.

    Closes-Bug: #2066263
    Change-Id: I45c6e6a1c3536cf4f2d90b01a3577eec9eaf3743
    (cherry picked from commit 20b9893e34dda0b448ac75c795867cb46de5e127)
    (cherry picked from commit 4221f706ce269c06e2acb194612c5241dd2c1e83)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/neutron/+/920730
Committed: https://opendev.org/openstack/neutron/commit/fde31034aef75d08d46db0f2bb410ae01d76b9d1
Submitter: "Zuul (22348)"
Branch: stable/2023.1

commit fde31034aef75d08d46db0f2bb410ae01d76b9d1
Author: yatinkarel <email address hidden>
Date: Tue May 21 18:36:39 2024 +0530

    [functional tests] compatibility with ovsdbapp>=2.2.2

    ovsdbapp>=2.2.2 handles cleanup of Chassis_Private record
    with chassis delete so we don't need explicit delete.
    The compatibility part can be dropped when we update
    requirements.txt to ovsdbapp>=2.2.2.

    Closes-Bug: #2066263
    Change-Id: I45c6e6a1c3536cf4f2d90b01a3577eec9eaf3743
    (cherry picked from commit 20b9893e34dda0b448ac75c795867cb46de5e127)
    (cherry picked from commit 4221f706ce269c06e2acb194612c5241dd2c1e83)
    (cherry picked from commit d1c5eac0a8910ded6042422c962ad20ca66b80d8)
    Conflicts: neutron/tests/functional/base.py