Neutron server log full of Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: WARNING neutron.objects.base [-] ORM session: SQL execution without transaction in progress, traceback:

[Miguel Lavalle]

In the neutron-tempest-plugin-ovn job, the neutron server log is full of the following error:

Jun 16 12:44:13.388278 np0034319125 neutron-server[83462]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-7cbd9fa8-94fb-4740-b7e9-afa577da1f57 None None] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=83462) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:63}}
Jun 16 12:44:13.388451 np0034319125 neutron-server[83463]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovsdb_monitor [None req-d2439ba0-25a6-419e-a0a4-c213f125a947 None None] ChassisMetadataAgentWriteEvent : Matched Chassis_Private, update, None None {{(pid=83463) matches /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py:63}}
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: WARNING neutron.objects.base [-] ORM session: SQL execution without transaction in progress, traceback:
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/local/lib/python3.10/dist-packages/eventlet/green/thread.py", line 43, in __thread_body
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: func(*args, **kwargs)
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: self._bootstrap_inner()
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/local/lib/python3.10/dist-packages/eventlet/green/thread.py", line 64, in wrap_bootstrap_inner
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: bootstrap_inner()
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: self.run()
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/lib/python3.10/threading.py", line 953, in run
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: self._target(*self._args, **self._kwargs)
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/connection.py", line 107, in run
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: self.idl.run()
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/local/lib/python3.10/dist-packages/ovs/db/idl.py", line 464, in run
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: self.__parse_update(msg.params[2], OVSDB_UPDATE3)
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/local/lib/python3.10/dist-packages/ovs/db/idl.py", line 891, in __parse_update
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: self.__do_parse_update(update, version, self.tables)
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/local/lib/python3.10/dist-packages/ovs/db/idl.py", line 951, in __do_parse_update
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: self.notify(*notice)
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py", line 727, in notify
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: target_node = self._hash_ring.get_node(str(row.uuid))
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py", line 106, in get_node
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: self._load_hash_ring()
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/opt/stack/neutron/neutron/common/ovn/hash_ring_manager.py", line 90, in _load_hash_ring
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: nodes = db_hash_ring.get_active_nodes(
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/opt/stack/neutron/neutron/db/ovn_hash_ring_db.py", line 88, in get_active_nodes
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: return query.all()
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/orm/query.py", line 2772, in all
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: return self._iter().all()
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/orm/query.py", line 2907, in _iter
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: result = self.session.execute(
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/orm/session.py", line 1693, in execute
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]: result = fn(orm_exec_state)
Jun 16 12:44:13.388637 np0034319125 neutron-server[83465]:

It seems the problem starts showing with the merge of https://review.opendev.org/c/openstack/neutron/+/886005. The next change to merge was https://review.opendev.org/c/openstack/neutron/+/885744 and also shows the problem

[Miguel Lavalle (minsel)]

Never mind, fix merged https://review.opendev.org/c/openstack/neutron/+/886457