neutron-linuxbridge-agent keeps going down and neutron-linuxbridge-cleanup fails to start on boot

[Heni Nechi]

1)

Description: Ubuntu 22.04.1 LTS
Release: 22.04

2)

neutron-linuxbridge-agent:
  Installed: 2:20.2.0-0ubuntu1

3)

neutron-linuxbridge-agent to be up and for neutron-linuxbridge-cleanup to start on boot.

4)

neutron-linuxbridge-agent keeps going down and after checking /var/log/neutron/neutron-linuxbridge-agent.log I found this :

2023-03-12 15:52:49.414 33866 CRITICAL neutron [-] Unhandled error: neutron.privileged.agent.linux.ip_lib.InterfaceOperationNotSupported: Operation not supported on interface vxlan-524, namespace None.
2023-03-12 15:52:49.414 33866 ERROR neutron Traceback (most recent call last):
2023-03-12 15:52:49.414 33866 ERROR neutron File "/usr/bin/neutron-linuxbridge-agent", line 10, in <module>
2023-03-12 15:52:49.414 33866 ERROR neutron sys.exit(main())
2023-03-12 15:52:49.414 33866 ERROR neutron File "/usr/lib/python3/dist-packages/neutron/cmd/eventlet/plugins/linuxbridge_neutron_agent.py", line 28, in main
2023-03-12 15:52:49.414 33866 ERROR neutron agent_main.main()
2023-03-12 15:52:49.414 33866 ERROR neutron File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 1039, in main
2023-03-12 15:52:49.414 33866 ERROR neutron manager = LinuxBridgeManager(bridge_mappings, interface_mappings)
2023-03-12 15:52:49.414 33866 ERROR neutron File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 92, in __init__
2023-03-12 15:52:49.414 33866 ERROR neutron self.check_vxlan_support()
2023-03-12 15:52:49.414 33866 ERROR neutron File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 729, in check_vxlan_support
2023-03-12 15:52:49.414 33866 ERROR neutron if self.vxlan_ucast_supported():
2023-03-12 15:52:49.414 33866 ERROR neutron File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 705, in vxlan_ucast_supported
2023-03-12 15:52:49.414 33866 ERROR neutron self.delete_interface(test_iface)
2023-03-12 15:52:49.414 33866 ERROR neutron File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 670, in delete_interface
2023-03-12 15:52:49.414 33866 ERROR neutron device.link.delete()
2023-03-12 15:52:49.414 33866 ERROR neutron File "/usr/lib/python3/dist-packages/neutron/agent/linux/ip_lib.py", line 482, in delete
2023-03-12 15:52:49.414 33866 ERROR neutron privileged.delete_interface(self.name, self._parent.namespace)
2023-03-12 15:52:49.414 33866 ERROR neutron File "/usr/lib/python3/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
2023-03-12 15:52:49.414 33866 ERROR neutron return self.channel.remote_call(name, args, kwargs,
2023-03-12 15:52:49.414 33866 ERROR neutron File "/usr/lib/python3/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
2023-03-12 15:52:49.414 33866 ERROR neutron raise exc_type(*result[2])
2023-03-12 15:52:49.414 33866 ERROR neutron neutron.privileged.agent.linux.ip_lib.InterfaceOperationNotSupported: Operation not supported on interface vxlan-524, namespace None.
2023-03-12 15:52:49.414 33866 ERROR neutron

it's keeps on repeating and adding vxlan interfaces.

and this in the boot logs:

16:02:26 controller ModemManager[1106]: <info> [base-manager] couldn't check support for device '/sys/devices/pci0000:00/0000:00:11.0/0000:02:01.0': not supported by any plugin
مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-cleanup.service: Main process exited, code=exited, status=1/FAILURE
مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-cleanup.service: Failed with result 'exit-code'.
مارس 12 16:02:26 controller systemd[1]: Failed to start OpenStack Neutron Linux bridge cleanup.
مارس 12 16:02:26 controller systemd[1]: Dependency failed for Openstack Neutron Linux Bridge Agent.
مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-agent.service: Job neutron-linuxbridge-agent.service/start failed with result 'dependency'.
مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-cleanup.service: Consumed 9.509s CPU time.

openstack network agent list
+--------------------------------------+--------------------+------------+-------------------+-------+-------+---------------------------+
| ID | Agent Type | Host | Availability Zone | Alive | State | Binary |
+--------------------------------------+--------------------+------------+-------------------+-------+-------+---------------------------+
| 059b6417-3f10-4a57-9eda-b0866f6a0060 | Linux bridge agent | compute1 | None | XXX | UP | neutron-linuxbridge-agent |
| 1549645e-5dbe-4ca1-9eb7-661f1cce5849 | DHCP agent | controller | nova | :-) | UP | neutron-dhcp-agent |
| 3045523c-b1d4-4256-bae4-d6909a47af4a | Linux bridge agent | compute5 | None | XXX | UP | neutron-linuxbridge-agent |
| 74a24664-cee4-4a87-95cf-303f44cc522e | Linux bridge agent | compute4 | None | XXX | UP | neutron-linuxbridge-agent |
| 7df2b9e8-7afb-41b4-b2c7-a5a44e95ff2e | Linux bridge agent | compute2 | None | XXX | UP | neutron-linuxbridge-agent |
| c253c2ef-8b17-490a-8bbc-957baac919ad | Metadata agent | controller | None | :-) | UP | neutron-metadata-agent |
| e121813a-3305-4d53-b3c9-6631f8b77a38 | Linux bridge agent | controller | None | XXX | UP | neutron-linuxbridge-agent |
| e1d79173-c06d-4be0-aa81-40845390ca07 | Linux bridge agent | compute3 | None | XXX | UP | neutron-linuxbridge-agent |
| f55768c2-7ca1-428c-b393-a63f7ff73e55 | L3 agent | controller | nova | :-) | UP | neutron-l3-agent |
+--------------------------------------+--------------------+------------+-------------------+-------+-------+---------------------------+