Neutron linuxbridge agent fails updating fdb when L2population enabled

[Hyunsun Moon]

Neutron linuxbridge agent fails update fdb entries when L2population enabled for the following error. It occurs in Ocata or later.

Error logs captured from linuxbridge agent pod.
--------------------------------------------------------------------------
2018-02-17 15:12:32.069 28 INFO oslo.privsep.daemon [req-d11576de-1ff1-4747-9777-380394966310 - - - - -] Running privsep helper: ['sudo', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/tmp/pod-shared/ml2-local-ip.ini', '--config-file', '/etc/neutron/plugins/ml2/linuxbridge_agent.ini', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmpZOF2JU/privsep.sock']
2018-02-17 15:12:32.094 28 WARNING oslo.privsep.daemon [-] privsep log: sudo: no tty present and no askpass program specified
2018-02-17 15:12:32.104 28 CRITICAL oslo.privsep.daemon [req-d11576de-1ff1-4747-9777-380394966310 - - - - -] privsep helper command exited non-zero (1)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server [req-d11576de-1ff1-4747-9777-380394966310 - - - - -] Exception during message handling
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 155, in _process_incoming
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 222, in dispatch
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 192, in _do_dispatch
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_log/helpers.py", line 48, in wrapper
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server return method(*args, **kwargs)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/l2pop/rpc_manager/l2population_rpc.py", line 41, in add_fdb_entries
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server self.fdb_add(context, self._unmarshall_fdb_entries(fdb_entries))
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 856, in fdb_add
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server interface)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 705, in add_fdb_entries
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server self.add_fdb_ip_entry(mac, ip, interface)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 696, in add_fdb_ip_entry
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server ip_lib.add_neigh_entry(ip, mac, interface)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 988, in add_neigh_entry
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server **kwargs)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 204, in _wrap
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server self.start()
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 215, in start
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server channel = daemon.RootwrapClientChannel(context=self)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 309, in __init__
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server raise FailedToDropPrivileges(msg)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server FailedToDropPrivileges: privsep helper command exited non-zero (1)
2018-02-17 15:12:32.105 28 ERROR oslo_messaging.rpc.server

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/545743

[OpenStack Infra (hudson-openstack)]

Change abandoned by Hyunsun Moon (<email address hidden>) on branch: master
Review: https://review.openstack.org/545743

[Deshi Xiao (xiaods)]

any updates?

[Hyunsun Moon (hyunsun-moon)]

this is not a bug anymore. you can fix it by adding
1) privsep filers to Values.conf.rootwrap_filters
2) privsep helper command config below to your values override
conf:
  neutron:
    privsep:
      helper_command: sudo neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf