error in netns privsep wrapper: ImportError: No module named agent.linux.ip_lib

[Thomas Morin]

I see this in a fullstack job:

Traceback (most recent call last):
  File "/opt/stack/new/networking-bagpipe/.tox/dsvm-fullstack/local/lib/python2.7/site-packages/fixtures/fixture.py", line 197, in setUp
    self._setUp()
  File "/opt/stack/new/networking-bagpipe/.tmp/tmp.mov2YMQdzm/openstack/neutron/neutron/tests/common/net_helpers.py", line 566, in _setUp
    self.ip_wrapper = ip.ensure_namespace(self.name)
  File "/opt/stack/new/networking-bagpipe/.tmp/tmp.mov2YMQdzm/openstack/neutron/neutron/agent/linux/ip_lib.py", line 202, in ensure_namespace
    if not self.netns.exists(name):
  File "/opt/stack/new/networking-bagpipe/.tmp/tmp.mov2YMQdzm/openstack/neutron/neutron/agent/linux/ip_lib.py", line 893, in exists
    return network_namespace_exists(name)
  File "/opt/stack/new/networking-bagpipe/.tmp/tmp.mov2YMQdzm/openstack/neutron/neutron/agent/linux/ip_lib.py", line 1049, in network_namespace_exists
    output = list_network_namespaces(**kwargs)
  File "/opt/stack/new/networking-bagpipe/.tmp/tmp.mov2YMQdzm/openstack/neutron/neutron/agent/linux/ip_lib.py", line 1038, in list_network_namespaces
    return privileged.list_netns(**kwargs)
  File "/opt/stack/new/networking-bagpipe/.tox/dsvm-fullstack/local/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 205, in _wrap
    return self.channel.remote_call(name, args, kwargs)
  File "/opt/stack/new/networking-bagpipe/.tox/dsvm-fullstack/local/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 202, in remote_call
    raise exc_type(*result[2])
ImportError: No module named agent.linux.ip_lib

http://logs.openstack.org/80/501780/17/check/legacy-networking-bagpipe-dsvm-fullstack/d8e221c/job-output.txt.gz#_2017-10-17_13_25_50_475156

I suspect this is related to https://review.openstack.org/#/c/505701/, but what happens is not obvious to me.

[Thomas Morin (tmmorin-orange)]

It seems that the issue would be due to the fact that in this CI setup, rootwrap is not configured as it should be, in particular the privsep filter.

[Boden R (boden)]

Based on [1] this started cropping up on the 16th.
Either something landed, or it's related to the zuul v3 change perhaps.

[1] http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22ImportError%3A%20No%20module%20named%20agent.linux.ip_lib%5C%22

[Thomas Morin (tmmorin-orange)]

Boden, as suggested in the description, the cause is https://review.openstack.org/#/c/505701 which landed that day.

As said in comment 1, The issue arises because the environnement for networking-bagpipe fullstack job isn't ok for rootwrap.

This is being worked on in change 500109.

[Ihar Hrachyshka (ihar-hrachyshka)]

I don't even think there is a bug in any meaningful sense in neutron here. The fact that bgpvpn wants to reuse the internal neutron script doesn't mean there is something wrong about neutron itself here. We can accommodate I guess, but that shouldn't be a reason to have a bug, especially 'Critical'.

[Thomas Morin (tmmorin-orange)]

@Ihar: agreed.

[OpenStack Infra (hudson-openstack)]

Change abandoned by boden (<email address hidden>) on branch: master
Review: https://review.openstack.org/513719
Reason: done testing