Neutron failed to spawn rootwrap process.

[Zhesen Zhang]

I installed Openstack Liberty for multi-node deployment, during the installation of the the neutron-openvswitch-agent on compute node,
the neutron-oenvswitch-agent failed to start.

Checking the log from /var/log/neutron/openvswitch-agent.log, it looks like neutron failed to spawn rootwrap process.

The details log as followings,

------------------------------------------------------------------------
2016-04-19 15:05:36.552 5562 DEBUG neutron.agent.linux.utils [-] Running command (rootwrap daemon): ['ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', '--may-exist', 'add-br', 'br-int', '--', 'set', 'Bridge', 'br-int', 'datapath_type=system'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:101
2016-04-19 15:05:36.560 5562 DEBUG oslo_rootwrap.client [-] Popen for ['sudo', 'neutron-rootwrap-daemon', '/etc/neutron/rootwrap.conf'] command has been instantiated _initialize /usr/lib/python2.7/site-packages/oslo_rootwrap/client.py:76
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl [-] Unable to execute ['ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', '--may-exist', 'add-br', 'br-int', '--', 'set', 'Bridge', 'br-int', 'datapath_type=system'].
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl Traceback (most recent call last):
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_vsctl.py", line 63, in run_vsctl
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl log_fail_as_error=False).rstrip()
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 117, in execute
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl execute_rootwrap_daemon(cmd, process_input, addl_env))
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 103, in execute_rootwrap_daemon
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl return client.execute(cmd, process_input)
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/site-packages/oslo_rootwrap/client.py", line 133, in execute
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl self._ensure_initialized()
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/site-packages/oslo_rootwrap/client.py", line 118, in _ensure_initialized
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl self._initialize()
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/site-packages/oslo_rootwrap/client.py", line 88, in _initialize
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl (stderr,))
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl Exception: Failed to spawn rootwrap process.
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl stderr:
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl Traceback (most recent call last):
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/bin/neutron-rootwrap-daemon", line 10, in <module>
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl sys.exit(daemon())
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/site-packages/oslo_rootwrap/cmd.py", line 57, in daemon
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl return main(run_daemon=True)
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/site-packages/oslo_rootwrap/cmd.py", line 98, in main
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl daemon_mod.daemon_start(config, filters)
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/site-packages/oslo_rootwrap/daemon.py", line 92, in daemon_start
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl server = manager.get_server()
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib64/python2.7/multiprocessing/managers.py", line 493, in get_server
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl self._authkey, self._serializer)
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib64/python2.7/multiprocessing/managers.py", line 162, in __init__
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl self.listener = Listener(address=address, backlog=16)
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/site-packages/oslo_rootwrap/jsonrpc.py", line 66, in __init__
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl self._socket.bind(address)
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib64/python2.7/socket.py", line 224, in meth
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl return getattr(self._sock,name)(*args)
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl socket.error: [Errno 13] Permission denied
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl
2016-04-19 15:05:36.624 5562 ERROR neutron.agent.ovsdb.impl_vsctl

------------------------------------------------------------------------

[Doug Wiegley (dougwig)]

This doesn't appear to be a bug, but a deployment issue. How is rootwrap defined, what are the contents of the rootwrap.d directory, what installer, ...?

[martins (martins256)]

I had the same error. The solution was to install openstack-selinux package (Centos 7).

[Launchpad Janitor (janitor)]

[Expired for neutron because there has been no activity for 60 days.]

[Jian Wen (wenjianhn)]

#2 works for me.

[changzhi (changzhi)]

Maybe you should disable selinux(setenforce 0) if #2 doesn't work.