Failure to launch neutron-openvswitch-agent after tripleo deployment ... I am able to manually start it and start an overcloud deployment which will later on fail but that's another issue.
2016-12-11 14:15:41.228 8272 INFO neutron.common.config [-] Logging enabled!
2016-12-11 14:15:41.229 8272 INFO neutron.common.config [-] /usr/bin/neutron-openvswitch-agent version 10.0.0.0b2.dev216
2016-12-11 14:15:41.234 8272 WARNING oslo_config.cfg [-] Option "rabbit_hosts" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
2016-12-11 14:15:41.235 8272 WARNING oslo_config.cfg [-] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
2016-12-11 14:15:41.235 8272 WARNING oslo_config.cfg [-] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
2016-12-11 14:15:41.239 8272 INFO ryu.base.app_manager [-] loading app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp
2016-12-11 14:15:41.553 8272 INFO ryu.base.app_manager [-] loading app ryu.app.ofctl.service
2016-12-11 14:15:41.555 8272 INFO ryu.base.app_manager [-] loading app ryu.controller.ofp_handler
2016-12-11 14:15:41.556 8272 INFO ryu.base.app_manager [-] instantiating app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp of OVSNeutronAgentRyuApp
2016-12-11 14:15:41.557 8272 INFO ryu.base.app_manager [-] instantiating app ryu.controller.ofp_handler of OFPHandler
2016-12-11 14:15:41.557 8272 INFO ryu.base.app_manager [-] instantiating app ryu.app.ofctl.service of OfctlService
2016-12-11 14:15:41.583 8272 WARNING neutron.agent.ovsdb.native.vlog [-] tcp:127.0.0.1:6640: send error: Connection refused
2016-12-11 14:15:41.747 8272 INFO oslo_rootwrap.client [-] Spawned new rootwrap daemon process with pid=8418
2016-12-11 14:15:51.779 8272 ERROR neutron.agent.ovsdb.impl_vsctl [-] Unable to execute ['ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', '--id=@manager', 'create', 'Manager', 'target="ptcp:6640:127.0.0.1"', '--', 'add', 'Open_vSwitch', '.', 'manager_options', '@manager']. Exception: Exit code: -14; Stdin: ; Stdout: ; Stderr: 2016-12-11T19:15:51Z|00002|fatal_signal|WARN|terminating with signal 14 (Alarm clock)
2016-12-11 14:15:51.849 8272 INFO neutron.agent.ovsdb.native.vlog [-] tcp:127.0.0.1:6640: connecting...
2016-12-11 14:15:51.849 8272 INFO neutron.agent.ovsdb.native.vlog [-] tcp:127.0.0.1:6640: connected
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp [-] Agent main thread died of an exception
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp Traceback (most recent call last):
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_ryuapp.py", line 42, in agent_main_wrapper
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp ovs_agent.main(bridge_classes)
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 2149, in main
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp agent = OVSNeutronAgent(bridge_classes, cfg.CONF)
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 169, in __init__
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp self.setup_integration_br()
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 154, in wrapper
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp return f(*args, **kwargs)
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 977, in setup_integration_br
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp self.int_br.create()
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/agent/common/ovs_lib.py", line 220, in create
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp FAILMODE_SECURE))
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/api.py", line 76, in __exit__
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp self.result = self.commit()
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 73, in commit
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp 'timeout': self.timeout})
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp TimeoutException: Commands [AddBridgeCommand(datapath_type=system, may_exist=True, name=br-int)] exceeded timeout 10 seconds
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl [-] Post-commit checks failed
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl Traceback (most recent call last):
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 152, in post_commit
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl self.do_post_commit(txn)
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 174, in do_post_commit
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl 'timeout': self.timeout})
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl TimeoutException: Commands [AddBridgeCommand(datapath_type=system, may_exist=True, name=br-int)] exceeded timeout 10 seconds post-commit
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl
2016-12-11 14:16:01.886 8272 ERROR ryu.lib.hub [-] hub: uncaught exception: Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/ryu/lib/hub.py", line 54, in _launch
return func(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/ryu/base/app_manager.py", line 545, in close
self.uninstantiate(app_name)
File "/usr/lib/python2.7/site-packages/ryu/base/app_manager.py", line 528, in uninstantiate
app = self.applications.pop(name)
KeyError: 'ofctl_service'
2016-12-11 14:16:01.977 8272 INFO oslo_rootwrap.client [-] Stopping rootwrap daemon process with pid=8418
This bug report miss details, like versions and environment. So far our CI has been able to deploy undercloud with OVS agent successfully, I'm not sure what is the bug here.