neutron

  1. Bug #1649124
  2. Comment #2

Comment 2 for bug 1649124

Revision history for this message
David Hill (david-hill-ubisoft) wrote : Re: [Bug 1649124] Re: Failure to launch neutron-openvswitch-agent after tripleo deployment

The undercloud is deployed alright but as you can see, the neutron-openvswitch-agent dies on startup and the overcloud won't deploy properly because of this ... I'll attach the version later on today .

David Hill

> On Dec 12, 2016, at 21:15, Emilien Macchi <email address hidden> wrote:
>
> This bug report miss details, like versions and environment. So far our
> CI has been able to deploy undercloud with OVS agent successfully, I'm
> not sure what is the bug here.
>
> ** Changed in: tripleo
> Status: New => Invalid
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1649124
>
> Title:
> Failure to launch neutron-openvswitch-agent after tripleo deployment
>
> Status in tripleo:
> Invalid
>
> Bug description:
> Failure to launch neutron-openvswitch-agent after tripleo deployment
> ... I am able to manually start it and start an overcloud deployment
> which will later on fail but that's another issue.
>
> 2016-12-11 14:15:41.228 8272 INFO neutron.common.config [-] Logging enabled!
> 2016-12-11 14:15:41.229 8272 INFO neutron.common.config [-] /usr/bin/neutron-openvswitch-agent version 10.0.0.0b2.dev216
> 2016-12-11 14:15:41.234 8272 WARNING oslo_config.cfg [-] Option "rabbit_hosts" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
> 2016-12-11 14:15:41.235 8272 WARNING oslo_config.cfg [-] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
> 2016-12-11 14:15:41.235 8272 WARNING oslo_config.cfg [-] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
> 2016-12-11 14:15:41.239 8272 INFO ryu.base.app_manager [-] loading app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp
> 2016-12-11 14:15:41.553 8272 INFO ryu.base.app_manager [-] loading app ryu.app.ofctl.service
> 2016-12-11 14:15:41.555 8272 INFO ryu.base.app_manager [-] loading app ryu.controller.ofp_handler
> 2016-12-11 14:15:41.556 8272 INFO ryu.base.app_manager [-] instantiating app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp of OVSNeutronAgentRyuApp
> 2016-12-11 14:15:41.557 8272 INFO ryu.base.app_manager [-] instantiating app ryu.controller.ofp_handler of OFPHandler
> 2016-12-11 14:15:41.557 8272 INFO ryu.base.app_manager [-] instantiating app ryu.app.ofctl.service of OfctlService
> 2016-12-11 14:15:41.583 8272 WARNING neutron.agent.ovsdb.native.vlog [-] tcp:127.0.0.1:6640: send error: Connection refused
> 2016-12-11 14:15:41.747 8272 INFO oslo_rootwrap.client [-] Spawned new rootwrap daemon process with pid=8418
> 2016-12-11 14:15:51.779 8272 ERROR neutron.agent.ovsdb.impl_vsctl [-] Unable to execute ['ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', '--id=@manager', 'create', 'Manager', 'target="ptcp:6640:127.0.0.1"', '--', 'add', 'Open_vSwitch', '.', 'manager_options', '@manager']. Exception: Exit code: -14; Stdin: ; Stdout: ; Stderr: 2016-12-11T19:15:51Z|00002|fatal_signal|WARN|terminating with signal 14 (Alarm clock)
>
> 2016-12-11 14:15:51.849 8272 INFO neutron.agent.ovsdb.native.vlog [-] tcp:127.0.0.1:6640: connecting...
> 2016-12-11 14:15:51.849 8272 INFO neutron.agent.ovsdb.native.vlog [-] tcp:127.0.0.1:6640: connected
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp [-] Agent main thread died of an exception
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp Traceback (most recent call last):
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_ryuapp.py", line 42, in agent_main_wrapper
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp ovs_agent.main(bridge_classes)
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 2149, in main
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp agent = OVSNeutronAgent(bridge_classes, cfg.CONF)
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 169, in __init__
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp self.setup_integration_br()
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 154, in wrapper
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp return f(*args, **kwargs)
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 977, in setup_integration_br
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp self.int_br.create()
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/agent/common/ovs_lib.py", line 220, in create
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp FAILMODE_SECURE))
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/api.py", line 76, in __exit__
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp self.result = self.commit()
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 73, in commit
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp 'timeout': self.timeout})
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp TimeoutException: Commands [AddBridgeCommand(datapath_type=system, may_exist=True, name=br-int)] exceeded timeout 10 seconds
> 2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp
> 2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl [-] Post-commit checks failed
> 2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl Traceback (most recent call last):
> 2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 152, in post_commit
> 2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl self.do_post_commit(txn)
> 2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 174, in do_post_commit
> 2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl 'timeout': self.timeout})
> 2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl TimeoutException: Commands [AddBridgeCommand(datapath_type=system, may_exist=True, name=br-int)] exceeded timeout 10 seconds post-commit
> 2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl
> 2016-12-11 14:16:01.886 8272 ERROR ryu.lib.hub [-] hub: uncaught exception: Traceback (most recent call last):
> File "/usr/lib/python2.7/site-packages/ryu/lib/hub.py", line 54, in _launch
> return func(*args, **kwargs)
> File "/usr/lib/python2.7/site-packages/ryu/base/app_manager.py", line 545, in close
> self.uninstantiate(app_name)
> File "/usr/lib/python2.7/site-packages/ryu/base/app_manager.py", line 528, in uninstantiate
> app = self.applications.pop(name)
> KeyError: 'ofctl_service'
>
> 2016-12-11 14:16:01.977 8272 INFO oslo_rootwrap.client [-] Stopping
> rootwrap daemon process with pid=8418
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/tripleo/+bug/1649124/+subscriptions