On the second deployment on the same host - 2014-01-09T13:13:35.962098+00:00 debug: 2014-01-09 13:13:26.272 20875 INFO neutron.agent.l3_agent [-] L3 agent started 2014-01-09T13:13:35.962098+00:00 debug: 2014-01-09 13:13:26.273 20875 INFO neutron.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.0.5:5672 2014-01-09T13:13:35.962106+00:00 debug: 2014-01-09 13:13:26.477 20875 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers 2014-01-09T13:13:35.962106+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent Traceback (most recent call last): 2014-01-09T13:13:35.962110+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 723, in _sync_routers_task 2014-01-09T13:13:35.962110+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent context, router_ids) 2014-01-09T13:13:35.962223+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 76, in get_routers 2014-01-09T13:13:35.962330+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent topic=self.topic) 2014-01-09T13:13:35.962473+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/openstack/common/rpc/proxy.py", line 126, in call 2014-01-09T13:13:35.962672+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent result = rpc.call(context, real_topic, msg, timeout) 2014-01-09T13:13:35.962800+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/openstack/common/rpc/__init__.py", line 140, in call 2014-01-09T13:13:35.962961+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent return _get_impl().call(CONF, context, topic, msg, timeout) 2014-01-09T13:13:35.962961+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/openstack/common/rpc/impl_kombu.py", line 796, in call 2014-01-09T13:13:35.964346+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent rpc_amqp.get_connection_pool(conf, Connection)) 2014-01-09T13:13:35.964346+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/openstack/common/rpc/amqp.py", line 551, in call 2014-01-09T13:13:35.964358+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent rv = list(rv) 2014-01-09T13:13:35.964358+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/openstack/common/rpc/amqp.py", line 516, in __iter__ 2014-01-09T13:13:35.964372+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent raise result 2014-01-09T13:13:35.964372+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent RemoteError: Remote error: AgentNotFoundByTypeHost Agent with agent_type=L3 agent and host=node-4.domain.tld could not be found 2014-01-09T13:13:35.964467+00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron.agent.l3_agent [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.6/site-packages/neutron/openstack/common/rpc/amqp.py", line 438, in _process_data\n **args)\n', u' File "/usr/lib/python2.6/site-packages/neutron/common/rpc.py", line 44, in dispatch\n neutron_ctxt, version, method, namespace, **kwargs)\n', u' File "/usr/lib/python2.6/site-packages/neutron/openstack/common/rpc/dispatcher.py", line 172, in dispatch\n result = getattr(proxyobj, method)(ctxt, **kwargs)\n', u' File "/usr/lib/python2.6/site-packages/neutron/db/l3_rpc_base.py", line 56, in sync_routers\n context, host, router_ids)\n', u' File "/usr/lib/python2.6/site-packages/neutron/db/l3_agentschedulers_db.py", line 131, in list_active_sync_routers_on_active_l3_agent\n context, constants.AGENT_TYPE_L3, host)\n', u' File "/usr/lib/python2.6/site-packages/neutron/db/agents_db.py", line 129, in _get_agent_by_type_and_host\n host=host)\n', u'AgentNotFoundByTypeHost: Agent with agent_type=L3 agent and host=node-4.domain.tld could not be found\n'].
Seems like L3 agent do not start on node(node-4)
On the second deployment on the same host - 2014-01- 09T13:13: 35.962098+ 00:00 debug: 2014-01-09 13:13:26.272 20875 INFO neutron. agent.l3_ agent [-] L3 agent started 09T13:13: 35.962098+ 00:00 debug: 2014-01-09 13:13:26.273 20875 INFO neutron. openstack. common. rpc.common [-] Connected to AMQP server on 192.168.0.5:5672 09T13:13: 35.962106+ 00:00 debug: 2014-01-09 13:13:26.477 20875 ERROR neutron. agent.l3_ agent [-] Failed synchronizing routers 09T13:13: 35.962106+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent Traceback (most recent call last): 09T13:13: 35.962110+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent File "/usr/lib/ python2. 6/site- packages/ neutron/ agent/l3_ agent.py" , line 723, in _sync_routers_task 09T13:13: 35.962110+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent context, router_ids) 09T13:13: 35.962223+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent File "/usr/lib/ python2. 6/site- packages/ neutron/ agent/l3_ agent.py" , line 76, in get_routers 09T13:13: 35.962330+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent topic=self.topic) 09T13:13: 35.962473+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent File "/usr/lib/ python2. 6/site- packages/ neutron/ openstack/ common/ rpc/proxy. py", line 126, in call 09T13:13: 35.962672+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent result = rpc.call(context, real_topic, msg, timeout) 09T13:13: 35.962800+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent File "/usr/lib/ python2. 6/site- packages/ neutron/ openstack/ common/ rpc/__init_ _.py", line 140, in call 09T13:13: 35.962961+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent return _get_impl( ).call( CONF, context, topic, msg, timeout) 09T13:13: 35.962961+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent File "/usr/lib/ python2. 6/site- packages/ neutron/ openstack/ common/ rpc/impl_ kombu.py" , line 796, in call 09T13:13: 35.964346+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent rpc_amqp. get_connection_ pool(conf, Connection)) 09T13:13: 35.964346+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent File "/usr/lib/ python2. 6/site- packages/ neutron/ openstack/ common/ rpc/amqp. py", line 551, in call 09T13:13: 35.964358+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent rv = list(rv) 09T13:13: 35.964358+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent File "/usr/lib/ python2. 6/site- packages/ neutron/ openstack/ common/ rpc/amqp. py", line 516, in __iter__ 09T13:13: 35.964372+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent raise result 09T13:13: 35.964372+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent RemoteError: Remote error: AgentNotFoundBy TypeHost Agent with agent_type=L3 agent and host=node- 4.domain. tld could not be found 09T13:13: 35.964467+ 00:00 debug: 2014-01-09 13:13:26.477 20875 TRACE neutron. agent.l3_ agent [u'Traceback (most recent call last):\n', u' File "/usr/lib/ python2. 6/site- packages/ neutron/ openstack/ common/ rpc/amqp. py", line 438, in _process_data\n **args)\n', u' File "/usr/lib/ python2. 6/site- packages/ neutron/ common/ rpc.py" , line 44, in dispatch\n neutron_ctxt, version, method, namespace, **kwargs)\n', u' File "/usr/lib/ python2. 6/site- packages/ neutron/ openstack/ common/ rpc/dispatcher. py", line 172, in dispatch\n result = getattr(proxyobj, method)(ctxt, **kwargs)\n', u' File "/usr/lib/ python2. 6/site- packages/ neutron/ db/l3_rpc_ base.py" , line 56, in sync_routers\n context, host, router_ids)\n', u' File "/usr/lib/ python2. 6/site- packages/ neutron/ db/l3_agentsche dulers_ db.py", line 131, in list_active_ sync_routers_ on_active_ l3_agent\ n context, constants. AGENT_TYPE_ L3, host)\n', u' File "/usr/lib/ python2. 6/site- packages/ neutron/ db/agents_ db.py", line 129, in _get_agent_ by_type_ and_host\ n host=host)\n', u'AgentNotFound ByTypeHost: Agent with agent_type=L3 agent and host=node- 4.domain. tld could not be found\n'].
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
2014-01-
Seems like L3 agent do not start on node(node-4)