[neutron] Err for neutron.agent.l3_agent: Failed reporting state!

[Anastasia Palkina]

"build_id": "2014-06-19_00-31-14",
"mirantis": "yes",
"build_number": "260",
"ostf_sha": "319d3858b24a962e87191a8d5fd4c1e46e1cd959",
"nailgun_sha": "6a995917e010edb247160ee5333b15fa564ed361",
"production": "docker",
"api": "1.0",
"fuelmain_sha": "7089ffea68000b90e5ba85dbfec64e18a6216eea",
"astute_sha": "694b5a55695e01e1c42185bfac9cc7a641a9bd48",
"release": "5.1",
"fuellib_sha": "a6fe0b4f41e6e251e44fb35f771c48f353e33530"

1. Create new environment (Ubuntu, HA mode)
2. Choose GRE segmentation
3. Choose both Ceph
4. Choose Sahara and Ceilometer
5. Add 3 controllers+ceph, 4 computes, 2 ceph, 1 mongo
6. Start deployment. It was successful
7. But there is error in neutron-l3-agent.log on first controller (node-1):

2014-06-19 12:09:30 ERROR

neutron.agent.l3_agent [req-a67f65ae-b4d2-42d6-bd73-d3139572b7dd None] Failed reporting state!
2014-06-19 11:09:30.584 8261 TRACE neutron.agent.l3_agent Traceback (most recent call last):
2014-06-19 11:09:30.584 8261 TRACE neutron.agent.l3_agent File "/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 944, in _report_state
2014-06-19 11:09:30.584 8261 TRACE neutron.agent.l3_agent self.use_call)
2014-06-19 11:09:30.584 8261 TRACE neutron.agent.l3_agent File "/usr/lib/python2.7/dist-packages/neutron/agent/rpc.py", line 72, in report_state
2014-06-19 11:09:30.584 8261 TRACE neutron.agent.l3_agent return self.call(context, msg, topic=self.topic)
2014-06-19 11:09:30.584 8261 TRACE neutron.agent.l3_agent File "/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/proxy.py", line 129, in call
2014-06-19 11:09:30.584 8261 TRACE neutron.agent.l3_agent exc.info, real_topic, msg.get('method'))
2014-06-19 11:09:30.584 8261 TRACE neutron.agent.l3_agent Timeout: Timeout while waiting on RPC response - topic: "q-plugin", RPC method: "report_state" info: "<unknown>"
2014-06-19 11:09:30.584 8261 TRACE neutron.agent.l3_agent

[Vladimir Kuklin (vkuklin)]

looks like #856764 or #1323277 duplicate

[Eugene Nikanorov (enikanorov)]

l3 agent can't consume message from the queue because of rabbitmq failure, you can check rabbit mq logs at:

localhost/var/log/remote/node-1.domain.tld/rabbitmq-sasl.log (see snapshot)

[Andrey Epifanov (aepifanov)]

Eugene Nikanorov is right, this message is appears when RMQ is down, also it might be partly fixed with patch for this https://bugs.launchpad.net/mos/+bug/856764