Bug is reproduced on {"build_id": "2014-03-25_11-38-46", "mirantis": "yes", "build_number": "43", "nailgun_sha": "3044c2054904525601c921387322a2978e821677", "ostf_sha": "013c13ab033a6829ca4eeaa2476c30837e814902", "fuelmain_sha": "f7ee8bcaa3d993395669f2bcae893176ff2b3bbe", "astute_sha": "d7c6c4d00ffd6e2fa74da442f573e6f39049961e", "release": "5.0", "fuellib_sha": "3445ab7550486074ec8e47fdaed869c697991364"}
Steps:
1. Create next cluster - Ubuntu, HA, KVM, Neutron Vlan, Ceph for volumes, Ceph for images, Rados
2. Create 3 controllers with ceph, create 2 compute with ceph
3. Deploy cluster - cluster was deployed successfully
4. Shutdown primary controller first, then two other controllers and then start primary controller first and then two other controllers
5. Run OSTF tests and check Neutron server logs
Expected - all tests passed and there are no errors
Actual - tests on creating volumes and instances failed, Lost connection to MySQL server in logs
Neutron server log on primary controller:
neutron [-] (OperationalError) (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 11") None None
neutron.openstack.common.rpc.common [-] ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/amqp.py", line 438, in _process_data\n **args)\n', ' File "/usr/lib/python2.7/dist-packages/neutron/common/rpc.py", line 45, in dispatch\n neutron_ctxt, version, method, namespace, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/dispatcher.py", line 172, in dispatch\n result = getattr(proxyobj, method)(ctxt, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/neutron/db/l3_rpc_base.py", line 56, in sync_routers\n context, host, router_ids)\n', ' File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 131, in list_active_sync_routers_on_active_l3_agent\n context, constants.AGENT_TYPE_L3, host)\n', ' File "/usr/lib/python2.7/dist-packages/neutron/db/agents_db.py", line 133, in _get_agent_by_type_and_host\n host=host)\n', 'AgentNotFoundByTypeHost: Agent with agent_type=L3 agent and host=node-10 could not be found\n']
Diagnostic snapshot is attached
caused by broken galera - see mysql logs for details