Rabbitmq unable to restart due to ** FATAL ** Failed to merge schema

[Fabrizio Soppelsa]

On 5.1.1 ubuntu vlan

After the reboot of the primary controller, Neutron stayed in an indefinite state:

<163>Feb 20 08:36:35 node-10 neutron-server 2015-02-20 08:36:35.131 8811 ERROR neutron.openstack.common.rpc.common [-] AMQP server on 172.16.255.133:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.
...

Rabbitmq was unable to restart

=ERROR REPORT==== 20-Feb-2015::08:28:04 ===
AMQP connection <0.11248.20> (running), channel 0 - error:
{amqp_error,connection_forced,
            "broker forced connection closure with reason 'shutdown'",none}
...
=INFO REPORT==== 20-Feb-2015::08:28:51 ===
Halting Erlang VM

And:

=ERROR REPORT==== 20-Feb-2015::09:23:15 ===
Mnesia('rabbit@node-10'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.rabbit@node-10_1424_424195_559987")
** FATAL ** Failed to merge schema: Bad cookie in table definition mirrored_sup_childspec: 'rabbit@node-10' = {cstruct,mirrored_sup_childspec,ordered_set,['rabbit@node-12','rabbit@node-14','rabbit@node-10'],[],[],0,read_write,false,[],[],false,mirrored_sup_childspec,[key,mirroring_pid,childspec],[],[],{{1424,257415,838584},'rabbit@node-10'},{{4,0},{'rabbit@node-12',{1424,258499,813983}}}}, 'rabbit@node-12' = {cstruct,mirrored_sup_childspec,ordered_set,['rabbit@node-14','rabbit@node-12'],[],[],0,read_write,false,[],[],false,mirrored_sup_childspec,[key,mirroring_pid,childspec],[],[],{{1424,421004,299429},'rabbit@node-12'},{{3,0},{'rabbit@node-14',{1424,421116,793063}}}}

[Bogdan Dobrelya (bogdando)]

I set incomplete state for 6.x milestones as it could have already be fixed for them and we have to check it out

[Bogdan Dobrelya (bogdando)]

Actually we have RabbitMQ OCF fixes backported for 5.1.x as well. So, QA team, please try to reproduce this issue on current 5.1.x trunc