Comment 40 for bug 1285449

Revision history for this message
Anastasia Palkina (apalkina) wrote : Re: Moving management vip breaks rabbitmq sessions

I reproduced with bug on ISO #235
"build_id": "2014-03-05_07-31-01",
"mirantis": "yes",
"build_number": "235",
"nailgun_sha": "f58aad317829112913f364347b14f1f0518ad371",
"ostf_sha": "dc54d99ddff2f497b131ad1a42362515f2a61afa",
"fuelmain_sha": "16637e2ea0ae6fe9a773aceb9d76c6e3a75f6c3b",
"astute_sha": "f15f5615249c59c826ea05d26707f062c88db32a",
"release": "4.1",
"fuellib_sha": "73313007c0914e602246ea41fa5e8ca2dfead9f8"

1. Create new environment (Ubuntu, HA mode)
2. Choose GRE segmentation
3. Choose installing both Ceph
4. Add 3 controllers+ceph, 1 compute
5. Start deployment. It was successful
6. Power off primary controller.
7. Try to create cinder volume. It is stuck in "creating" state
8. Power on primary controller

root@node-3:~# rabbitmqctl list_queues pid
Listing queues ...
<'rabbit@node-2'.1.251.0>
<'rabbit@node-2'.1.647.0>
<'rabbit@node-3'.3.1109.0>
<'rabbit@node-2'.1.253.0>
<'rabbit@node-2'.1.255.0>
<'rabbit@node-2'.1.257.0>
<'rabbit@node-3'.3.693.0>
<'rabbit@node-2'.1.259.0>
<'rabbit@node-3'.3.4128.0>
<'rabbit@node-3'.3.26698.0>
<'rabbit@node-3'.3.4192.0>
<'rabbit@node-3'.3.401.0>
<'rabbit@node-3'.3.26684.0>
<'rabbit@node-3'.3.26685.0>
<'rabbit@node-2'.1.261.0>
<'rabbit@node-2'.1.570.0>
<'rabbit@node-2'.1.3102.1>
<'rabbit@node-2'.1.31299.0>
<'rabbit@node-3'.3.2686.0>
<'rabbit@node-2'.1.940.0>
<'rabbit@node-3'.3.6045.0>
<'rabbit@node-3'.3.1581.0>
<'rabbit@node-2'.1.263.0>
<'rabbit@node-2'.1.2557.0>
<'rabbit@node-2'.1.897.0>
<'rabbit@node-2'.1.267.0>
<'rabbit@node-2'.1.3110.1>
<'rabbit@node-3'.3.1106.0>
<'rabbit@node-2'.1.269.0>
<'rabbit@node-2'.1.2211.0>
<'rabbit@node-2'.1.271.0>
<'rabbit@node-2'.1.273.0>
<'rabbit@node-2'.1.773.0>
<'rabbit@node-3'.3.4194.0>
<'rabbit@node-2'.1.359.0>
<'rabbit@node-2'.1.275.0>
<'rabbit@node-2'.1.3105.1>
<'rabbit@node-2'.1.3278.1>
<'rabbit@node-2'.1.900.0>
<'rabbit@node-2'.1.277.0>
<'rabbit@node-3'.3.4139.0>
<'rabbit@node-3'.3.716.0>
<'rabbit@node-2'.1.279.0>
<'rabbit@node-2'.1.3303.1>
<'rabbit@node-2'.1.3115.1>
<'rabbit@node-2'.1.283.0>
<'rabbit@node-2'.1.3173.1>
<'rabbit@node-2'.1.285.0>
<'rabbit@node-2'.1.289.0>
<'rabbit@node-2'.1.291.0>
<'rabbit@node-2'.1.293.0>
<'rabbit@node-2'.1.295.0>
<'rabbit@node-3'.3.943.0>
<'rabbit@node-3'.3.26686.0>
<'rabbit@node-3'.3.1100.0>
<'rabbit@node-3'.3.789.0>
<'rabbit@node-2'.1.297.0>
<'rabbit@node-2'.1.299.0>
<'rabbit@node-2'.1.301.0>
<'rabbit@node-2'.1.31320.0>
<'rabbit@node-2'.1.31301.0>
<'rabbit@node-3'.3.1103.0>
<'rabbit@node-3'.3.1143.0>
<'rabbit@node-2'.1.3253.1>
<'rabbit@node-2'.1.3178.1>
<'rabbit@node-2'.1.303.0>
<'rabbit@node-2'.1.906.0>
<'rabbit@node-2'.1.903.0>
<'rabbit@node-2'.1.1744.0>
<'rabbit@node-2'.1.305.0>
<'rabbit@node-2'.1.309.0>
<'rabbit@node-3'.3.916.0>
<'rabbit@node-2'.1.374.0>
<'rabbit@node-2'.1.311.0>
<'rabbit@node-3'.3.4125.0>
<'rabbit@node-2'.1.3312.1>
<'rabbit@node-2'.1.1325.0>
<'rabbit@node-2'.1.749.0>
<'rabbit@node-3'.3.4210.0>
<'rabbit@node-2'.1.31304.0>
<'rabbit@node-2'.1.313.0>
<'rabbit@node-3'.3.4196.0>
<'rabbit@node-2'.1.591.0>
<'rabbit@node-3'.3.4130.0>
<'rabbit@node-2'.1.315.0>
<'rabbit@node-3'.3.26687.0>
<'rabbit@node-3'.3.4137.0>
<'rabbit@node-1'.3.453.0>
<'rabbit@node-3'.3.386.0>
<'rabbit@node-3'.3.5130.0>
<'rabbit@node-2'.1.319.0>
<'rabbit@node-2'.1.321.0>
<'rabbit@node-2'.1.31306.0>
<'rabbit@node-3'.3.1582.0>
<'rabbit@node-2'.1.323.0>
...done.

9. Power off second controller.
10. After 15 minutes:

root@node-3:~# rabbitmqctl list_queues pid
Listing queues ...
<'rabbit@node-3'.3.1109.0>
<'rabbit@node-3'.3.693.0>
<'rabbit@node-3'.3.4128.0>
<'rabbit@node-3'.3.4192.0>
<'rabbit@node-3'.3.401.0>
<'rabbit@node-3'.3.2686.0>
<'rabbit@node-3'.3.6045.0>
<'rabbit@node-3'.3.1581.0>
<'rabbit@node-3'.3.1106.0>
<'rabbit@node-3'.3.4194.0>
<'rabbit@node-3'.3.4139.0>
<'rabbit@node-3'.3.716.0>
<'rabbit@node-3'.3.943.0>
<'rabbit@node-3'.3.1100.0>
<'rabbit@node-3'.3.789.0>
<'rabbit@node-3'.3.1103.0>
<'rabbit@node-3'.3.1143.0>
<'rabbit@node-3'.3.916.0>
<'rabbit@node-3'.3.4125.0>
<'rabbit@node-3'.3.4210.0>
<'rabbit@node-3'.3.4196.0>
<'rabbit@node-3'.3.4130.0>
<'rabbit@node-3'.3.4137.0>
<'rabbit@node-3'.3.386.0>
<'rabbit@node-3'.3.5130.0>
<'rabbit@node-3'.3.1582.0>
...done.

Only third controller.