Volume stuck in creating state

[Andrey Sledzinskiy]

Bug is reproduced on {"build_id": "2014-04-07_04-17-26", "mirantis": "yes", "build_number": "270", "nailgun_sha": "7a05e365240ab27c492b20585ef8ac8557102cc0", "ostf_sha": "de0222fed646525d248dc6892eeceab139d5c469", "fuelmain_sha": "5714f2a3cf56ebdc124e9555dfff0fe274e84bdd", "astute_sha": "55df06b2e84fa5d71a1cc0e78dbccab5db29d968", "release": "4.1", "fuellib_sha": "52e7f57695f33bafa5d84d524d77f1bc3a2289b2"}

Steps:
1. Create next cluster - Ubuntu, Simple, KVM, Neutron Valn, Ceph for images, Cinder for volumes, Ceilometer
2. Add 1 controller, 1 compute, 1 cinder, 2 ceph nodes
3. Deploy cluster
4. Try to create volume on Horizon dashboard

Expected - volume can be created
Actual - volume stuck in creating state

Diagnostic snapshot is attached

[Dmitry Borodaenko (angdraug)]

According to astute.yaml Cinder backend was set to LVM, not Ceph:

storage:
  volumes_ceph: false
  objects_ceph: false
  ephemeral_ceph: false
  volumes_lvm: true
  pg_num: 256
  osd_pool_size: '2'
  images_ceph: true

And Cinder logs from the cinder node (node-18) are full of reports of lost connectivity to MySQL and RabbitMQ:

2014-04-09T11:36:29.440454+00:00 warning: WARNING: Got mysql server has gone away: (2006, 'MySQL server has gone away')
2014-04-09T11:01:18.672778+00:00 err: ERROR: Failed to publish message to topic 'cinder-scheduler': Socket closed
2014-04-09T11:01:18.676548+00:00 info: INFO: Reconnecting to AMQP server on 192.168.0.2:5672
2014-04-09T11:01:18.685531+00:00 info: INFO: Connected to AMQP server on 192.168.0.2:5672

It looks like the volume creation has locked up due to a network problem on the controller.