IOError: Socket closed When creating a deployment

[Tyler Wilson]

{"build_id": "2014-08-19_05-27-34", "ostf_sha": "d2a894d228c1f3c22595a77f04b1e00d09d8e463", "build_number": "81", "auth_required": true, "api": "1.0", "nailgun_sha": "36d27ff737b361f92093986d061bbfc1670bee45", "production": "docker", "fuelmain_sha": "a19c69d1b80abb6dfa5bc8caafb11b32551c2cf8", "astute_sha": "efe3cb3668b9079e68fb1534fd4649ac45a344e1", "feature_groups": ["experimental"], "release": "5.1", "fuellib_sha": "85bf0728a8cbb5385cd644b2103c878b4251ccca"}

1. Create new environment (Ubuntu, HA mode)
2. Choose GRE segmentation
3. Add controller x3 + Ceilometer
4. Add computes x3 + Ceph OSD

Deployment fails with " A server error has occured. Please contact the administrators." Fuel Snapshot cannot be created and network verification tests fail with 'Socket Closed'

Logs show:

2014-08-20 00:32:42 ERROR
[7f66546bb740] (logger) Response code '500 Internal Server Error' for PUT /api/clusters/2/changes from 172.17.42.1:55715
2014-08-20 00:32:42 ERROR
[7f66546bb740] (logger) Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/web/application.py", line 239, in process
    return self.handle()
  File "/usr/lib/python2.6/site-packages/web/application.py", line 230, in handle
    return self._delegate(fn, self.fvars, args)
  File "/usr/lib/python2.6/site-packages/web/application.py", line 420, in _delegate
    return handle_class(cls)
  File "/usr/lib/python2.6/site-packages/web/application.py", line 396, in handle_class
    return tocall(*args)
  File "<string>", line 2, in PUT
  File "/usr/lib/python2.6/site-packages/nailgun/api/v1/handlers/base.py", line 93, in content_json
    data = func(*args, **kwargs)
  File "/usr/lib/python2.6/site-packages/nailgun/api/v1/handlers/base.py", line 364, in PUT
    task = task_manager.execute()
  File "/usr/lib/python2.6/site-packages/nailgun/task/manager.py", line 260, in execute
    rpc.cast('naily', task_messages)
  File "/usr/lib/python2.6/site-packages/nailgun/rpc/__init__.py", line 92, in cast
    publish()
  File "/usr/lib/python2.6/site-packages/kombu/messaging.py", line 168, in publish
    routing_key, mandatory, immediate, exchange, declare)
  File "/usr/lib/python2.6/site-packages/kombu/messaging.py", line 173, in _publish
    channel = self.channel
  File "/usr/lib/python2.6/site-packages/kombu/messaging.py", line 190, in _get_channel
    channel = self._channel = channel()
  File "/usr/lib/python2.6/site-packages/kombu/utils/__init__.py", line 422, in __call__
    value = self.__value__ = self.__contract__()
  File "/usr/lib/python2.6/site-packages/kombu/messaging.py", line 205, in <lambda>
    channel = ChannelPromise(lambda: connection.default_channel)
  File "/usr/lib/python2.6/site-packages/kombu/connection.py", line 773, in default_channel
    self.connection
  File "/usr/lib/python2.6/site-packages/kombu/connection.py", line 758, in connection
    self._connection = self._establish_connection()
  File "/usr/lib/python2.6/site-packages/kombu/connection.py", line 713, in _establish_connection
    conn = self.transport.establish_connection()
  File "/usr/lib/python2.6/site-packages/kombu/transport/pyamqp.py", line 112, in establish_connection
    conn = self.Connection(**opts)
  File "/usr/lib/python2.6/site-packages/amqp/connection.py", line 180, in __init__
    (10, 30), # tune
  File "/usr/lib/python2.6/site-packages/amqp/abstract_channel.py", line 67, in wait
    self.channel_id, allowed_methods)
  File "/usr/lib/python2.6/site-packages/amqp/connection.py", line 237, in _wait_method
    self.method_reader.read_method()
  File "/usr/lib/python2.6/site-packages/amqp/method_framing.py", line 189, in read_method
    raise m
IOError: Socket closed

I've attempted restarting rabbitmq via 'supervisorctl restart docker-rabbitmq' however the socket errors remain.

This is the current docker logs for the rabbitmq container;
[root@fuel ~]# docker logs 5ccf45c4d6b6
Info: Loading facts in /etc/puppet/modules/corosync/lib/facter/pacemaker_hostname.rb
Info: Loading facts in /etc/puppet/modules/swift/lib/facter/swift_mountpoints.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/check_kern_module.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/openvswitch.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/default_route.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/ovs_vlan_splinters.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/fqdn_hostname.rb
Info: Loading facts in /etc/puppet/modules/nailgun/lib/facter/fuel_version.rb
Info: Loading facts in /etc/puppet/modules/nailgun/lib/facter/iops.rb
Info: Loading facts in /etc/puppet/modules/nailgun/lib/facter/generate_fuel_key.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/puppet_semantic_version.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/hostprivkey.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/cakey.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/cacert.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/localacacert.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/hostcert.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/cacrl.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/certname.rb
Info: Loading facts in /etc/puppet/modules/osnailyfacter/lib/facter/naily.rb
Info: Loading facts in /etc/puppet/modules/lvm/lib/facter/lvm_support.rb
Info: Loading facts in /etc/puppet/modules/galera/lib/facter/galera_gcomm_empty.rb
Info: Loading facts in /etc/puppet/modules/galera/lib/facter/mysql_log_file_size_real.rb
Info: Loading facts in /etc/puppet/modules/firewall/lib/facter/ip6tables_version.rb
Info: Loading facts in /etc/puppet/modules/firewall/lib/facter/iptables_persistent_version.rb
Info: Loading facts in /etc/puppet/modules/firewall/lib/facter/iptables_version.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/root_home.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/pe_version.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/puppet_vardir.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/facter_dot_d.rb
Info: Loading facts in /etc/puppet/modules/neutron/lib/facter/defaultroute.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/nova_compute.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/glance_api_conf.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/ceph_osd.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/keystone_conf.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/ceph_conf.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/cinder_conf.rb
Info: Loading facts in /etc/puppet/modules/concat/lib/facter/concat_basedir.rb
ls: cannot access /dev/sda?*: No such file or directory
ls: cannot access /dev/sda?*: No such file or directory
Warning: Config file /etc/puppet/hiera.yaml not found, using Hiera defaults
Notice: Compiled catalog for 5ccf45c4d6b6.ubiquity.io in environment production in 2.60 seconds
Info: Loading facts in /etc/puppet/modules/corosync/lib/facter/pacemaker_hostname.rb
Info: Loading facts in /etc/puppet/modules/swift/lib/facter/swift_mountpoints.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/check_kern_module.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/openvswitch.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/default_route.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/ovs_vlan_splinters.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/fqdn_hostname.rb
Info: Loading facts in /etc/puppet/modules/nailgun/lib/facter/fuel_version.rb
Info: Loading facts in /etc/puppet/modules/nailgun/lib/facter/iops.rb
Info: Loading facts in /etc/puppet/modules/nailgun/lib/facter/generate_fuel_key.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/puppet_semantic_version.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/hostprivkey.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/cakey.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/cacert.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/localacacert.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/hostcert.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/cacrl.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/certname.rb
Info: Loading facts in /etc/puppet/modules/osnailyfacter/lib/facter/naily.rb
Info: Loading facts in /etc/puppet/modules/lvm/lib/facter/lvm_support.rb
Info: Loading facts in /etc/puppet/modules/galera/lib/facter/galera_gcomm_empty.rb
Info: Loading facts in /etc/puppet/modules/galera/lib/facter/mysql_log_file_size_real.rb
Info: Loading facts in /etc/puppet/modules/firewall/lib/facter/ip6tables_version.rb
Info: Loading facts in /etc/puppet/modules/firewall/lib/facter/iptables_persistent_version.rb
Info: Loading facts in /etc/puppet/modules/firewall/lib/facter/iptables_version.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/root_home.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/pe_version.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/puppet_vardir.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/facter_dot_d.rb
Info: Loading facts in /etc/puppet/modules/neutron/lib/facter/defaultroute.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/nova_compute.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/glance_api_conf.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/ceph_osd.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/keystone_conf.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/ceph_conf.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/cinder_conf.rb
Info: Loading facts in /etc/puppet/modules/concat/lib/facter/concat_basedir.rb
ls: cannot access /dev/sda?*: No such file or directory
ls: cannot access /dev/sda?*: No such file or directory
Info: Applying configuration version '1408486426'
Notice: /Stage[main]/Rabbitmq::Server/Package[qpid-cpp-server]/ensure: created
Info: /Stage[main]/Rabbitmq::Server/File[rabbitmq-env.config]: Filebucketed /etc/rabbitmq/rabbitmq-env.conf to puppet with sum 4d49f2721ad5bf51f846c069127a8aa2
Notice: /Stage[main]/Rabbitmq::Server/File[rabbitmq-env.config]/content: content changed '{md5}4d49f2721ad5bf51f846c069127a8aa2' to '{md5}5a31ceabe976f2312ead3292b5b13b72'
Info: /Stage[main]/Rabbitmq::Server/File[rabbitmq-env.config]: Scheduling refresh of Class[Rabbitmq::Service]
Info: Class[Rabbitmq::Service]: Scheduling refresh of Service[rabbitmq-server]
Notice: Module rabbitmq cannot notify service rabbitmq-server on package rabbitmq-server update
Notice: /Stage[main]/Rabbitmq::Service/Notify[Module rabbitmq cannot notify service rabbitmq-server on package rabbitmq-server update]/message: defined 'message' as 'Module rabbitmq cannot notify service rabbitmq-server on package rabbitmq-server update'
Error: Could not start Service[rabbitmq-server]: Execution of '/sbin/service rabbitmq-server start' returned 1:
Error: /Stage[main]/Rabbitmq::Service/Service[rabbitmq-server]/ensure: change from stopped to running failed: Could not start Service[rabbitmq-server]: Execution of '/sbin/service rabbitmq-server start' returned 1:
Notice: /Stage[main]/Rabbitmq::Service/Service[rabbitmq-server]/ensure: ensure changed 'stopped' to 'running'
Notice: /Stage[main]/Rabbitmq::Service/Service[rabbitmq-server]/enable: enable changed 'false' to 'true'
Notice: /Stage[main]/Rabbitmq::Service/Service[rabbitmq-server]: Triggered 'refresh' from 1 events
Notice: /Stage[main]/Rabbitmq::Server/Rabbitmq_user[guest]: Dependency Service[rabbitmq-server] has failures: true
Warning: /Stage[main]/Rabbitmq::Server/Rabbitmq_user[guest]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_user[naily]: Dependency Service[rabbitmq-server] has failures: true
Warning: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_user[naily]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_vhost[mcollective]: Dependency Service[rabbitmq-server] has failures: true
Warning: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_vhost[mcollective]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Rabbitmq/Anchor[nailgun::rabbitmq end]: Dependency Service[rabbitmq-server] has failures: true
Warning: /Stage[main]/Nailgun::Rabbitmq/Anchor[nailgun::rabbitmq end]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_vhost[/]: Dependency Service[rabbitmq-server] has failures: true
Warning: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_vhost[/]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_user_permissions[naily@/]: Dependency Service[rabbitmq-server] has failures: true
Warning: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_user_permissions[naily@/]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_user[mcollective]: Dependency Service[rabbitmq-server] has failures: true
Warning: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_user[mcollective]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_user_permissions[mcollective@mcollective]: Dependency Service[rabbitmq-server] has failures: true
Warning: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_user_permissions[mcollective@mcollective]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Rabbitmq/Exec[create-mcollective-broadcast-exchange]: Dependency Service[rabbitmq-server] has failures: true
Warning: /Stage[main]/Nailgun::Rabbitmq/Exec[create-mcollective-broadcast-exchange]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Rabbitmq/Exec[create-mcollective-directed-exchange]: Dependency Service[rabbitmq-server] has failures: true
Warning: /Stage[main]/Nailgun::Rabbitmq/Exec[create-mcollective-directed-exchange]: Skipping because of failed dependencies
Notice: Finished catalog run in 35.71 seconds
Stopping rabbitmq-server: rabbitmq-server.

              RabbitMQ 3.3.5. Copyright (C) 2007-2014 GoPivotal, Inc.
  ## ## Licensed under the MPL. See http://www.rabbitmq.com/
  ## ##
  ########## Logs: /var/log/rabbitmq/[e-mail]
  ###### ## /var/log/rabbitmq/[e-mail]
  ##########
              Starting broker... completed with 7 plugins.

[Tyler Wilson (loth)]

After a reboot of the fuel master I was able to delete the old env's and download the support snapshot

[Dima Shulyak (dshulyak)]

I see a lot of next errors:

=ERROR REPORT==== 20-Aug-2014::00:40:40 ===
closing AMQP connection <0.27943.0> (172.17.42.1:49155 -> 172.17.0.3:5672):
{handshake_error,starting,0,
                 {amqp_error,access_refused,
                             "PLAIN login refused: user 'naily' - invalid credentials",
                             'connection.start_ok'}}

It is unclear why it can happen, but i will try to reproduce

[Dima Shulyak (dshulyak)]

oh, all the configuration was skiped on first attemt

Notice: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_user_permissions[naily@/]: Dependency Service[rabbitmq-server] has failures: true
Warning: /Stage[main]/Nailgun::Rabbitmq/Rabbitmq_user_permissions[naily@/]: Skipping because of failed dependencies

because

Execution of '/sbin/service rabbitmq-server start' returned 1:

[Bogdan Dobrelya (bogdando)]

Cannot reproduce it yet. In logs attached there are the signs of internal nailgun 500 errors could be an rc:
2014-08-20 00:15:15 ./docker-logs/nailgun/api.log:2014-08-20 00:15:15.297 ERROR [7f66546bb740] (logger) Response code '500 Internal Server Error' for PUT /api/clusters/1/changes from 172.17.42.1:54075
2014-08-20 00:15:15 ./docker-logs/nailgun/app.log:2014-08-20 00:15:15.213 ERROR [7f66546bb740] (base) Error during execution of deployment task on environment '1': Socket closed
2014-08-20 00:20:33 ./docker-logs/nailgun/api.log:2014-08-20 00:20:33.875 ERROR [7f66546bb740] (logger) Response code '500 Internal Server Error' for PUT /api/v1/clusters/1/reset/ from 23.105.89.2:54402
2014-08-20 00:32:42 ./docker-logs/nailgun/api.log:2014-08-20 00:32:42.569 ERROR [7f66546bb740] (logger) Response code '500 Internal Server Error' for PUT /api/clusters/2/changes from 172.17.42.1:55715
2014-08-20 00:32:42 ./docker-logs/nailgun/app.log:2014-08-20 00:32:42.568 ERROR [7f66546bb740] (base) Error during execution of deployment task on environment '2': Socket closed
2014-08-20 01:34:42 ./docker-logs/nailgun/api.log:2014-08-20 01:34:42.931 ERROR [7f66546bb740] (logger) Response code '500 Internal Server Error' for GET /api/tasks/20?_=1408492798379 from 172.17.42.1:36479
2014-08-20 01:34:50 ./docker-logs/nailgun/api.log:2014-08-20 01:34:50.118 ERROR [7f66546bb740] (logger) Response code '500 Internal Server Error' for GET /api/tasks/12?_=1408492798383 from 172.17.42.1:54268

[Bogdan Dobrelya (bogdando)]

Please elaborate reproducing steps (cannot reproduce)

[Tyler Wilson (loth)]

Just reproduced with latest master image;

VERSION:
  feature_groups:
    - experimental
  production: "docker"
  release: "5.1"
  api: "1.0"
  build_number: "83"
  build_id: "2014-08-20_07-32-11"
  astute_sha: "efe3cb3668b9079e68fb1534fd4649ac45a344e1"
  fuellib_sha: "fa23adb05c58fdad5011a3ad806467eb3d883217"
  ostf_sha: "c6ecd0137b5d7c1576fa65baef0fc70f9a150daa"
  nailgun_sha: "36d27ff737b361f92093986d061bbfc1670bee45"
  fuelmain_sha: "365fc0bfe9d5e4ce38101d9158f66347bf32c310"

No environment creation needed to reproduce, rabbitMQ fails to start on initial install of fuel master.
I SSH'ed in after I noticed the tries reaching 200+ on each service starting and got the logs of the docker instance;

[root@fuel ~]# docker logs 1d763443ac59
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/cacert.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/puppet_semantic_version.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/certname.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/cakey.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/localacacert.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/hostprivkey.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/cacrl.rb
Info: Loading facts in /etc/puppet/modules/puppet/lib/facter/hostcert.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/nova_compute.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/ceph_osd.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/ceph_conf.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/glance_api_conf.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/keystone_conf.rb
Info: Loading facts in /etc/puppet/modules/ceph/lib/facter/cinder_conf.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/facter_dot_d.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/puppet_vardir.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/pe_version.rb
Info: Loading facts in /etc/puppet/modules/stdlib/lib/facter/root_home.rb
Info: Loading facts in /etc/puppet/modules/osnailyfacter/lib/facter/naily.rb
Info: Loading facts in /etc/puppet/modules/lvm/lib/facter/lvm_support.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/openvswitch.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/check_kern_module.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/ovs_vlan_splinters.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/fqdn_hostname.rb
Info: Loading facts in /etc/puppet/modules/l23network/lib/facter/default_route.rb
Info: Loading facts in /etc/puppet/modules/neutron/lib/facter/defaultroute.rb
Info: Loading facts in /etc/puppet/modules/concat/lib/facter/concat_basedir.rb
Info: Loading facts in /etc/puppet/modules/nailgun/lib/facter/generate_fuel_key.rb
Info: Loading facts in /etc/puppet/modules/nailgun/lib/facter/fuel_version.rb
Info: Loading facts in /etc/puppet/modules/nailgun/lib/facter/iops.rb
Info: Loading facts in /etc/puppet/modules/swift/lib/facter/swift_mountpoints.rb
Info: Loading facts in /etc/puppet/modules/corosync/lib/facter/pacem...

[Tyler Wilson (loth)]

Support snapshot (after reboot)

[Dima Shulyak (dshulyak)]

I dont understand why this bug was set as incomplete or new.
The issue is there, and puppet will not create user/vhost if rabbit failed to start

Nailgun returns 500 because there is no correct user created

[Dima Shulyak (dshulyak)]

I think we need to shutdown container in case it was not possible to start rabbitmq service
In such case it will be restarted by supervisord, with additional attempt to create vhost/user once again

[Matthew Mosesohn (raytrac3r)]

Let's solve this the same way we solved keystone https://review.openstack.org/#/c/116613/

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/116873

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/116873
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=15feac0ba50a2b681c1a33694dbe4c6980094f86
Submitter: Jenkins
Branch: master

commit 15feac0ba50a2b681c1a33694dbe4c6980094f86
Author: Matthew Mosesohn <email address hidden>
Date: Tue Aug 26 16:03:57 2014 +0400

    Exit rabbitmq container if puppet apply fails

    Puppet now runs for rabbitmq container with
    detailed exitcodes, allowing us to fail start
    of container with start.sh. Sometimes restarting
    the container will resolve rare issues where
    rabbitmq service doesn't start from its init script.

    Change-Id: I108cc4521fa7e193c68ede466b5829ad33464224
    Closes-Bug: #1358972

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/116912

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/116912
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=74a97d500bb2fe9528f99771ccc2ec657ae3f76e
Submitter: Jenkins
Branch: master

commit 74a97d500bb2fe9528f99771ccc2ec657ae3f76e
Author: Matthew Mosesohn <email address hidden>
Date: Tue Aug 26 18:51:28 2014 +0400

    Fix incorrect puppet manifest for rabbitmq

    Change-Id: Ie732abc4323a4775cd39a72ba5f5f71e0f65557f
    Related-Bug: #1358972