Comment 2 for bug 1526351

Revision history for this message
Artem Panchenko (apanchenko-8) wrote :

As you can see docker container for RabbitMQ is running, but service is down:

[root@nailgun ~]# docker ps | grep rabbitmq
a7c397add136 fuel/rabbitmq_8.0 "/usr/sbin/init" About an hour ago Up About an hour fuel-core-8.0-rabbitmq

[root@nailgun ~]# dockerctl shell rabbitmq ps auxfw
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 3160 0.0 0.0 35884 1448 ? Rs+ 09:34 0:00 ps auxfw
root 1 0.0 0.0 40956 712 ? Ss 08:26 0:00 /usr/sbin/init
dbus 43 0.0 0.0 26592 284 ? Ss 08:26 0:00 /bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
root 83 0.0 0.0 211560 544 ? Ssl 08:26 0:00 /usr/sbin/rsyslogd -n
root 88 0.0 0.0 26156 620 ? Ss 08:26 0:00 /usr/sbin/crond -n
root 101 0.0 0.0 37496 256 ? Ss 08:26 0:00 /usr/sbin/xinetd -stayalive -pidfile /var/run/xinetd.pid
root 3105 0.0 0.0 25252 244 ? Ss 09:01 0:00 /usr/sbin/anacron -s

[root@nailgun ~]# dockerctl shell rabbitmq systemctl status rabbitmq-server.service
* rabbitmq-server.service - RabbitMQ broker
   Loaded: loaded (/etc/systemd/system/rabbitmq-server.service; enabled; vendor preset: disabled)
   Active: inactive (dead) since Tue 2015-12-15 08:27:11 UTC; 5h 41min ago
  Process: 2896 ExecStop=/usr/lib/rabbitmq/bin/rabbitmqctl stop (code=exited, status=0/SUCCESS)
  Process: 677 ExecStart=/usr/sbin/rabbitmq-server (code=killed, signal=TERM)
 Main PID: 677 (code=killed, signal=TERM)

That's what I've found in RabbitMQ logs:

http://paste.openstack.org/show/481950/

and in Docker logs (container stdout/stderr):

http://paste.openstack.org/show/481960/

According to content of '/var/tmp/setup.log' file, the service wasn't started because of `pkill -u rabbitmq` returned non-zero value (no processes found):

+ rm -f '/var/lib/rpm/__db.*'
+ rpm --rebuilddb
+ mkdir -p /var/log/rabbitmq
+ chown -R rabbitmq:rabbitmq /var/log/rabbitmq
+ systemctl daemon-reload
+ puppet apply --debug --verbose --color false --detailed-exitcodes --logdest /var/log/puppet/rabbitmq.log /etc/puppet/modules/nailgun/examples/rabbitmq-only.pp
Unable to add resolve nil for fact osd_devices_list: unexpected return
Could not retrieve fact='ssh_client_version_full', resolution='<anonymous>': undefined method `lines' for nil:NilClass
Could not retrieve fact='ssh_client_version_full', resolution='<anonymous>': undefined method `lines' for nil:NilClass
Could not retrieve fact='ssh_client_version_major', resolution='<anonymous>': undefined method `gsub' for nil:NilClass
Could not retrieve fact='ssh_client_version_full', resolution='<anonymous>': undefined method `lines' for nil:NilClass
Could not retrieve fact='ssh_client_version_release', resolution='<anonymous>': undefined method `gsub' for nil:NilClass
Could not retrieve fact='ssh_server_version_full', resolution='<anonymous>': undefined method `lines' for nil:NilClass
Could not retrieve fact='ssh_server_version_full', resolution='<anonymous>': undefined method `lines' for nil:NilClass
Could not retrieve fact='ssh_server_version_major', resolution='<anonymous>': undefined method `gsub' for nil:NilClass
Could not retrieve fact='ssh_server_version_full', resolution='<anonymous>': undefined method `lines' for nil:NilClass
Could not retrieve fact='ssh_server_version_release', resolution='<anonymous>': undefined method `gsub' for nil:NilClass
+ [[ 2 == 2 ]]
+ systemctl stop rabbitmq-server.service
+ pkill -u rabbitmq