Fuel master node deployment failed with ERROR: rabbitmq failed to start.
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Fix Released
|
Critical
|
Artem Panchenko |
Bug Description
Steps:
1. Start fuel installation
Actual result - installation failed:
http://
VERSION:
feature_groups:
- mirantis
production: "docker"
release: "8.0"
api: "1.0"
build_number: "292"
build_id: "292"
fuel-nailgun_sha: "a0ca2ca443abfe
python-
fuel-agent_sha: "06bd5bc2280fa2
fuel-
astute_sha: "1c3a981dff739f
fuel-library_sha: "8f2f65f2ed1730
fuel-ostf_sha: "9910a4726cbd03
fuel-mirror_sha: "31b9df814960ec
fuelmenu_sha: "680b720291ff57
shotgun_sha: "a0bd0650806793
network-
fuel-upgrade_sha: "1e894e26d4e142
fuelmain_sha: "7702258023b34e
tags: | added: swarm-fail-driver |
Changed in fuel: | |
status: | Fix Committed → Fix Released |
As you can see docker container for RabbitMQ is running, but service is down:
[root@nailgun ~]# docker ps | grep rabbitmq 8.0-rabbitmq
a7c397add136 fuel/rabbitmq_8.0 "/usr/sbin/init" About an hour ago Up About an hour fuel-core-
[root@nailgun ~]# dockerctl shell rabbitmq ps auxfw activation
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 3160 0.0 0.0 35884 1448 ? Rs+ 09:34 0:00 ps auxfw
root 1 0.0 0.0 40956 712 ? Ss 08:26 0:00 /usr/sbin/init
dbus 43 0.0 0.0 26592 284 ? Ss 08:26 0:00 /bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-
root 83 0.0 0.0 211560 544 ? Ssl 08:26 0:00 /usr/sbin/rsyslogd -n
root 88 0.0 0.0 26156 620 ? Ss 08:26 0:00 /usr/sbin/crond -n
root 101 0.0 0.0 37496 256 ? Ss 08:26 0:00 /usr/sbin/xinetd -stayalive -pidfile /var/run/xinetd.pid
root 3105 0.0 0.0 25252 244 ? Ss 09:01 0:00 /usr/sbin/anacron -s
[root@nailgun ~]# dockerctl shell rabbitmq systemctl status rabbitmq- server. service server. service - RabbitMQ broker system/ rabbitmq- server. service; enabled; vendor preset: disabled) /usr/lib/ rabbitmq/ bin/rabbitmqctl stop (code=exited, status=0/SUCCESS) /usr/sbin/ rabbitmq- server (code=killed, signal=TERM)
* rabbitmq-
Loaded: loaded (/etc/systemd/
Active: inactive (dead) since Tue 2015-12-15 08:27:11 UTC; 5h 41min ago
Process: 2896 ExecStop=
Process: 677 ExecStart=
Main PID: 677 (code=killed, signal=TERM)
That's what I've found in RabbitMQ logs:
http:// paste.openstack .org/show/ 481950/
and in Docker logs (container stdout/stderr):
http:// paste.openstack .org/show/ 481960/
According to content of '/var/tmp/ setup.log' file, the service wasn't started because of `pkill -u rabbitmq` returned non-zero value (no processes found):
+ rm -f '/var/lib/ rpm/__db. *' exitcodes --logdest /var/log/ puppet/ rabbitmq. log /etc/puppet/ modules/ nailgun/ examples/ rabbitmq- only.pp client_ version_ full', resolution= '<anonymous> ': undefined method `lines' for nil:NilClass client_ version_ full', resolution= '<anonymous> ': undefined method `lines' for nil:NilClass client_ version_ major', resolution= '<anonymous> ': undefined method `gsub' for nil:NilClass client_ version_ full', resolution= '<anonymous> ': undefined method `lines' for nil:NilClass client_ version_ release' , resolution= '<anonymous> ': undefined method `gsub' for nil:NilClass server_ version_ full', resolution= '<anonymous> ': undefined method `lines' for nil:NilClass server_ version_ full', resolution= '<anonymous> ': undefined method `lines' for nil:NilClass server_ version_ major', resol...
+ rpm --rebuilddb
+ mkdir -p /var/log/rabbitmq
+ chown -R rabbitmq:rabbitmq /var/log/rabbitmq
+ systemctl daemon-reload
+ puppet apply --debug --verbose --color false --detailed-
Unable to add resolve nil for fact osd_devices_list: unexpected return
Could not retrieve fact='ssh_
Could not retrieve fact='ssh_
Could not retrieve fact='ssh_
Could not retrieve fact='ssh_
Could not retrieve fact='ssh_
Could not retrieve fact='ssh_
Could not retrieve fact='ssh_
Could not retrieve fact='ssh_