Comment 2 for bug 1879292

Revision history for this message
Michele Baldessari (michele) wrote :

Facter errors are benign. The issue is the following:
2020-05-17T06:34:31.158273146+00:00 stderr F Error: 'rabbitmqctl status | grep -F "{rabbit,"' returned 1 instead of one of [0]

I.e. it seems this is not returning one ever. It tries:
2020-05-17T06:02:19.763745454+00:00 stdout F Notice: /Stage[main]/Tripleo::Profile::Pacemaker::Rabbitmq_bundle/Pacemaker::Resource::Ocf[rabbitmq]/Pcmk_resource[rabbitmq]/ensure: created
2020-05-17T06:34:31.158273146+00:00 stderr F Error: 'rabbitmqctl status | grep -F "{rabbit,"' returned 1 instead of one of [0]
2020-05-17T06:34:31.165014450+00:00 stderr F Error: /Stage[main]/Tripleo::Profile::Pacemaker::Rabbitmq_bundle/Exec[rabbitmq-ready]/returns: change from 'notrun' to ['0'] failed: 'rabbitmqctl status | grep -F "{rabbit,"' returned 1 instead of one of [0]
2020-05-17T06:34:31.167860042+00:00 stdout F Notice: /Stage[main]/Tripleo::Profile::Pacemaker::Rabbitmq_bundle/Rabbitmq_policy[ha-all@/]: Dependency Exec[rabbitmq-ready] has failures: true

So it tried for 32mins but it never returned 0.
rabbitmq seems to be up:
2020-05-17T06:02:34.208968474+00:00 stderr F (log_finished) info: finished - rsc:rabbitmq action:start call_id:13 pid:208 exit-code:0 exec-time:9838ms queue-time:0ms

https://logserver.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario004-standalone-<email address hidden>
2020-05-17 06:02:31.538 [info] <0.818.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2020-05-17 06:02:31.551 [notice] <0.105.0> Changed loghwm of /<email address hidden> to 50
2020-05-17 06:02:31.789 [info] <0.8.0> Server startup complete; 3 plugins started.
 * rabbitmq_management
 * rabbitmq_management_agent
 * rabbitmq_web_dispatch

So now we need to figure out what the output of 'rabbitmqctl status' actually is.
Either somebody gives me a live env or we add puppet debug set to true (i checked and it is not set to true https://logserver.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario004-standalone-train/2a37116/logs/undercloud/var/log/extra/podman/containers/rabbitmq_init_bundle/podman_info.log.txt.gz)