N->O After successful upgrade of the undercloud rabbitmq is non functionning.

[Sofer Athlan-Guyot]

Hi,

Install newton and upgrade the undercloud. Then the epmd socket is in error:

    ● [e-mail] loaded failed failed Erlang Port Mapper Daemon Activation Socket

I had to:

   systemctl stop rabbitmq

Get the pid of the left epmd process:

   ps fauxww | grep rabbitmq

kill it

   kill 11268

and then restart rabbitmq:

   systemctl restart rabbitmq-server

So, I think there is a problem during the upgrade where the rabbitmq process is not "properly" restarted.

Can anybody else check if it has the same problem with epmd socket ?

[Michele Baldessari (michele)]

I am moderately sure I have seen this also on fresh deploys and if systemctl status rabbitmq-server is active then we should be okay. I will double-check on new deployments.

[Michele Baldessari (michele)]

So I checked from an older newton undercloud sosreport and I have:
sos_commands/systemd/systemctl_list-units_--failed:* [e-mail] loaded failed failed Erlang Port Mapper Daemon Activation Socket
sos_commands/systemd/systemctl_list-units_--all: [e-mail] loaded inactive dead Erlang Port Mapper Daemon
sos_commands/systemd/systemctl_list-units_--all: system-epmd.slice loaded inactive dead system-epmd.slice

So this is something that is just like that all the time, probably. Worth asking eck or peter about it though.

[Emilien Macchi (emilienm)]

It sounds like the CI job that test undercloud upgrades doesn't hit it or?

See nova-scheduler:
http://logs.openstack.org/52/439052/2/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/c9f6b7a/logs/var/log/nova/nova-scheduler.txt.gz#_2017-02-28_17_32_16_254

After the upgrade, nova is able to reconnect to rabbitmq.

[Michele Baldessari (michele)]

yeah i think this epmd socket activation is a false alarm. as long as rabbitmq is up it is all good as erlang will start the listener anyway. It'd be nice to remove the failed status, but nothing major here.

[Sofer Athlan-Guyot (sofer-athlan-guyot)]

So yeah, it would be nice to get rid of the this false alarm in the systemd listing.

[Sofer Athlan-Guyot (sofer-athlan-guyot)]

Well, this is not a really important issue and may not be relevant anymore.