openstack overcloud ceph-upgrade run fails with error ""stat: cannot stat '/var/run/ceph/ceph-mon.controller-3.localdomain.asok': No such file or directory"

[Francesco Pantano]

 When a minor update is run the overcloud fails with the error:

mon.controller-3.localdomain.asok': No such file or directory", "stderr_lines": ["stat: cannot stat '/var/run/ceph/ceph-mon.controller-3.asok': No such file or directory", "stat: cannot stat '/var/run/ceph/ceph-mon.controller-3.localdomain.asok': No such file or directory"], "stdout": "", "stdout_lines": []}

# docker exec ceph-mon-controller-3 sh -c stat /var/run/ceph/ceph-mon.controller-3.asok || stat /var/run/ceph/ceph-mon.controller-3.localdomain.asok
stat: missing operand
Try 'stat --help' for more information.
stat: cannot stat ‘/var/run/ceph/ceph-mon.controller-3.localdomain.asok’: No such file or directory

None of the .asok does exist inside the container. It only has the asok for ceph-mgr container.

# docker exec -it ceph-mon-controller-3 /bin/bash
# ls /var/run/ceph/
ceph-mgr.controller-3.asok

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/753636
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=9edeaaff3b05648ca9cd10784f6593ad4273f71d
Submitter: Zuul
Branch: stable/queens

commit 9edeaaff3b05648ca9cd10784f6593ad4273f71d
Author: Francesco Pantano <email address hidden>
Date: Wed Sep 23 14:50:51 2020 +0200

    [QUEENS-ONLY] Make ceph mons consistent with their systemd unit

    This change is required to recover from an update scenario
    that fails because of the bug:

    Closes-Bug: #1897240
    Change-Id: I1ea5a80b482e7a4f1147abb74d5357b60a142daa

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-heat-templates queens-eol release.