ceph version hangs and devstack cannot finish running

[Victoria Martinez de la Cruz]

Reproducible with newers version of Ceph (Nautilus and beyond).

++++ /opt/stack/devstack-plugin-ceph/devstack/lib/ceph:_get_ceph_version:237 : sudo ceph daemon mon.$id version
admin_socket: exception getting command descriptions: [Errno 2] No such file or directory

The admin socket /var/run/ceph/ceph-mon.$id.asok is created, but the mon service starts right before it is created.

Restarting the mon service is a proper workaround since the script continues to run and finish successfully, but we should add some access control over that call so we avoid this problem at all.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/722427

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/722427
Committed: https://git.openstack.org/cgit/openstack/devstack-plugin-ceph/commit/?id=a97b1449cde413277b896854104645786d290a89
Submitter: Zuul
Branch: master

commit a97b1449cde413277b896854104645786d290a89
Author: Victoria Martinez de la Cruz <email address hidden>
Date: Thu Apr 23 18:52:55 2020 +0000

    Check that ceph-mon service has started to get its version

    Add an extra check to verify that ceph-mon service has started
    before trying to retrieve its version.

    An already existing function is being used, wait_for_daemon

    Since we now guarantee that we are using systemctl, we can use
    the is-active feature. If the service is running, the exit code
    will be 0.

    Also, change the command used to get the mon version. We can use
    the ceph version command provided by the new cli instead of using
    ceph daemon command which requires more privileges.

    Change-Id: I2d4f23721107c4b5cb1c09719c55424eecd0c880
    Closes-Bug: #1872855