Enhance Ceph: option require-osd-release

[Gabriel Cocenza]

Following the OpenStack upgrade documentation [0] there is a warning regarding ceph [1].

I think the documentation could be more clear that setting require-osd-release should happen after ceph-osd upgrade, otherwise running after ceph-mon upgrade the command will fail. Suggestion:

1. On any ceph-mon unit, the current value of the option can be queried with:
   sudo ceph osd dump | grep require_osd_release

2. If it needs changing, it can be done manually on any ceph-mon unit. Here the current release is Nautilus:
   sudo ceph osd require-osd-release nautilus

3. In addition, upon completion of `all` ceph charms, the option should be set to the new release. Here the new release is Octopus:
    sudo ceph osd require-osd-release octopus

[0] https://docs.openstack.org/charm-guide/latest/admin/upgrades/openstack.html
[1] https://docs.openstack.org/charm-guide/latest/project/issues/upgrade-issues.html#ceph-require-osd-release

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/charm-guide/+/899206

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/charm-guide/+/899206
Committed: https://opendev.org/openstack/charm-guide/commit/3f8449d46e654830a68c6d9d86d846350913223f
Submitter: "Zuul (22348)"
Branch: master

commit 3f8449d46e654830a68c6d9d86d846350913223f
Author: Peter Matulis <email address hidden>
Date: Tue Oct 24 15:28:47 2023 -0400

    Clarify Ceph payload upgrades

    Fix confusion around some steps involving Ceph charm payload
    upgrades.

    Closes-Bug: #2040310
    Change-Id: I2774c26bba1b4833fa6e49ed746b7d48a6077c74
    Signed-off-by: Peter Matulis <email address hidden>