Tested on groovy lsb_release -a -------------- Distributor ID: Ubuntu Description: Ubuntu 20.10 Release: 20.10 Codename: groovy dpkg -l | grep ceph ii ceph 15.2.8-0ubuntu0.20.10.1 amd64 distributed storage and file system ii ceph-base 15.2.8-0ubuntu0.20.10.1 amd64 common ceph daemon libraries and management tools ii ceph-common 15.2.8-0ubuntu0.20.10.1 amd64 common utilities to mount and interact with a ceph storage cluster ii ceph-mds 15.2.8-0ubuntu0.20.10.1 amd64 metadata server for the ceph distributed file system ii ceph-mgr 15.2.8-0ubuntu0.20.10.1 amd64 manager for the ceph distributed file system ii ceph-mgr-modules-core 15.2.8-0ubuntu0.20.10.1 all ceph manager modules which are always enabled ii ceph-mon 15.2.8-0ubuntu0.20.10.1 amd64 monitor server for the ceph storage system ii ceph-osd 15.2.8-0ubuntu0.20.10.1 amd64 OSD server for the ceph storage system ii libcephfs2 15.2.8-0ubuntu0.20.10.1 amd64 Ceph distributed file system client library ii python3-ceph-argparse 15.2.8-0ubuntu0.20.10.1 amd64 Python 3 utility libraries for Ceph CLI ii python3-ceph-common 15.2.8-0ubuntu0.20.10.1 all Python 3 utility libraries for Ceph ii python3-cephfs 15.2.8-0ubuntu0.20.10.1 amd64 Python 3 libraries for the Ceph libcephfs library ceph versions { "mon": { "ceph version 15.2.8 (bdf3eebcd22d7d0b3dd4d5501bee5bac354d5b55) octopus (stable)": 1 }, "mgr": { "ceph version 15.2.8 (bdf3eebcd22d7d0b3dd4d5501bee5bac354d5b55) octopus (stable)": 1 }, "osd": { "ceph version 15.2.8 (bdf3eebcd22d7d0b3dd4d5501bee5bac354d5b55) octopus (stable)": 3 }, "mds": {}, "overall": { "ceph version 15.2.8 (bdf3eebcd22d7d0b3dd4d5501bee5bac354d5b55) octopus (stable)": 5 } } Enabled balancer and do I/O --------------------------- ceph mgr module enable balancer ceph balancer on ceph osd set-require-min-compat-client luminous ceph balancer mode upmap ceph balancer status ceph osd pool create test 128 128 rados bench -p test 10 write --no-cleanup ceph -s -- cluster: id: dbb7d488-75c5-11eb-ae41-9f233e631612 health: HEALTH_OK services: mon: 1 daemons, quorum juju-cfcb57-ussuri-0 (age 10m) mgr: juju-cfcb57-ussuri-0(active, since 10m) osd: 5 osds: 3 up (since 7m), 3 in (since 2h) data: pools: 2 pools, 114 pgs objects: 337 objects, 1.3 GiB usage: 7.0 GiB used, 23 GiB / 30 GiB avail pgs: 0.877% pgs not active 113 active+clean 1 peering progress: PG autoscaler decreasing pool 2 PGs from 128 to 32 (60s) [==..........................] (remaining: 8m) for pg in 2.60 2.61 2.62 2.63 2.64 2.65 2.66 2.67 2.68 2.69 2.6a 2.6b 2.6c 2.6d 2.6e; do ceph pg deep-scrub $pg done