Default partition-power is too small

Bug #1931286 reported by Erlon R. Cruz
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Swift Proxy Charm
Fix Released
Undecided
Erlon R. Cruz

Bug Description

The partition power is used to build the swift rings and define the
granularity of the data copies. The total number of partitions in
the cluster will be 2^partition-power. The recommended number of
partitions of a cluster is a minimum of 100 per disk, and it should
be considered any future cluster expansion, since changing this value
is not trivial after the cluster initialization.

Currently, the default value is 8, and given that 2^8 is only 256,
this number will lead to a sub-optimal configuration even on test
deployments with 3+ disks, not to say on a production where disks can
surpass the hundreds and this will lead to a very unbalanced cluster.

We had some production clusters that were wrongly set to the default
value and that resulted in an awfully unbalanced cluster. We should
avoid that to happen again.

Revision history for this message
Erlon R. Cruz (sombrafam) wrote :

As I mentioned offline, the only drawback of using a big value would be memory consumption, but that would be in the MBs, and wouldn't affect performance. Documentation on the recommended values is not present in the official documentation, but there are some good presentations[1] providing info on that.

[1] https://youtu.be/LzaQKKp58JI?t=606

Changed in charm-swift-proxy:
status: New → In Progress
Revision history for this message
Erlon R. Cruz (sombrafam) wrote :
Changed in charm-swift-proxy:
assignee: nobody → Erlon R. Cruz (sombrafam)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to charm-swift-proxy (master)

Reviewed: https://review.opendev.org/c/openstack/charm-swift-proxy/+/784813
Committed: https://opendev.org/openstack/charm-swift-proxy/commit/54583248b9510ba0d17313dea044b402953f4e94
Submitter: "Zuul (22348)"
Branch: master

commit 54583248b9510ba0d17313dea044b402953f4e94
Author: Erlon R. Cruz <email address hidden>
Date: Mon Apr 5 15:31:12 2021 -0300

    Bump default swift partition power

    The partition power is used to build the swift rings. The total
    number of partitions in the cluster will be 2^partition-power.
    The recommend number of partitions of a cluster is a minimum of 100
    per disk. Given that 2^8 is only 256, this number will lead to a sub-
    optimal configuration even on test deployments, not to say on production
    where disks can surpass the hundreds, and this will lead to a very
    unbalanced cluster.

    Closes-bug: #1931286
    Change-Id: Ifdf2b96f27f18bc64549c40d8fa47474f8eb59c8

Changed in charm-swift-proxy:
status: In Progress → Fix Committed
Changed in charm-swift-proxy:
milestone: none → 21.10
Changed in charm-swift-proxy:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.