Need to set production oriented Ceph configuration parameters to increase the Ceph performance
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Fix Released
|
High
|
Stanislav Makar | ||
6.0.x |
Won't Fix
|
Undecided
|
Stanislaw Bogatkin |
Bug Description
To increase the Ceph performance when we install OpenStack with Ceph storage we should set production-oriented parameters.
All parameters were tested on lab with 4 Ceph nodes with SSD disks and 2x10Gb interfaces.
On all Ceph nodes, in /etc/ceph/ceph.conf (we enabled Ceph cashing and set optimal parameters for osd nodes sync):
[global]
...
osd_pool_
osd_pool_
osd_pool_
...
[osd]
osd recovery max active = 1
osd max backfills = 1
filestore max sync interval = 30
filestore min sync interval = 29
filestore flusher = false
filestore queue max ops = 10000
filestore op threads = <CPU count>
osd op threads = <CPU count>
...
[client]
rbd cache = true
rbd cache writethrough until flush = true
If we will use Ceph for Glance volumes:
On controller nodes, in /etc/cinder/
[DEFAULT]
...
volume_tmp_dir=/tmp ### or path to free SSD disk?
tags: | added: customer-found |
Changed in fuel: | |
milestone: | none → 6.0 |
Changed in fuel: | |
assignee: | nobody → Fuel Library Team (fuel-library) |
status: | New → Opinion |
Changed in fuel: | |
status: | Opinion → Confirmed |
importance: | High → Low |
Changed in fuel: | |
importance: | Low → Medium |
Changed in fuel: | |
assignee: | Fuel Library Team (fuel-library) → Dmitry Borodaenko (dborodaenko) |
Changed in fuel: | |
assignee: | Dmitry Borodaenko (dborodaenko) → Fuel Library Team (fuel-library) |
Changed in fuel: | |
milestone: | 6.0 → 6.1 |
Changed in fuel: | |
assignee: | Fuel Library Team (fuel-library) → Stanislaw Bogatkin (sbogatkin) |
Changed in fuel: | |
assignee: | Stanislaw Bogatkin (sbogatkin) → Stanislav Makar (smakar) |
Changed in fuel: | |
importance: | Medium → High |
tags: | added: on-verification |
tags: | removed: on-verification |
Changed in fuel: | |
status: | Fix Committed → Fix Released |
Providing more optimized settings for Ceph deployments is a valid request, so I changed status from Opinion to Confirmed.
Since the problem affects only specific configurations and doesn't render the whole environment unusable, the priority is Medium.