setting kernel.pid_max for large deployment

Bug #1366598 reported by Nobuto Murata
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
ceph (Juju Charms Collection)
Fix Released
Low
Jorge Niedbalski
ceph-osd (Juju Charms Collection)
Fix Released
Low
Jorge Niedbalski

Bug Description

In large and high density deployment, ceph daemon hits pid limit. Recently upstream has added a description regarding kernel.pid_max in their doc.

It would be great if ceph charms add kernel.pid_max values into the deployed nodes to be capable of handling large and high density deployments.

http://ceph.com/docs/master/start/hardware-recommendations/#additional-considerations
> Hosts with high numbers of OSDs (e.g., > 20) may spawn a lot of threads, especially during recovery and rebalancing. Many Linux kernels default to a relatively small maximum number of threads (e.g., 32k). If you encounter problems starting up OSDs on hosts with a high number of OSDs, consider setting kernel.pid_max to a higher number of threads. The theoretical maximum is 4,194,303 threads. For example, you could add the following to the /etc/sysctl.conf file:
>
> kernel.pid_max = 4194303

[related info]
https://github.com/ceph/ceph/commit/7948e13b9d12f3da676e93347b3f18151c424488
http://tracker.ceph.com/issues/6142

Tags: openstack cts

Related branches

Revision history for this message
Jorge Niedbalski (niedbalski) wrote :

Linked the branch for fixing this.

Changed in ceph (Juju Charms Collection):
status: New → Fix Committed
no longer affects: ceph-osd (Juju Charms Collection)
Changed in ceph (Juju Charms Collection):
assignee: nobody → Jorge Niedbalski (niedbalski)
tags: added: cts
tags: added: openstack
Revision history for this message
Edward Hope-Morley (hopem) wrote :

Hey Jorge, any update on this?

Changed in ceph (Juju Charms Collection):
status: Fix Committed → In Progress
affects: ceph-osd (Ubuntu) → ceph-osd (Juju Charms Collection)
Changed in ceph-osd (Juju Charms Collection):
status: New → In Progress
assignee: nobody → Jorge Niedbalski (niedbalski)
Changed in ceph (Juju Charms Collection):
importance: Undecided → Low
Changed in ceph-osd (Juju Charms Collection):
importance: Undecided → Low
Changed in ceph (Juju Charms Collection):
status: In Progress → Fix Committed
Changed in ceph-osd (Juju Charms Collection):
status: In Progress → Fix Committed
Changed in ceph (Juju Charms Collection):
status: Fix Committed → Fix Released
Changed in ceph-osd (Juju Charms Collection):
status: Fix Committed → Fix Released
Revision history for this message
Edward Hope-Morley (hopem) wrote :

This is not actually release to stable yet so setting to Fix Committed for now. Will be available as part of 15.01 release.

Changed in ceph (Juju Charms Collection):
status: Fix Released → Fix Committed
Changed in ceph-osd (Juju Charms Collection):
status: Fix Released → Fix Committed
James Page (james-page)
Changed in ceph (Juju Charms Collection):
milestone: none → 15.01
Changed in ceph-osd (Juju Charms Collection):
milestone: none → 15.01
Revision history for this message
Nobuto Murata (nobuto) wrote :
Changed in ceph (Juju Charms Collection):
status: Fix Committed → Fix Released
Changed in ceph-osd (Juju Charms Collection):
status: Fix Committed → Fix Released
Revision history for this message
Nobuto Murata (nobuto) wrote :
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.