setting kernel.pid_max for large deployment

Bug #1366598 reported by Nobuto Murata on 2014-09-07
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
ceph (Juju Charms Collection)
Low
Jorge Niedbalski
ceph-osd (Juju Charms Collection)
Low
Jorge Niedbalski

Bug Description

In large and high density deployment, ceph daemon hits pid limit. Recently upstream has added a description regarding kernel.pid_max in their doc.

It would be great if ceph charms add kernel.pid_max values into the deployed nodes to be capable of handling large and high density deployments.

http://ceph.com/docs/master/start/hardware-recommendations/#additional-considerations
> Hosts with high numbers of OSDs (e.g., > 20) may spawn a lot of threads, especially during recovery and rebalancing. Many Linux kernels default to a relatively small maximum number of threads (e.g., 32k). If you encounter problems starting up OSDs on hosts with a high number of OSDs, consider setting kernel.pid_max to a higher number of threads. The theoretical maximum is 4,194,303 threads. For example, you could add the following to the /etc/sysctl.conf file:
>
> kernel.pid_max = 4194303

[related info]
https://github.com/ceph/ceph/commit/7948e13b9d12f3da676e93347b3f18151c424488
http://tracker.ceph.com/issues/6142

Related branches

Jorge Niedbalski (niedbalski) wrote :

Linked the branch for fixing this.

Changed in ceph (Juju Charms Collection):
status: New → Fix Committed
no longer affects: ceph-osd (Juju Charms Collection)
Changed in ceph (Juju Charms Collection):
assignee: nobody → Jorge Niedbalski (niedbalski)
tags: added: cts
tags: added: openstack
Edward Hope-Morley (hopem) wrote :

Hey Jorge, any update on this?

Changed in ceph (Juju Charms Collection):
status: Fix Committed → In Progress
affects: ceph-osd (Ubuntu) → ceph-osd (Juju Charms Collection)
Changed in ceph-osd (Juju Charms Collection):
status: New → In Progress
assignee: nobody → Jorge Niedbalski (niedbalski)
Changed in ceph (Juju Charms Collection):
importance: Undecided → Low
Changed in ceph-osd (Juju Charms Collection):
importance: Undecided → Low
Changed in ceph (Juju Charms Collection):
status: In Progress → Fix Committed
Changed in ceph-osd (Juju Charms Collection):
status: In Progress → Fix Committed
Changed in ceph (Juju Charms Collection):
status: Fix Committed → Fix Released
Changed in ceph-osd (Juju Charms Collection):
status: Fix Committed → Fix Released
Edward Hope-Morley (hopem) wrote :

This is not actually release to stable yet so setting to Fix Committed for now. Will be available as part of 15.01 release.

Changed in ceph (Juju Charms Collection):
status: Fix Released → Fix Committed
Changed in ceph-osd (Juju Charms Collection):
status: Fix Released → Fix Committed
James Page (james-page) on 2015-01-23
Changed in ceph (Juju Charms Collection):
milestone: none → 15.01
Changed in ceph-osd (Juju Charms Collection):
milestone: none → 15.01
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers