more sysctl values needed to be capable for more threads

Bug #1420339 reported by Nobuto Murata
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
ceph (Juju Charms Collection)
Fix Released
Medium
Nobuto Murata
ceph-osd (Juju Charms Collection)
Fix Released
Medium
Nobuto Murata

Bug Description

In bug #1366598, sysctl support and kernel.pid_max=2097152 by default have been implemented. However it turned out that more sysctl default change is needed in some high density deployment, especially vm.max_map_count and kernel.threads-max.

Tags: openstack cts
Nobuto Murata (nobuto)
Changed in ceph (Juju Charms Collection):
assignee: nobody → Nobuto Murata (nobuto)
status: New → In Progress
Changed in ceph-osd (Juju Charms Collection):
assignee: nobody → Nobuto Murata (nobuto)
status: New → In Progress
Revision history for this message
Nobuto Murata (nobuto) wrote :

TESTCASE

With a patched stress-ng package: https://launchpad.net/~nobuto/+archive/ubuntu/pthread/+files/stress-ng_0.03.15-1ppa1_amd64.deb
and 8GB memory nodes.

$ sudo stress-ng --pthread 1 --pthread-max 60000 --pthread-ops 60000
$ sudo stress-ng --pthread 1 --pthread-max 256000 --pthread-ops 256000

[Current result]
$ sudo stress-ng --pthread 1 --pthread-max 60000 --pthread-ops 60000
stress-ng: info: [179250] defaulting to a 86400 second run per stressor
stress-ng: info: [179250] dispatching hogs: 1 pthread
stress-ng: error: [179251] stress-ng-pthread: pthread create failed, errno=12 (Cannot allocate memory)
stress-ng: info: [179250] successful run completed in 2.45s

$ sudo stress-ng --pthread 1 --pthread-max 256000 --pthread-ops 256000
stress-ng: info: [146499] defaulting to a 86400 second run per stressor
stress-ng: info: [146499] re-adjusting maximum threads to soft limit of 63803
stress-ng: info: [146499] dispatching hogs: 1 pthread
stress-ng: error: [146500] stress-ng-pthread: pthread create failed, errno=12 (Cannot allocate memory)
stress-ng: info: [146499] successful run completed in 2.02s

-> pthread create failed, errno=12 (Cannot allocate memory)

[result with new defaults]
$ sudo stress-ng --pthread 1 --pthread-max 60000 --pthread-ops 60000
stress-ng: info: [15587] defaulting to a 86400 second run per stressor
stress-ng: info: [15587] dispatching hogs: 1 pthread
stress-ng: info: [15587] successful run completed in 5.86s

$ sudo stress-ng --pthread 1 --pthread-max 256000 --pthread-ops 256000
stress-ng: info: [185128] defaulting to a 86400 second run per stressor
stress-ng: info: [185128] re-adjusting maximum threads to soft limit of 63803
stress-ng: info: [185128] dispatching hogs: 1 pthread
stress-ng: info: [185128] successful run completed in 20.96s

-> no pthread creation error

Changed in ceph (Juju Charms Collection):
importance: Undecided → Medium
Changed in ceph-osd (Juju Charms Collection):
importance: Undecided → Medium
Changed in ceph (Juju Charms Collection):
milestone: none → 15.04
Changed in ceph-osd (Juju Charms Collection):
milestone: none → 15.04
Changed in ceph (Juju Charms Collection):
status: In Progress → Fix Committed
Changed in ceph-osd (Juju Charms Collection):
status: In Progress → Fix Committed
James Page (james-page)
Changed in ceph (Juju Charms Collection):
status: Fix Committed → Fix Released
Changed in ceph-osd (Juju Charms Collection):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.