| 2017-08-28 21:39:26 |
bugproxy |
bug |
|
|
added bug |
| 2017-08-28 21:39:28 |
bugproxy |
tags |
|
architecture-ppc64le bugnameltc-157336 severity-high targetmilestone-inin16043 |
|
| 2017-08-28 21:39:29 |
bugproxy |
attachment added |
|
Migration count https://bugs.launchpad.net/bugs/1713576/+attachment/4940430/+files/migrate.txt |
|
| 2017-08-28 21:39:30 |
bugproxy |
attachment added |
|
Migration count with 96 threads https://bugs.launchpad.net/bugs/1713576/+attachment/4940431/+files/migrate2.txt |
|
| 2017-08-28 21:39:32 |
bugproxy |
attachment added |
|
sched/fair: Prefer sibiling only if local group is under-utilized https://bugs.launchpad.net/bugs/1713576/+attachment/4940432/+files/05b40e0577.patch |
|
| 2017-08-28 21:39:36 |
bugproxy |
ubuntu: assignee |
|
Ubuntu on IBM Power Systems Bug Triage (ubuntu-power-triage) |
|
| 2017-08-28 21:39:38 |
bugproxy |
affects |
ubuntu |
linux (Ubuntu) |
|
| 2017-08-29 07:08:03 |
Andrew Cloke |
bug task added |
|
ubuntu-power-systems |
|
| 2017-08-29 07:08:14 |
Andrew Cloke |
ubuntu-power-systems: importance |
Undecided |
High |
|
| 2017-08-29 07:08:23 |
Andrew Cloke |
ubuntu-power-systems: assignee |
|
Canonical Kernel Team (canonical-kernel-team) |
|
| 2017-08-29 21:14:37 |
Joseph Salisbury |
linux (Ubuntu): importance |
Undecided |
High |
|
| 2017-08-29 21:14:40 |
Joseph Salisbury |
linux (Ubuntu): status |
New |
Triaged |
|
| 2017-08-29 21:14:47 |
Joseph Salisbury |
tags |
architecture-ppc64le bugnameltc-157336 severity-high targetmilestone-inin16043 |
architecture-ppc64le bugnameltc-157336 kernel-da-key severity-high targetmilestone-inin16043 |
|
| 2017-09-11 05:16:49 |
Frank Heimes |
ubuntu-power-systems: status |
New |
Triaged |
|
| 2017-09-13 15:17:44 |
Joseph Salisbury |
linux (Ubuntu): status |
Triaged |
In Progress |
|
| 2017-09-13 15:17:48 |
Joseph Salisbury |
linux (Ubuntu): assignee |
Ubuntu on IBM Power Systems Bug Triage (ubuntu-power-triage) |
Joseph Salisbury (jsalisbury) |
|
| 2017-09-13 15:17:56 |
Joseph Salisbury |
nominated for series |
|
Ubuntu Zesty |
|
| 2017-09-13 15:17:56 |
Joseph Salisbury |
bug task added |
|
linux (Ubuntu Zesty) |
|
| 2017-09-13 15:18:05 |
Joseph Salisbury |
linux (Ubuntu Zesty): status |
New |
In Progress |
|
| 2017-09-13 15:18:09 |
Joseph Salisbury |
linux (Ubuntu Zesty): importance |
Undecided |
High |
|
| 2017-09-13 15:18:13 |
Joseph Salisbury |
linux (Ubuntu Zesty): assignee |
|
Joseph Salisbury (jsalisbury) |
|
| 2017-09-13 15:41:34 |
Frank Heimes |
ubuntu-power-systems: status |
Triaged |
In Progress |
|
| 2017-09-18 13:52:54 |
Manoj Iyer |
tags |
architecture-ppc64le bugnameltc-157336 kernel-da-key severity-high targetmilestone-inin16043 |
architecture-ppc64le bugnameltc-157336 kernel-da-key severity-high targetmilestone-inin16043 triage-g |
|
| 2017-09-20 15:31:51 |
Joseph Salisbury |
description |
== Comment: #0 - PUVICHAKRAVARTHY RAMACHANDRAN - 2017-08-06 13:44:45 ==
---Problem Description---
Significantly higher number of task migrations when the load is fixed but not balanced across cores.
---uname output---
Linux isvbos3 4.10.0-29-generic #33~16.04.1-Ubuntu SMP Tue Jul 25 18:17:06 UTC 2017 ppc64le ppc64le ppc64le GNU/Linux
---Additional Hardware Info---
Power9 dd2.0
Machine Type = Power9
---Steps to Reproduce---
Benchmark : Multithreaded - cpu intensive. The system had 2 socket/ 32 cores/ SMT4 mode.
When 64 threads was run - the migrations were less over 10s interval.
when 80 threads were run - the migrations were very high.
Ideally, it should have been very minimal, as the over all load was constant
== Comment: #3 - SRIKAR DRONAMRAJU - 2017-08-11 06:56:47 ==
As suspected (commit : 05b40e0577 : "sched/fair: Prefer sibiling only if local group is under-utilized")
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=05b40e0577
should fix the problem
Ran ' perf stat -a -r 5 -e sched:sched_migrate_task /home/srikar/work/ebizzy-0.3/ebizzy -t 35 -S 100'
to detect the problem and verify the fix
Here is perf stat without fix.
Performance counter stats for 'system wide' (5 runs):
7,758 sched:sched_migrate_task ( +- 1.28% )
100.015658079 seconds time elapsed ( +- 0.00% )
perf stat with fix.
Performance counter stats for 'system wide' (5 runs):
415 sched:sched_migrate_task ( +- 11.74% )
100.016021787 seconds time elapsed ( +- 0.00% )
git describe on upstream kernel says v4.11-rc2
# git describe 05b40e0577
v4.11-rc2-227-g05b40e0
== Comment: #4 - SRIKAR DRONAMRAJU - 2017-08-11 07:05:37 ==
Attaching the patch that needs to be applied to fix this bug.
Verified that patch fixes the problem. |
== SRU Justification ==
There is a significantly higher number of task migrations when the load is
fixed and not balanced across cores.
Benchmark results are posted in the bug description and in the commits git log.
This bug is resolved by mainline commit 05b40e057734811ce452344fb3690d09965a7b6a, which is
in mailine as of 4.12-rc1.
== Fix ==
commit 05b40e057734811ce452344fb3690d09965a7b6a
Author: Srikar Dronamraju <srikar@linux.vnet.ibm.com>
Date: Wed Mar 22 23:27:50 2017 +0530
sched/fair: Prefer sibiling only if local group is under-utilized
== Regression Potential ==
Medium, since this commit does touch the scheduler. However, the commit only makes a change to
allow a local group to pull a task, if the source group has more number of
tasks than the local group.
== Test Case ==
A test kernel was built with this patch and tested by the original bug reporter.
The bug reporter states the test kernel resolved the bug.
== Comment: #0 - PUVICHAKRAVARTHY RAMACHANDRAN - 2017-08-06 13:44:45 ==
---Problem Description---
Significantly higher number of task migrations when the load is fixed but not balanced across cores.
---uname output---
Linux isvbos3 4.10.0-29-generic #33~16.04.1-Ubuntu SMP Tue Jul 25 18:17:06 UTC 2017 ppc64le ppc64le ppc64le GNU/Linux
---Additional Hardware Info---
Power9 dd2.0
Machine Type = Power9
---Steps to Reproduce---
Benchmark : Multithreaded - cpu intensive. The system had 2 socket/ 32 cores/ SMT4 mode.
When 64 threads was run - the migrations were less over 10s interval.
when 80 threads were run - the migrations were very high.
Ideally, it should have been very minimal, as the over all load was constant
== Comment: #3 - SRIKAR DRONAMRAJU - 2017-08-11 06:56:47 ==
As suspected (commit : 05b40e0577 : "sched/fair: Prefer sibiling only if local group is under-utilized")
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=05b40e0577
should fix the problem
Ran ' perf stat -a -r 5 -e sched:sched_migrate_task /home/srikar/work/ebizzy-0.3/ebizzy -t 35 -S 100'
to detect the problem and verify the fix
Here is perf stat without fix.
Performance counter stats for 'system wide' (5 runs):
7,758 sched:sched_migrate_task ( +- 1.28% )
100.015658079 seconds time elapsed ( +- 0.00% )
perf stat with fix.
Performance counter stats for 'system wide' (5 runs):
415 sched:sched_migrate_task ( +- 11.74% )
100.016021787 seconds time elapsed ( +- 0.00% )
git describe on upstream kernel says v4.11-rc2
# git describe 05b40e0577
v4.11-rc2-227-g05b40e0
== Comment: #4 - SRIKAR DRONAMRAJU - 2017-08-11 07:05:37 ==
Attaching the patch that needs to be applied to fix this bug.
Verified that patch fixes the problem. |
|
| 2017-10-09 19:26:14 |
Thadeu Lima de Souza Cascardo |
linux (Ubuntu Zesty): status |
In Progress |
Fix Committed |
|
| 2017-10-18 08:59:00 |
Kleber Sacilotto de Souza |
tags |
architecture-ppc64le bugnameltc-157336 kernel-da-key severity-high targetmilestone-inin16043 triage-g |
architecture-ppc64le bugnameltc-157336 kernel-da-key severity-high targetmilestone-inin16043 triage-g verification-needed-zesty |
|
| 2017-10-30 19:26:53 |
Launchpad Janitor |
linux (Ubuntu Zesty): status |
Fix Committed |
Fix Released |
|
| 2017-10-30 19:26:53 |
Launchpad Janitor |
cve linked |
|
2017-1000252 |
|
| 2017-10-30 19:26:53 |
Launchpad Janitor |
cve linked |
|
2017-10663 |
|
| 2017-10-30 19:26:53 |
Launchpad Janitor |
cve linked |
|
2017-10911 |
|
| 2017-10-30 19:26:53 |
Launchpad Janitor |
cve linked |
|
2017-11176 |
|
| 2017-10-30 19:26:53 |
Launchpad Janitor |
cve linked |
|
2017-14340 |
|
| 2017-10-30 20:59:42 |
bugproxy |
tags |
architecture-ppc64le bugnameltc-157336 kernel-da-key severity-high targetmilestone-inin16043 triage-g verification-needed-zesty |
architecture-ppc64le bugnameltc-157336 kernel-da-key severity-high targetmilestone-inin16043 triage-g verification-done-zesty |
|
| 2017-11-06 15:34:25 |
Manoj Iyer |
ubuntu-power-systems: status |
In Progress |
Fix Committed |
|
| 2017-11-20 14:56:07 |
Manoj Iyer |
ubuntu-power-systems: status |
Fix Committed |
Fix Released |
|
| 2019-01-19 17:20:45 |
Joseph Salisbury |
linux (Ubuntu): status |
In Progress |
Fix Released |
|
| 2019-07-24 20:20:25 |
Brad Figg |
tags |
architecture-ppc64le bugnameltc-157336 kernel-da-key severity-high targetmilestone-inin16043 triage-g verification-done-zesty |
architecture-ppc64le bugnameltc-157336 cscc kernel-da-key severity-high targetmilestone-inin16043 triage-g verification-done-zesty |
|
