2017-10-27 17:55:36 |
Thadeu Lima de Souza Cascardo |
bug |
|
|
added bug |
2017-10-27 17:55:46 |
Thadeu Lima de Souza Cascardo |
nominated for series |
|
Ubuntu Artful |
|
2017-10-27 17:55:54 |
Thadeu Lima de Souza Cascardo |
nominated for series |
|
Ubuntu Bionic |
|
2017-10-27 17:56:06 |
Thadeu Lima de Souza Cascardo |
bug task added |
|
linux (Ubuntu) |
|
2017-10-27 17:56:41 |
Thadeu Lima de Souza Cascardo |
bug |
|
|
added subscriber Nish Aravamudan |
2017-10-27 18:00:07 |
Ubuntu Kernel Bot |
linux (Ubuntu): status |
New |
Incomplete |
|
2017-10-27 18:23:20 |
Thadeu Lima de Souza Cascardo |
linux (Ubuntu): status |
Incomplete |
Triaged |
|
2017-10-27 18:23:23 |
Thadeu Lima de Souza Cascardo |
makedumpfile (Ubuntu): status |
New |
Triaged |
|
2017-10-27 18:23:32 |
Thadeu Lima de Souza Cascardo |
makedumpfile (Ubuntu): assignee |
|
Thadeu Lima de Souza Cascardo (cascardo) |
|
2017-11-07 18:59:27 |
Thadeu Lima de Souza Cascardo |
description |
The linux kernel won't boot when crashkernel parameter tells it to load a crash kernel at 32Mi on ppc64el on artful.
This happens because the artful kernel is too big. In fact, multiple requirements on the architecture lead to that:
Kernel memory at address 0 is reserved.
crashkernel must be at first RMO, so architecture puts it at 128Mi. However, kdump-tools currently puts it at @32Mi because of bug https://bugs.launchpad.net/ubuntu/+source/makedumpfile/+bug/1567539.
PACA and LPPACA need to be at the first RMO as well, and with 2048 CPUs, they take more than 5MB and 2MiB, respectively.
With the kernel now taking around 25MB from stext to _end, the kernel can't reserve enough memory for PACA or LPPACA right after boot, and it panics.
So, right after installing kdump-tools on artful, and rebooting, the kernel won't boot, with no sign of life as we haven't even started any console. Investigation for this issue took an entire day.
The fix would be setting the loading address to 128MiB, and start reducing size of PACA and maybe remove some of the requirements for the location of PACA and crash kernel.
I would not even set the loading address of the crash kernel in the parameter itself, and leave it to the kernel to decide it, which it already does and already would put it at 128Mi.
Cascardo. |
[Impact]
On Power Systems, the kernel won't boot when given a crashkernel parameter with an offset/start address of 32M. No output will be shown, giving no clue to the user why the system has not booted, or what the problem is.
[Test Case]
Installing kdump-tools on artful, then booting the system. It won't boot. With the fix, it boots and the crash kernel is reserved.
[Regression Potential]
Some Power Systems might have problems loading the kernel at this address. LP#1567539 is not really clear if PowerNV systems won't kdump when using an address different from 32M. However, it has been requested from an IBM person to test it with 128M instead, and no particular problem was shown. It's possible that there was no reason at first to use 32M, and no problems will be found on either PowerNV or other systems on the field. On the other hand, it's possible they might break kdump. But, right now, those systems won't even boot the first kernel without this change.
----
The linux kernel won't boot when crashkernel parameter tells it to load a crash kernel at 32Mi on ppc64el on artful.
This happens because the artful kernel is too big. In fact, multiple requirements on the architecture lead to that:
Kernel memory at address 0 is reserved.
crashkernel must be at first RMO, so architecture puts it at 128Mi. However, kdump-tools currently puts it at @32Mi because of bug https://bugs.launchpad.net/ubuntu/+source/makedumpfile/+bug/1567539.
PACA and LPPACA need to be at the first RMO as well, and with 2048 CPUs, they take more than 5MB and 2MiB, respectively.
With the kernel now taking around 25MB from stext to _end, the kernel can't reserve enough memory for PACA or LPPACA right after boot, and it panics.
So, right after installing kdump-tools on artful, and rebooting, the kernel won't boot, with no sign of life as we haven't even started any console. Investigation for this issue took an entire day.
The fix would be setting the loading address to 128MiB, and start reducing size of PACA and maybe remove some of the requirements for the location of PACA and crash kernel.
I would not even set the loading address of the crash kernel in the parameter itself, and leave it to the kernel to decide it, which it already does and already would put it at 128Mi.
Cascardo. |
|
2017-11-07 18:59:49 |
Thadeu Lima de Souza Cascardo |
attachment added |
|
makedumpfile_1.6.1-2ubuntu0.1.diff https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1728115/+attachment/5005511/+files/makedumpfile_1.6.1-2ubuntu0.1.diff |
|
2017-11-07 19:00:03 |
Thadeu Lima de Souza Cascardo |
linux (Ubuntu): status |
Triaged |
In Progress |
|
2017-11-07 19:00:07 |
Thadeu Lima de Souza Cascardo |
makedumpfile (Ubuntu): status |
Triaged |
In Progress |
|
2017-11-07 19:00:19 |
Thadeu Lima de Souza Cascardo |
linux (Ubuntu): status |
In Progress |
New |
|
2017-11-07 19:30:07 |
Ubuntu Kernel Bot |
linux (Ubuntu): status |
New |
Incomplete |
|
2017-11-08 00:32:53 |
Ubuntu Foundations Team Bug Bot |
tags |
|
patch |
|
2017-11-08 00:33:04 |
Ubuntu Foundations Team Bug Bot |
bug |
|
|
added subscriber Ubuntu Sponsors Team |
2017-11-21 13:21:17 |
Thadeu Lima de Souza Cascardo |
makedumpfile (Ubuntu): importance |
Undecided |
High |
|
2017-11-21 14:03:59 |
Andy Whitcroft |
bug task added |
|
linux (Ubuntu Artful) |
|
2017-11-21 14:03:59 |
Andy Whitcroft |
bug task added |
|
makedumpfile (Ubuntu Artful) |
|
2017-11-21 14:04:05 |
Andy Whitcroft |
bug task added |
|
linux (Ubuntu Bionic) |
|
2017-11-21 14:04:05 |
Andy Whitcroft |
bug task added |
|
makedumpfile (Ubuntu Bionic) |
|
2017-11-21 14:13:58 |
Thadeu Lima de Souza Cascardo |
makedumpfile (Ubuntu Artful): status |
New |
In Progress |
|
2017-11-21 14:14:02 |
Thadeu Lima de Souza Cascardo |
makedumpfile (Ubuntu Artful): importance |
Undecided |
High |
|
2017-11-21 14:14:06 |
Thadeu Lima de Souza Cascardo |
makedumpfile (Ubuntu Artful): assignee |
|
Thadeu Lima de Souza Cascardo (cascardo) |
|
2017-12-05 12:09:14 |
Thadeu Lima de Souza Cascardo |
attachment added |
|
fix for bionic https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1728115/+attachment/5018771/+files/makedumpfile_1.6.2-1ubuntu0.1.diff |
|
2017-12-13 17:36:41 |
Launchpad Janitor |
makedumpfile (Ubuntu Bionic): status |
In Progress |
Fix Released |
|
2017-12-14 21:05:29 |
Brian Murray |
makedumpfile (Ubuntu Artful): status |
In Progress |
Fix Committed |
|
2017-12-14 21:05:32 |
Brian Murray |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
2017-12-14 21:05:34 |
Brian Murray |
bug |
|
|
added subscriber SRU Verification |
2017-12-14 21:05:38 |
Brian Murray |
tags |
patch |
patch verification-needed verification-needed-artful |
|
2017-12-14 23:52:33 |
Brian Murray |
removed subscriber Ubuntu Sponsors Team |
|
|
|
2018-03-21 06:40:10 |
bugproxy |
tags |
patch verification-needed verification-needed-artful |
architecture-ppc64le bugnameltc-165886 patch severity-medium targetmilestone-inin--- |
|
2018-03-21 14:48:09 |
Thadeu Lima de Souza Cascardo |
tags |
architecture-ppc64le bugnameltc-165886 patch severity-medium targetmilestone-inin--- |
architecture-ppc64le bugnameltc-165886 patch severity-medium targetmilestone-inin--- verification-done verification-done-artful |
|
2018-03-21 14:59:21 |
bugproxy |
tags |
architecture-ppc64le bugnameltc-165886 patch severity-medium targetmilestone-inin--- verification-done verification-done-artful |
architecture-ppc64le targetmilestone-inin--- |
|
2018-03-21 15:12:46 |
Thadeu Lima de Souza Cascardo |
tags |
architecture-ppc64le targetmilestone-inin--- |
architecture-ppc64le targetmilestone-inin--- verification-done verification-done-artful |
|
2018-03-21 21:20:25 |
bugproxy |
tags |
architecture-ppc64le targetmilestone-inin--- verification-done verification-done-artful |
architecture-ppc64le bugnameltc-165886 severity-medium targetmilestone-inin--- verification-done verification-done-artful |
|
2018-03-26 09:06:27 |
Launchpad Janitor |
makedumpfile (Ubuntu Artful): status |
Fix Committed |
Fix Released |
|
2018-03-26 09:06:36 |
Ćukasz Zemczak |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
2018-06-13 11:19:35 |
bugproxy |
tags |
architecture-ppc64le bugnameltc-165886 severity-medium targetmilestone-inin--- verification-done verification-done-artful |
architecture-ppc64le bugnameltc-165886 severity-medium targetmilestone-inin1710 verification-done verification-done-artful |
|
2024-07-31 19:12:49 |
Brian Murray |
linux (Ubuntu Artful): status |
New |
Won't Fix |
|
2024-07-31 20:24:48 |
Ubuntu Foundations Team Bug Bot |
tags |
architecture-ppc64le bugnameltc-165886 severity-medium targetmilestone-inin1710 verification-done verification-done-artful |
architecture-ppc64le bugnameltc-165886 patch severity-medium targetmilestone-inin1710 verification-done verification-done-artful |
|
2024-07-31 20:24:49 |
Ubuntu Foundations Team Bug Bot |
bug |
|
|
added subscriber Terry Rudd |