| 2023-03-21 04:11:05 |
xijunli |
bug |
|
|
added bug |
| 2023-03-21 04:11:05 |
xijunli |
attachment added |
|
msi-from5.15-to-6.1.PNG https://bugs.launchpad.net/bugs/2012335/+attachment/5656161/+files/msi-from5.15-to-6.1.PNG |
|
| 2023-03-22 02:17:08 |
Joseph Salisbury |
affects |
ubuntu-realtime |
linux (Ubuntu) |
|
| 2023-03-22 02:30:07 |
Ubuntu Kernel Bot |
linux (Ubuntu): status |
New |
Incomplete |
|
| 2023-03-22 02:50:37 |
xijunli |
linux (Ubuntu): status |
Incomplete |
Confirmed |
|
| 2023-03-31 11:18:25 |
Kleber Sacilotto de Souza |
nominated for series |
|
Ubuntu Jammy |
|
| 2023-03-31 11:18:25 |
Kleber Sacilotto de Souza |
bug task added |
|
linux (Ubuntu Jammy) |
|
| 2023-03-31 11:18:31 |
Kleber Sacilotto de Souza |
linux (Ubuntu Jammy): status |
New |
Confirmed |
|
| 2023-03-31 11:18:47 |
Kleber Sacilotto de Souza |
linux (Ubuntu): status |
Confirmed |
Fix Released |
|
| 2023-04-04 20:56:45 |
Luke Nowakowski-Krijger |
linux (Ubuntu Jammy): status |
Confirmed |
In Progress |
|
| 2023-04-04 20:56:47 |
Luke Nowakowski-Krijger |
linux (Ubuntu Jammy): assignee |
|
Luke Nowakowski-Krijger (lukenow) |
|
| 2023-04-14 18:14:48 |
Luke Nowakowski-Krijger |
nominated for series |
|
Ubuntu Kinetic |
|
| 2023-04-14 18:14:48 |
Luke Nowakowski-Krijger |
bug task added |
|
linux (Ubuntu Kinetic) |
|
| 2023-04-14 18:14:55 |
Luke Nowakowski-Krijger |
linux (Ubuntu Kinetic): status |
New |
Confirmed |
|
| 2023-04-14 18:14:57 |
Luke Nowakowski-Krijger |
linux (Ubuntu Kinetic): assignee |
|
Luke Nowakowski-Krijger (lukenow) |
|
| 2023-04-14 21:30:58 |
Luke Nowakowski-Krijger |
linux (Ubuntu Kinetic): status |
Confirmed |
In Progress |
|
| 2023-04-18 17:18:40 |
Luke Nowakowski-Krijger |
description |
System Configuration
OS: Ubuntu 22.04 LTS
Kernel: 5.15.0-25-generic
CPUs: 256
NIC: Intel E810 NIC with 512 MSIx vectors each function
Errors
Not enough device MSI-X vectors, requested = 260, available = 253
Findings
(1) the current ice kernel driver (ice_main.c) will pre-allocate all required number of msix (even it's not enough for big core CPUs)
(2) the commit https://github.com/torvalds/linux/commit/ce4626131112e1d0066a890371e14d8091323f99 has improved this logic, and it seems merged into kernel version from v6.1
So for supporting the new CPUs with more than 252 vCPUs, will Ubuntu kernel backport above patch to the current kernel (v5.15) ? |
SRU Justification:
[Impact]
There is a user reporting errors in setup with their Intel E810 NIC with
error messages saying that the driver cannot allocate enough MSI-X vectors
on their 256 cpu-count system.
It seems the ICE ethernet driver has an all or nothing approach to
allocating MSI-X vectors and could request more MSI-X vectors than it
finds available, which could lead to the driver failing to initialize and
start.
[Fix]
The patch that fixes this allocates as many MSI-X vectors as it can to continue
functionality by reducing the number of requested MSI-X vectors if it does
not have enough to do full allocation.
[Backport]
In Jammy we do not carry patches for switchdev support in the driver so do not
allocate the switchdev MSI-X vector for it. Also in Jammy use the older
way of checking RDMA support by testing the RDMA bit is set as opposed to the newer
ice_is_rdma_ena that the patch uses.
[Test Plan]
Install and startup Ice driver with an Intel 800 series NIC and check that we
do not have the failure:
Not enough device MSI-X vectors, requested = 260, available = 253
and check that everything works as expected.
The backported patch for Jammy has been tested by the original user who
submited the bug report with their high cpu count system and confirmed no errors.
[Where problems could occur]
There could be problems with the logic of reducing the MSI-X vector
usage leading to more errors in the driver, but otherwise minimal
regression potential as the code is mostly refactoring initial MSI-X
setup.
----------------------------------
System Configuration
OS: Ubuntu 22.04 LTS
Kernel: 5.15.0-25-generic
CPUs: 256
NIC: Intel E810 NIC with 512 MSIx vectors each function
Errors
Not enough device MSI-X vectors, requested = 260, available = 253
Findings
(1) the current ice kernel driver (ice_main.c) will pre-allocate all required number of msix (even it's not enough for big core CPUs)
(2) the commit https://github.com/torvalds/linux/commit/ce4626131112e1d0066a890371e14d8091323f99 has improved this logic, and it seems merged into kernel version from v6.1
So for supporting the new CPUs with more than 252 vCPUs, will Ubuntu kernel backport above patch to the current kernel (v5.15) ? |
|
| 2023-05-11 13:33:42 |
Luke Nowakowski-Krijger |
linux (Ubuntu Jammy): status |
In Progress |
Fix Committed |
|
| 2023-05-11 13:33:44 |
Luke Nowakowski-Krijger |
linux (Ubuntu Kinetic): status |
In Progress |
Fix Committed |
|
| 2023-05-15 20:16:21 |
Ubuntu Kernel Bot |
tags |
|
kernel-spammed-jammy-linux verification-needed-jammy |
|
| 2023-05-17 08:42:59 |
xijunli |
tags |
kernel-spammed-jammy-linux verification-needed-jammy |
kernel-spammed-jammy-linux verification-done-jammy |
|
| 2023-05-17 22:01:02 |
Ubuntu Kernel Bot |
tags |
kernel-spammed-jammy-linux verification-done-jammy |
kernel-spammed-jammy-linux kernel-spammed-kinetic-linux verification-done-jammy verification-needed-kinetic |
|
| 2023-05-18 01:54:18 |
xijunli |
tags |
kernel-spammed-jammy-linux kernel-spammed-kinetic-linux verification-done-jammy verification-needed-kinetic |
kernel-spammed-jammy-linux kernel-spammed-kinetic-linux verification-done-jammy verification-done-kinetic |
|
| 2023-06-06 16:34:21 |
Ubuntu Kernel Bot |
tags |
kernel-spammed-jammy-linux kernel-spammed-kinetic-linux verification-done-jammy verification-done-kinetic |
kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-kinetic-linux verification-done-kinetic verification-needed-jammy |
|
| 2023-06-13 20:01:19 |
Ubuntu Kernel Bot |
tags |
kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-kinetic-linux verification-done-kinetic verification-needed-jammy |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-kinetic-linux verification-done-kinetic verification-needed-focal verification-needed-jammy |
|
| 2023-06-14 02:01:25 |
xijunli |
tags |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-kinetic-linux verification-done-kinetic verification-needed-focal verification-needed-jammy |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-kinetic-linux verification-done-focal verification-done-kinetic verification-needed-jammy |
|
| 2023-06-15 22:17:27 |
Launchpad Janitor |
linux (Ubuntu Jammy): status |
Fix Committed |
Fix Released |
|
| 2023-06-15 22:17:27 |
Launchpad Janitor |
cve linked |
|
2023-1380 |
|
| 2023-06-15 22:17:27 |
Launchpad Janitor |
cve linked |
|
2023-1670 |
|
| 2023-06-15 22:17:27 |
Launchpad Janitor |
cve linked |
|
2023-1859 |
|
| 2023-06-15 22:17:27 |
Launchpad Janitor |
cve linked |
|
2023-2612 |
|
| 2023-06-15 22:17:27 |
Launchpad Janitor |
cve linked |
|
2023-30456 |
|
| 2023-06-15 22:17:27 |
Launchpad Janitor |
cve linked |
|
2023-31436 |
|
| 2023-06-15 22:17:27 |
Launchpad Janitor |
cve linked |
|
2023-32233 |
|
| 2023-06-15 22:20:36 |
Launchpad Janitor |
linux (Ubuntu Kinetic): status |
Fix Committed |
Fix Released |
|
| 2023-06-15 22:20:36 |
Launchpad Janitor |
cve linked |
|
2022-4269 |
|
| 2023-07-10 19:31:27 |
Ubuntu Kernel Bot |
tags |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-kinetic-linux verification-done-focal verification-done-kinetic verification-needed-jammy |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-kinetic-linux verification-done-focal verification-done-kinetic verification-needed-jammy |
|
| 2023-07-13 02:26:02 |
Ubuntu Kernel Bot |
tags |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-kinetic-linux verification-done-focal verification-done-kinetic verification-needed-jammy |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-kinetic verification-needed-jammy |
|
| 2023-07-13 02:59:42 |
xijunli |
tags |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-kinetic verification-needed-jammy |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-jammy verification-done-kinetic |
|
| 2023-07-19 09:38:59 |
Ubuntu Kernel Bot |
tags |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-jammy verification-done-kinetic |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-azure kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-kinetic verification-needed-jammy |
|
| 2023-07-19 13:24:48 |
Ubuntu Kernel Bot |
tags |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-azure kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-kinetic verification-needed-jammy |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-aws kernel-spammed-jammy-linux-azure kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-kinetic verification-needed-jammy |
|
| 2023-07-20 03:44:09 |
xijunli |
tags |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-aws kernel-spammed-jammy-linux-azure kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-kinetic verification-needed-jammy |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-aws kernel-spammed-jammy-linux-azure kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-jammy verification-done-kinetic |
|
| 2023-09-09 14:18:02 |
Ubuntu Kernel Bot |
tags |
kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-aws kernel-spammed-jammy-linux-azure kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-jammy verification-done-kinetic |
kernel-spammed-focal-linux-aws-5.15-v2 kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-aws kernel-spammed-jammy-linux-azure kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-jammy verification-done-kinetic verification-needed-focal-linux-aws-5.15 |
|
| 2023-09-11 03:27:52 |
xijunli |
tags |
kernel-spammed-focal-linux-aws-5.15-v2 kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-aws kernel-spammed-jammy-linux-azure kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-jammy verification-done-kinetic verification-needed-focal-linux-aws-5.15 |
kernel-spammed-focal-linux-aws-5.15-v2 kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-aws kernel-spammed-jammy-linux-azure kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-focal-linux-aws-5.15 verification-done-jammy verification-done-kinetic |
|
| 2024-03-01 06:18:54 |
Ubuntu Kernel Bot |
tags |
kernel-spammed-focal-linux-aws-5.15-v2 kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-aws kernel-spammed-jammy-linux-azure kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-focal-linux-aws-5.15 verification-done-jammy verification-done-kinetic |
kernel-spammed-focal-linux-aws-5.15-v2 kernel-spammed-focal-linux-intel-iotg-5.15 kernel-spammed-jammy-linux kernel-spammed-jammy-linux-aws kernel-spammed-jammy-linux-azure kernel-spammed-jammy-linux-mtk-v2 kernel-spammed-jammy-linux-nvidia-5.19 kernel-spammed-jammy-linux-nvidia-tegra kernel-spammed-jammy-linux-nvidia-tegra-igx kernel-spammed-kinetic-linux verification-done-focal verification-done-focal-linux-aws-5.15 verification-done-jammy verification-done-kinetic verification-needed-jammy-linux-mtk |
|
