| 2021-12-13 16:10:17 |
Andrea Righi |
bug |
|
|
added bug |
| 2021-12-13 16:10:25 |
Andrea Righi |
nominated for series |
|
Ubuntu Jammy |
|
| 2021-12-13 16:10:25 |
Andrea Righi |
bug task added |
|
zfs-linux (Ubuntu Jammy) |
|
| 2021-12-13 17:30:07 |
Andrea Righi |
attachment added |
|
zfs-update-to-2.1.1.debdiff https://bugs.launchpad.net/ubuntu/+source/zfs-linux/+bug/1954676/+attachment/5547343/+files/zfs-update-to-2.1.1.debdiff |
|
| 2021-12-13 17:32:23 |
Andrea Righi |
description |
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings. |
[Impact]
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings.
[Test case]
On s390x install the latest 5.15 Jammy kernel and run:
apt install zfs-dkms
[Fix]
Moving to zfs 2.1.1 (from Debian) seems to fix the problem.
[Regression potential]
It is a major zfs update so we may introduce zfs regressions, but it seems sane to be aligned with the upstream zfs version. Also the zfs smoke tests passed across all architectures, so moving to this new version seems the right thing to do. |
|
| 2021-12-13 20:22:33 |
Ubuntu Foundations Team Bug Bot |
tags |
|
patch |
|
| 2021-12-16 07:04:54 |
Andrea Righi |
bug watch added |
|
https://github.com/openzfs/zfs/issues/12762 |
|
| 2021-12-16 07:04:54 |
Andrea Righi |
attachment added |
|
zfs-update-to-2.1.1-v2.debdiff https://bugs.launchpad.net/ubuntu/+source/zfs-linux/+bug/1954676/+attachment/5547945/+files/zfs-update-to-2.1.1-v2.debdiff |
|
| 2022-01-05 22:42:31 |
Andrea Righi |
attachment added |
|
zfs-update-to-2.1.2.debdiff https://bugs.launchpad.net/ubuntu/+source/zfs-linux/+bug/1954676/+attachment/5551832/+files/zfs-update-to-2.1.2.debdiff |
|
| 2022-01-10 17:02:15 |
Andrea Righi |
bug watch added |
|
https://github.com/openzfs/zfs/issues/12942 |
|
| 2022-01-10 17:25:55 |
Andrea Righi |
bug task added |
|
gcc-11 (Ubuntu) |
|
| 2022-01-10 17:27:40 |
Andrea Righi |
description |
[Impact]
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings.
[Test case]
On s390x install the latest 5.15 Jammy kernel and run:
apt install zfs-dkms
[Fix]
Moving to zfs 2.1.1 (from Debian) seems to fix the problem.
[Regression potential]
It is a major zfs update so we may introduce zfs regressions, but it seems sane to be aligned with the upstream zfs version. Also the zfs smoke tests passed across all architectures, so moving to this new version seems the right thing to do. |
[Impact]
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings.
This seems to happen only when zfs is compile with gcc >= 11.2.0-10ubuntu1. Downgrading gcc to previous versions doesn't show the problem and zfs is working just fine.
[Test case]
On s390x install the latest 5.15 Jammy kernel and run:
apt install zfs-dkms
[Fix]
Moving to zfs 2.1.1 (from Debian) seems to fix the problem.
[Regression potential]
It is a major zfs update so we may introduce zfs regressions, but it seems sane to be aligned with the upstream zfs version. Also the zfs smoke tests passed across all architectures, so moving to this new version seems the right thing to do. |
|
| 2022-01-10 17:28:03 |
Andrea Righi |
description |
[Impact]
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings.
This seems to happen only when zfs is compile with gcc >= 11.2.0-10ubuntu1. Downgrading gcc to previous versions doesn't show the problem and zfs is working just fine.
[Test case]
On s390x install the latest 5.15 Jammy kernel and run:
apt install zfs-dkms
[Fix]
Moving to zfs 2.1.1 (from Debian) seems to fix the problem.
[Regression potential]
It is a major zfs update so we may introduce zfs regressions, but it seems sane to be aligned with the upstream zfs version. Also the zfs smoke tests passed across all architectures, so moving to this new version seems the right thing to do. |
[Impact]
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings.
This seems to happen only when zfs is compile with gcc >= 11.2.0-10ubuntu1. Downgrading gcc to previous versions doesn't show the problem and zfs is working just fine.
[Test case]
On s390x install the latest 5.15 Jammy kernel and run:
apt install zfs-dkms
[Fix]
Temporary workaround is to downgrade gcc. |
|
| 2022-01-10 17:33:40 |
Andrea Righi |
summary |
jammy 5.15 soft lockup when zfs.ko is loaded on s390x |
jammy 5.15 kernel soft lockup when zfs.ko is loaded on s390x w/ gcc >= 11.2.0-10ubuntu1 |
|
| 2022-01-10 17:33:57 |
Andrea Righi |
gcc-11 (Ubuntu Jammy): importance |
Undecided |
Critical |
|
| 2022-01-10 17:34:00 |
Andrea Righi |
zfs-linux (Ubuntu Jammy): importance |
Undecided |
Critical |
|
| 2022-01-10 17:34:10 |
Andrea Righi |
zfs-linux (Ubuntu Jammy): assignee |
|
Andrea Righi (arighi) |
|
| 2022-01-11 17:30:30 |
Andrea Righi |
description |
[Impact]
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings.
This seems to happen only when zfs is compile with gcc >= 11.2.0-10ubuntu1. Downgrading gcc to previous versions doesn't show the problem and zfs is working just fine.
[Test case]
On s390x install the latest 5.15 Jammy kernel and run:
apt install zfs-dkms
[Fix]
Temporary workaround is to downgrade gcc. |
[Impact]
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings.
This seems to happen only when zfs is compile with gcc >= 11.2.0-10ubuntu1. Downgrading gcc to previous versions doesn't show the problem and zfs is working just fine.
[Test case]
On s390x install the latest 5.15 Jammy kernel and run:
apt install zfs-dkms
[Fix]
Temporary workaround is to build zfs with gcc-10 on s390x.
[Regression potential]
Building a kernel module with a different compiler is never 100% safe, we may experience potential crashes / panics if the ABI is not compatible. Moreover, if we build zfs with gcc-10 we are going to lose some of the performance benefits provided by gcc-11.
However these regressions are limited to zfs on s390x and without this change zfs is broken anyway on this architecture. |
|
| 2022-01-11 17:31:09 |
Andrea Righi |
attachment added |
|
zfs-update-to-2.1.2-v2.debdiff https://bugs.launchpad.net/ubuntu/+source/gcc-11/+bug/1954676/+attachment/5553372/+files/zfs-update-to-2.1.2-v2.debdiff |
|
| 2022-01-11 18:00:34 |
Andrea Righi |
attachment added |
|
zfs-update-to-2.1.2-v3.debdiff https://bugs.launchpad.net/ubuntu/+source/gcc-11/+bug/1954676/+attachment/5553379/+files/zfs-update-to-2.1.2-v3.debdiff |
|
| 2022-01-12 12:43:11 |
Dimitri John Ledkov |
description |
[Impact]
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings.
This seems to happen only when zfs is compile with gcc >= 11.2.0-10ubuntu1. Downgrading gcc to previous versions doesn't show the problem and zfs is working just fine.
[Test case]
On s390x install the latest 5.15 Jammy kernel and run:
apt install zfs-dkms
[Fix]
Temporary workaround is to build zfs with gcc-10 on s390x.
[Regression potential]
Building a kernel module with a different compiler is never 100% safe, we may experience potential crashes / panics if the ABI is not compatible. Moreover, if we build zfs with gcc-10 we are going to lose some of the performance benefits provided by gcc-11.
However these regressions are limited to zfs on s390x and without this change zfs is broken anyway on this architecture. |
[Impact]
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings.
This seems to happen only when zfs is compile with gcc >= 11.2.0-10ubuntu1. Downgrading gcc to previous versions doesn't show the problem and zfs is working just fine.
[Test case]
On s390x install the latest 5.15 Jammy kernel and run:
apt install zfs-dkms
[Fix]
Temporary workaround is to build zfs with gcc-10 on s390x.
[Regression potential]
Building a kernel module with a different compiler is never 100% safe, we may experience potential crashes / panics if the ABI is not compatible. Moreover, if we build zfs with gcc-10 we are going to lose some of the performance benefits provided by gcc-11.
However these regressions are limited to zfs on s390x and without this change zfs is broken anyway on this architecture.
[Further analysis]
@IBM
Issue report to zfs upstream at https://github.com/openzfs/zfs/issues/12942
Reverting https://gcc.gnu.org/git/?p=gcc.git;a=patch;h=2335aa8771acd06b082d3e15d9f21ae0a802afd7 appears to make everything work, the compiled kernel and zfs.ko are loadable/unloadable once again.
Please bring this issue to the attention of Ilya Leoshkevich |
|
| 2022-01-12 12:43:17 |
Dimitri John Ledkov |
bug |
|
|
added subscriber Ilya Leoshkevich |
| 2022-01-12 12:43:36 |
Dimitri John Ledkov |
summary |
jammy 5.15 kernel soft lockup when zfs.ko is loaded on s390x w/ gcc >= 11.2.0-10ubuntu1 |
jammy 5.15 kernel soft lockup when zfs.ko is loaded on s390x w/ gcc >= 11.2.0-10ubuntu1 / gcc-11 PLT regression on s390x |
|
| 2022-01-12 12:46:17 |
Dimitri John Ledkov |
description |
[Impact]
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings.
This seems to happen only when zfs is compile with gcc >= 11.2.0-10ubuntu1. Downgrading gcc to previous versions doesn't show the problem and zfs is working just fine.
[Test case]
On s390x install the latest 5.15 Jammy kernel and run:
apt install zfs-dkms
[Fix]
Temporary workaround is to build zfs with gcc-10 on s390x.
[Regression potential]
Building a kernel module with a different compiler is never 100% safe, we may experience potential crashes / panics if the ABI is not compatible. Moreover, if we build zfs with gcc-10 we are going to lose some of the performance benefits provided by gcc-11.
However these regressions are limited to zfs on s390x and without this change zfs is broken anyway on this architecture.
[Further analysis]
@IBM
Issue report to zfs upstream at https://github.com/openzfs/zfs/issues/12942
Reverting https://gcc.gnu.org/git/?p=gcc.git;a=patch;h=2335aa8771acd06b082d3e15d9f21ae0a802afd7 appears to make everything work, the compiled kernel and zfs.ko are loadable/unloadable once again.
Please bring this issue to the attention of Ilya Leoshkevich |
[Impact]
Installing zfs-dkms seems to trigger a soft lockup issue as soon as zfs.ko is loaded. When the soft lockup happens the system isn't reachable anymore via ssh and on the console we can see some exlicit rcu stall warnings.
This seems to happen only when zfs is compile with gcc >= 11.2.0-10ubuntu1. Downgrading gcc to previous versions doesn't show the problem and zfs is working just fine.
[Test case]
On s390x install the latest 5.15 Jammy kernel and run:
apt install zfs-dkms
[Fix]
Temporary workaround is to build zfs with gcc-10 on s390x.
[Regression potential]
Building a kernel module with a different compiler is never 100% safe, we may experience potential crashes / panics if the ABI is not compatible. Moreover, if we build zfs with gcc-10 we are going to lose some of the performance benefits provided by gcc-11.
However these regressions are limited to zfs on s390x and without this change zfs is broken anyway on this architecture.
[Further analysis]
@IBM
Issue report to zfs upstream at https://github.com/openzfs/zfs/issues/12942
Reverting https://gcc.gnu.org/git/?p=gcc.git;a=patch;h=2335aa8771acd06b082d3e15d9f21ae0a802afd7 appears to make everything work, the compiled kernel and zfs.ko are loadable/unloadable once again.
Please bring this issue to the attention of Ilya Leoshkevich
Potentially this means we may have missbuilt userspace binaries in the archive for s390x. |
|
| 2022-01-12 12:54:56 |
Frank Heimes |
bug task added |
|
ubuntu-z-systems |
|
| 2022-01-12 12:55:09 |
Frank Heimes |
tags |
patch |
patch s390x |
|
| 2022-01-12 12:55:22 |
Frank Heimes |
ubuntu-z-systems: assignee |
|
bugproxy (bugproxy) |
|
| 2022-01-12 12:55:29 |
Frank Heimes |
bug |
|
|
added subscriber Frank Heimes |
| 2022-01-12 12:55:35 |
Frank Heimes |
ubuntu-z-systems: importance |
Undecided |
Critical |
|
| 2022-01-19 06:48:06 |
Frank Heimes |
gcc-11 (Ubuntu Jammy): status |
New |
Confirmed |
|
| 2022-01-19 06:48:09 |
Frank Heimes |
ubuntu-z-systems: status |
New |
Confirmed |
|
| 2022-01-19 11:30:52 |
Launchpad Janitor |
gcc-11 (Ubuntu Jammy): status |
Confirmed |
Fix Released |
|
| 2022-01-21 12:27:52 |
Ilya Leoshkevich |
attachment added |
|
0001-s390-module-fix-loading-modules-with-a-lot-of-reloca.patch https://bugs.launchpad.net/ubuntu/+source/zfs-linux/+bug/1954676/+attachment/5556146/+files/0001-s390-module-fix-loading-modules-with-a-lot-of-reloca.patch |
|
| 2022-02-02 06:16:19 |
Frank Heimes |
ubuntu-z-systems: status |
Confirmed |
In Progress |
|
| 2022-02-02 06:37:03 |
Frank Heimes |
ubuntu-z-systems: status |
In Progress |
Fix Committed |
|
| 2022-02-02 15:02:28 |
Andrea Righi |
nominated for series |
|
Ubuntu Impish |
|
| 2022-02-02 15:02:28 |
Andrea Righi |
bug task added |
|
zfs-linux (Ubuntu Impish) |
|
| 2022-02-02 15:02:28 |
Andrea Righi |
bug task added |
|
gcc-11 (Ubuntu Impish) |
|
| 2022-02-02 15:04:59 |
Andrea Righi |
bug task added |
|
linux (Ubuntu) |
|
| 2022-02-02 15:05:15 |
Andrea Righi |
linux (Ubuntu Jammy): status |
New |
Fix Committed |
|
| 2022-02-02 15:05:35 |
Andrea Righi |
bug task deleted |
zfs-linux (Ubuntu) |
|
|
| 2022-02-02 15:05:43 |
Andrea Righi |
bug task deleted |
zfs-linux (Ubuntu Impish) |
|
|
| 2022-02-02 15:05:48 |
Andrea Righi |
bug task deleted |
zfs-linux (Ubuntu Jammy) |
|
|
| 2022-02-02 15:06:07 |
Andrea Righi |
linux (Ubuntu Jammy): importance |
Undecided |
Critical |
|
| 2022-02-02 15:06:16 |
Andrea Righi |
linux (Ubuntu Impish): importance |
Undecided |
High |
|
| 2022-02-02 16:18:58 |
Ubuntu Foundations Team Bug Bot |
bug |
|
|
added subscriber Terry Rudd |
| 2022-02-11 15:46:16 |
Stefan Bader |
linux (Ubuntu Impish): status |
New |
Fix Committed |
|
| 2022-02-24 11:02:49 |
Ubuntu Kernel Bot |
tags |
patch s390x |
patch s390x verification-needed-impish |
|
| 2022-02-28 13:23:27 |
Ilya Leoshkevich |
tags |
patch s390x verification-needed-impish |
patch s390x verification-done-impish |
|
| 2022-03-17 14:02:43 |
Ubuntu Kernel Bot |
tags |
patch s390x verification-done-impish |
patch s390x verification-done-impish verification-needed-focal |
|
| 2022-03-21 15:36:28 |
Launchpad Janitor |
linux (Ubuntu Impish): status |
Fix Committed |
Fix Released |
|
| 2022-03-21 15:36:28 |
Launchpad Janitor |
cve linked |
|
2022-0435 |
|
| 2022-03-21 15:36:28 |
Launchpad Janitor |
cve linked |
|
2022-0492 |
|
| 2022-03-21 15:36:28 |
Launchpad Janitor |
cve linked |
|
2022-0516 |
|
| 2022-03-21 15:36:28 |
Launchpad Janitor |
cve linked |
|
2022-0742 |
|
| 2022-03-21 15:36:28 |
Launchpad Janitor |
cve linked |
|
2022-23222 |
|
| 2022-03-21 16:29:04 |
Frank Heimes |
linux (Ubuntu Jammy): status |
Fix Committed |
Fix Released |
|
| 2022-03-21 16:29:08 |
Frank Heimes |
ubuntu-z-systems: status |
Fix Committed |
Fix Released |
|
| 2022-04-05 15:11:53 |
Dimitri John Ledkov |
gcc-11 (Ubuntu Impish): status |
New |
Invalid |
|
