Activity log for bug #1956166

Date Who What changed Old value New value Message
2022-01-01 22:23:48 Belgarath bug added bug
2022-01-03 13:44:03 Christian Ehrhardt  bug added subscriber Stefan Bader
2022-01-03 13:46:28 Christian Ehrhardt  xen (Ubuntu): assignee Stefan Bader (smb)
2022-01-03 13:54:02 Christian Ehrhardt  tags server-triage-discuss
2022-01-19 16:18:36 Christian Ehrhardt  tags server-triage-discuss
2022-01-27 11:13:04 Launchpad Janitor xen (Ubuntu): status New Confirmed
2022-01-31 06:55:01 Christian Ehrhardt  merge proposal linked https://code.launchpad.net/~paelzer/ubuntu/+source/xen/+git/xen/+merge/414651
2022-02-14 01:11:00 Jan Kellermann bug added subscriber Jan Kellermann
2022-03-02 17:12:58 Launchpad Janitor xen (Ubuntu): status Confirmed Fix Released
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-0543
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-15563
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-15564
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-15565
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-15567
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-25595
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-25596
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-25597
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-25598
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-25599
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-25600
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-25601
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-25602
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-25603
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-25604
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-27670
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-27671
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-27672
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-27674
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-28368
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29040
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29479
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29480
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29481
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29482
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29483
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29484
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29485
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29486
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29566
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29567
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29570
2022-03-02 17:12:58 Launchpad Janitor cve linked 2020-29571
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-0089
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-26313
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-26933
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28687
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28690
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28692
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28693
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28694
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28695
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28696
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28697
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28698
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28699
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28700
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28701
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28702
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28704
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28705
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28706
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28707
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28708
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28709
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-28710
2022-03-02 17:12:58 Launchpad Janitor cve linked 2021-3308
2022-07-04 21:54:57 Mauricio Faria de Oliveira merge proposal linked https://code.launchpad.net/~mfo/ubuntu/+source/xen/+git/xen/+merge/426221
2022-07-04 22:04:08 Mauricio Faria de Oliveira description Ubuntu 22.04 doesn't boot with xen kernels compressed using zstd are only supported in upstream xen 4.15 but xen-4.11 is installed in ubuntu 22.04 together with zstd compressed kernel 5.13.0-19 Either compression needs to be changed to one that is supported by xen or xen packages needs to be upgraded to 4.15 or higher. [Impact] * Xen fails to boot as Dom0 and DomU PV (Dom0 HVM works) with the HWE kernel from Jammy (5.15) on Focal. * Xen 4.11 doesn't have support zstd kernel compression, which was added in Xen 4.15, but it backports nicely. (First 3 patches for Dom0, and 2 patches for DomU PV). ~/git/xen$ git log --oneline RELEASE-4.11.3..RELEASE-4.15.0 ... 8169f82049ef libxenguest: support zstd compressed kernels d8099d94dfaa libxenguest: add get_unaligned_le32() ... d6627cf1b63c x86/Dom0: support zstd compressed kernels 35d2960ae65f lib: introduce xxhash 7c9f81687ad6 introduce unaligned.h ... [Test Plan] * On Focal, test Xen with the 5.15 HWE kernel from Jammy, on the 3 modes (Dom0, DomU PV, and DomU HVM). * Likewise, check for regressions with the 5.4 GA kernel. * Basically (full steps in comment #13), on a KVM guest with serial console enabled for grub/xen/linux kernel: $ sudo apt install --yes xen-hypervisor-4.11-amd64 linux-image-generic-hwe-20.04-edge Before: * Dom0: - Boot 'Ubuntu GNU/Linux, with Xen 4.11-amd64 and Linux 5.15.0-33-generic' ... (XEN) Brought up 2 CPUs (XEN) Dom0 has maximum 400 PIRQs (XEN) ELF: not an ELF binary ... (XEN) Could not set up DOM0 guest OS * DomU PV: $ sudo xl create -c xen-5.15-vm.pv Parsing config from xen-5.15-vm.pv xc: error: panic: xc_dom_bzimageloader.c:774: xc_dom_probe_bzimage_kernel: unknown compression format: Invalid kernel ... * DomU HVM: (works; it runs in QEMU) $ sudo xl create -c xen-5.15-vm.hvm Parsing config from xen-5.15-vm.hvm [ 0.000000] Linux version 5.15.0-33-generic ... ... [ 0.000000] DMI: Xen HVM domU, BIOS 4.11.4-pre 07/04/2022 ... After: (ppa:mfo/lp1956166) * Dom0: - Boot 'Ubuntu GNU/Linux, with Xen 4.11-amd64 and Linux 5.15.0-33-generic' ... (XEN) Brought up 2 CPUs (XEN) Dom0 has maximum 400 PIRQs (XEN) Xen kernel: 64-bit, lsb, compat32 (XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x4000000 ... [ 0.000000] Linux version 5.15.0-33-generic ... * DomU PV: $ sudo xl create -c xen-5.15-vm.pv Parsing config from xen-5.15-vm.pv [ 0.000000] Linux version 5.15.0-33-generic ... ... [ 0.000000] Hypervisor detected: Xen PV ... * DomU HVM: (still work) $ sudo xl create -c xen-5.15-vm.hvm Parsing config from xen-5.15-vm.hvm [ 0.000000] Linux version 5.15.0-33-generic ... ... [ 0.000000] DMI: Xen HVM domU, BIOS 4.11.4-pre 07/04/2022 ... [Where problems could occur] * Even though the patches _add a lot_ of code to support zstd (ie, read/decompress), the actual _changes_ to existing code are usually just calling its decompression functions after the other compression methods. (And some helper factor-out). * Regressions would likely manifest in the kernel decompression functions, i.e., _boot_, so should be quick/easy to find out (with older/non-zstd compressed kernel versions; eg, GA/5.4). [Other Info] * Only Focal needs a SRU. The patches are applied in Xen 4.15, so Kinetic and Jammy (4.16) already have it, and Impish and Focal (4.11) don't; but Impish is almost EOL, so, only Focal. * The DomU PV mode hits kernel errors during early boot, and doesn't get to the initramfs. These issues seem related to the PV mode only (seen elsewhere, and regardless of kernel version, 5.4 or 5.15), but it looks like the DomU HVM mode is more used in practice? So, theoretically, Ubuntu support for DomU PV wouldn't be needed, but maybe let's just add it all at once, in case users are booting other kernels that are patched to work. [Original Bug Description] Ubuntu 22.04 doesn't boot with xen kernels compressed using zstd are only supported in upstream xen 4.15 but xen-4.11 is installed in ubuntu 22.04 together with zstd compressed kernel 5.13.0-19 Either compression needs to be changed to one that is supported by xen or xen packages needs to be upgraded to 4.15 or higher.
2022-07-04 22:04:22 Mauricio Faria de Oliveira nominated for series Ubuntu Impish
2022-07-04 22:04:22 Mauricio Faria de Oliveira bug task added xen (Ubuntu Impish)
2022-07-04 22:04:22 Mauricio Faria de Oliveira nominated for series Ubuntu Focal
2022-07-04 22:04:22 Mauricio Faria de Oliveira bug task added xen (Ubuntu Focal)
2022-07-04 22:04:36 Mauricio Faria de Oliveira xen (Ubuntu Focal): status New In Progress
2022-07-04 22:04:40 Mauricio Faria de Oliveira xen (Ubuntu Focal): importance Undecided Medium
2022-07-04 22:04:42 Mauricio Faria de Oliveira xen (Ubuntu Focal): assignee Mauricio Faria de Oliveira (mfo)
2022-07-04 22:04:46 Mauricio Faria de Oliveira xen (Ubuntu Impish): status New Won't Fix
2022-07-04 22:05:15 Mauricio Faria de Oliveira description [Impact] * Xen fails to boot as Dom0 and DomU PV (Dom0 HVM works) with the HWE kernel from Jammy (5.15) on Focal. * Xen 4.11 doesn't have support zstd kernel compression, which was added in Xen 4.15, but it backports nicely. (First 3 patches for Dom0, and 2 patches for DomU PV). ~/git/xen$ git log --oneline RELEASE-4.11.3..RELEASE-4.15.0 ... 8169f82049ef libxenguest: support zstd compressed kernels d8099d94dfaa libxenguest: add get_unaligned_le32() ... d6627cf1b63c x86/Dom0: support zstd compressed kernels 35d2960ae65f lib: introduce xxhash 7c9f81687ad6 introduce unaligned.h ... [Test Plan] * On Focal, test Xen with the 5.15 HWE kernel from Jammy, on the 3 modes (Dom0, DomU PV, and DomU HVM). * Likewise, check for regressions with the 5.4 GA kernel. * Basically (full steps in comment #13), on a KVM guest with serial console enabled for grub/xen/linux kernel: $ sudo apt install --yes xen-hypervisor-4.11-amd64 linux-image-generic-hwe-20.04-edge Before: * Dom0: - Boot 'Ubuntu GNU/Linux, with Xen 4.11-amd64 and Linux 5.15.0-33-generic' ... (XEN) Brought up 2 CPUs (XEN) Dom0 has maximum 400 PIRQs (XEN) ELF: not an ELF binary ... (XEN) Could not set up DOM0 guest OS * DomU PV: $ sudo xl create -c xen-5.15-vm.pv Parsing config from xen-5.15-vm.pv xc: error: panic: xc_dom_bzimageloader.c:774: xc_dom_probe_bzimage_kernel: unknown compression format: Invalid kernel ... * DomU HVM: (works; it runs in QEMU) $ sudo xl create -c xen-5.15-vm.hvm Parsing config from xen-5.15-vm.hvm [ 0.000000] Linux version 5.15.0-33-generic ... ... [ 0.000000] DMI: Xen HVM domU, BIOS 4.11.4-pre 07/04/2022 ... After: (ppa:mfo/lp1956166) * Dom0: - Boot 'Ubuntu GNU/Linux, with Xen 4.11-amd64 and Linux 5.15.0-33-generic' ... (XEN) Brought up 2 CPUs (XEN) Dom0 has maximum 400 PIRQs (XEN) Xen kernel: 64-bit, lsb, compat32 (XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x4000000 ... [ 0.000000] Linux version 5.15.0-33-generic ... * DomU PV: $ sudo xl create -c xen-5.15-vm.pv Parsing config from xen-5.15-vm.pv [ 0.000000] Linux version 5.15.0-33-generic ... ... [ 0.000000] Hypervisor detected: Xen PV ... * DomU HVM: (still work) $ sudo xl create -c xen-5.15-vm.hvm Parsing config from xen-5.15-vm.hvm [ 0.000000] Linux version 5.15.0-33-generic ... ... [ 0.000000] DMI: Xen HVM domU, BIOS 4.11.4-pre 07/04/2022 ... [Where problems could occur] * Even though the patches _add a lot_ of code to support zstd (ie, read/decompress), the actual _changes_ to existing code are usually just calling its decompression functions after the other compression methods. (And some helper factor-out). * Regressions would likely manifest in the kernel decompression functions, i.e., _boot_, so should be quick/easy to find out (with older/non-zstd compressed kernel versions; eg, GA/5.4). [Other Info] * Only Focal needs a SRU. The patches are applied in Xen 4.15, so Kinetic and Jammy (4.16) already have it, and Impish and Focal (4.11) don't; but Impish is almost EOL, so, only Focal. * The DomU PV mode hits kernel errors during early boot, and doesn't get to the initramfs. These issues seem related to the PV mode only (seen elsewhere, and regardless of kernel version, 5.4 or 5.15), but it looks like the DomU HVM mode is more used in practice? So, theoretically, Ubuntu support for DomU PV wouldn't be needed, but maybe let's just add it all at once, in case users are booting other kernels that are patched to work. [Original Bug Description] Ubuntu 22.04 doesn't boot with xen kernels compressed using zstd are only supported in upstream xen 4.15 but xen-4.11 is installed in ubuntu 22.04 together with zstd compressed kernel 5.13.0-19 Either compression needs to be changed to one that is supported by xen or xen packages needs to be upgraded to 4.15 or higher. [Impact]  * Xen fails to boot as Dom0 and DomU PV (Dom0 HVM works)    with the HWE kernel from Jammy (5.15) on Focal.  * Xen 4.11 doesn't have support zstd kernel compression,    which was added in Xen 4.15, but it backports nicely.    (First 3 patches for Dom0, and 2 patches for DomU PV).    ~/git/xen$ git log --oneline RELEASE-4.11.3..RELEASE-4.15.0    ...    8169f82049ef libxenguest: support zstd compressed kernels    d8099d94dfaa libxenguest: add get_unaligned_le32()    ...    d6627cf1b63c x86/Dom0: support zstd compressed kernels    35d2960ae65f lib: introduce xxhash    7c9f81687ad6 introduce unaligned.h    ... [Test Plan]  * On Focal, test Xen with the 5.15 HWE kernel from Jammy,    on the 3 modes (Dom0, DomU PV, and DomU HVM).  * Likewise, check for regressions with the 5.4 GA kernel.  * Basically (full steps in comment #14), on a KVM guest    with serial console enabled for grub/xen/linux kernel:    $ sudo apt install --yes xen-hypervisor-4.11-amd64 linux-image-generic-hwe-20.04-edge    Before:    * Dom0:    - Boot 'Ubuntu GNU/Linux, with Xen 4.11-amd64 and Linux 5.15.0-33-generic'      ...      (XEN) Brought up 2 CPUs      (XEN) Dom0 has maximum 400 PIRQs      (XEN) ELF: not an ELF binary      ...      (XEN) Could not set up DOM0 guest OS    * DomU PV:      $ sudo xl create -c xen-5.15-vm.pv      Parsing config from xen-5.15-vm.pv      xc: error: panic: xc_dom_bzimageloader.c:774: xc_dom_probe_bzimage_kernel: unknown compression format: Invalid kernel      ...    * DomU HVM: (works; it runs in QEMU)      $ sudo xl create -c xen-5.15-vm.hvm      Parsing config from xen-5.15-vm.hvm      [ 0.000000] Linux version 5.15.0-33-generic ...      ...      [ 0.000000] DMI: Xen HVM domU, BIOS 4.11.4-pre 07/04/2022      ...    After: (ppa:mfo/lp1956166)    * Dom0:    - Boot 'Ubuntu GNU/Linux, with Xen 4.11-amd64 and Linux 5.15.0-33-generic'      ...      (XEN) Brought up 2 CPUs      (XEN) Dom0 has maximum 400 PIRQs      (XEN) Xen kernel: 64-bit, lsb, compat32      (XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x4000000      ...      [ 0.000000] Linux version 5.15.0-33-generic ...    * DomU PV:      $ sudo xl create -c xen-5.15-vm.pv      Parsing config from xen-5.15-vm.pv      [ 0.000000] Linux version 5.15.0-33-generic ...      ...      [ 0.000000] Hypervisor detected: Xen PV      ...    * DomU HVM: (still work)      $ sudo xl create -c xen-5.15-vm.hvm      Parsing config from xen-5.15-vm.hvm      [ 0.000000] Linux version 5.15.0-33-generic ...      ...      [ 0.000000] DMI: Xen HVM domU, BIOS 4.11.4-pre 07/04/2022      ... [Where problems could occur]  * Even though the patches _add a lot_ of code to support zstd    (ie, read/decompress), the actual _changes_ to existing code    are usually just calling its decompression functions after    the other compression methods. (And some helper factor-out).  * Regressions would likely manifest in the kernel decompression    functions, i.e., _boot_, so should be quick/easy to find out    (with older/non-zstd compressed kernel versions; eg, GA/5.4). [Other Info]  * Only Focal needs a SRU. The patches are applied in Xen 4.15,    so Kinetic and Jammy (4.16) already have it, and Impish and    Focal (4.11) don't; but Impish is almost EOL, so, only Focal.  * The DomU PV mode hits kernel errors during early boot, and    doesn't get to the initramfs. These issues seem related to    the PV mode only (seen elsewhere, and regardless of kernel    version, 5.4 or 5.15), but it looks like the DomU HVM mode    is more used in practice?    So, theoretically, Ubuntu support for DomU PV wouldn't be    needed, but maybe let's just add it all at once, in case    users are booting other kernels that are patched to work. [Original Bug Description] Ubuntu 22.04 doesn't boot with xen kernels compressed using zstd are only supported in upstream xen 4.15 but xen-4.11 is installed in ubuntu 22.04 together with zstd compressed kernel 5.13.0-19 Either compression needs to be changed to one that is supported by xen or xen packages needs to be upgraded to 4.15 or higher.
2022-07-04 22:05:41 Mauricio Faria de Oliveira bug added subscriber Mauricio Faria de Oliveira
2022-07-06 13:25:34 Mauricio Faria de Oliveira tags sts
2022-07-07 12:36:40 Łukasz Zemczak xen (Ubuntu Focal): status In Progress Fix Committed
2022-07-07 12:36:41 Łukasz Zemczak bug added subscriber Ubuntu Stable Release Updates Team
2022-07-07 12:36:43 Łukasz Zemczak bug added subscriber SRU Verification
2022-07-07 12:36:47 Łukasz Zemczak tags sts sts verification-needed verification-needed-focal
2022-07-07 19:42:15 Mauricio Faria de Oliveira merge proposal linked https://code.launchpad.net/~mfo/ubuntu/+source/xen/+git/xen/+merge/426503
2022-07-28 15:03:39 Mauricio Faria de Oliveira tags sts verification-needed verification-needed-focal sts verification-done verification-done-focal
2022-08-16 15:06:35 Launchpad Janitor xen (Ubuntu Focal): status Fix Committed Fix Released
2022-08-16 15:06:44 Brian Murray removed subscriber Ubuntu Stable Release Updates Team
2022-08-30 20:15:11 Mauricio Faria de Oliveira nominated for series Ubuntu Kinetic
2022-08-30 20:15:11 Mauricio Faria de Oliveira bug task added xen (Ubuntu Kinetic)
2022-08-30 20:15:11 Mauricio Faria de Oliveira nominated for series Ubuntu Jammy
2022-08-30 20:15:11 Mauricio Faria de Oliveira bug task added xen (Ubuntu Jammy)
2022-08-30 20:15:21 Mauricio Faria de Oliveira xen (Ubuntu Kinetic): status Fix Released In Progress
2022-08-30 20:15:24 Mauricio Faria de Oliveira xen (Ubuntu Kinetic): importance Undecided Medium
2022-08-30 20:15:27 Mauricio Faria de Oliveira xen (Ubuntu Kinetic): assignee Stefan Bader (smb) Mauricio Faria de Oliveira (mfo)
2022-08-30 20:15:31 Mauricio Faria de Oliveira xen (Ubuntu Jammy): status New In Progress
2022-08-30 20:15:33 Mauricio Faria de Oliveira xen (Ubuntu Jammy): importance Undecided Medium
2022-08-30 20:15:36 Mauricio Faria de Oliveira xen (Ubuntu Jammy): assignee Mauricio Faria de Oliveira (mfo)
2022-11-25 20:33:55 László Szalma bug added subscriber László Szalma
2022-11-26 23:11:27 Mauricio Faria de Oliveira description [Impact]  * Xen fails to boot as Dom0 and DomU PV (Dom0 HVM works)    with the HWE kernel from Jammy (5.15) on Focal.  * Xen 4.11 doesn't have support zstd kernel compression,    which was added in Xen 4.15, but it backports nicely.    (First 3 patches for Dom0, and 2 patches for DomU PV).    ~/git/xen$ git log --oneline RELEASE-4.11.3..RELEASE-4.15.0    ...    8169f82049ef libxenguest: support zstd compressed kernels    d8099d94dfaa libxenguest: add get_unaligned_le32()    ...    d6627cf1b63c x86/Dom0: support zstd compressed kernels    35d2960ae65f lib: introduce xxhash    7c9f81687ad6 introduce unaligned.h    ... [Test Plan]  * On Focal, test Xen with the 5.15 HWE kernel from Jammy,    on the 3 modes (Dom0, DomU PV, and DomU HVM).  * Likewise, check for regressions with the 5.4 GA kernel.  * Basically (full steps in comment #14), on a KVM guest    with serial console enabled for grub/xen/linux kernel:    $ sudo apt install --yes xen-hypervisor-4.11-amd64 linux-image-generic-hwe-20.04-edge    Before:    * Dom0:    - Boot 'Ubuntu GNU/Linux, with Xen 4.11-amd64 and Linux 5.15.0-33-generic'      ...      (XEN) Brought up 2 CPUs      (XEN) Dom0 has maximum 400 PIRQs      (XEN) ELF: not an ELF binary      ...      (XEN) Could not set up DOM0 guest OS    * DomU PV:      $ sudo xl create -c xen-5.15-vm.pv      Parsing config from xen-5.15-vm.pv      xc: error: panic: xc_dom_bzimageloader.c:774: xc_dom_probe_bzimage_kernel: unknown compression format: Invalid kernel      ...    * DomU HVM: (works; it runs in QEMU)      $ sudo xl create -c xen-5.15-vm.hvm      Parsing config from xen-5.15-vm.hvm      [ 0.000000] Linux version 5.15.0-33-generic ...      ...      [ 0.000000] DMI: Xen HVM domU, BIOS 4.11.4-pre 07/04/2022      ...    After: (ppa:mfo/lp1956166)    * Dom0:    - Boot 'Ubuntu GNU/Linux, with Xen 4.11-amd64 and Linux 5.15.0-33-generic'      ...      (XEN) Brought up 2 CPUs      (XEN) Dom0 has maximum 400 PIRQs      (XEN) Xen kernel: 64-bit, lsb, compat32      (XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x4000000      ...      [ 0.000000] Linux version 5.15.0-33-generic ...    * DomU PV:      $ sudo xl create -c xen-5.15-vm.pv      Parsing config from xen-5.15-vm.pv      [ 0.000000] Linux version 5.15.0-33-generic ...      ...      [ 0.000000] Hypervisor detected: Xen PV      ...    * DomU HVM: (still work)      $ sudo xl create -c xen-5.15-vm.hvm      Parsing config from xen-5.15-vm.hvm      [ 0.000000] Linux version 5.15.0-33-generic ...      ...      [ 0.000000] DMI: Xen HVM domU, BIOS 4.11.4-pre 07/04/2022      ... [Where problems could occur]  * Even though the patches _add a lot_ of code to support zstd    (ie, read/decompress), the actual _changes_ to existing code    are usually just calling its decompression functions after    the other compression methods. (And some helper factor-out).  * Regressions would likely manifest in the kernel decompression    functions, i.e., _boot_, so should be quick/easy to find out    (with older/non-zstd compressed kernel versions; eg, GA/5.4). [Other Info]  * Only Focal needs a SRU. The patches are applied in Xen 4.15,    so Kinetic and Jammy (4.16) already have it, and Impish and    Focal (4.11) don't; but Impish is almost EOL, so, only Focal.  * The DomU PV mode hits kernel errors during early boot, and    doesn't get to the initramfs. These issues seem related to    the PV mode only (seen elsewhere, and regardless of kernel    version, 5.4 or 5.15), but it looks like the DomU HVM mode    is more used in practice?    So, theoretically, Ubuntu support for DomU PV wouldn't be    needed, but maybe let's just add it all at once, in case    users are booting other kernels that are patched to work. [Original Bug Description] Ubuntu 22.04 doesn't boot with xen kernels compressed using zstd are only supported in upstream xen 4.15 but xen-4.11 is installed in ubuntu 22.04 together with zstd compressed kernel 5.13.0-19 Either compression needs to be changed to one that is supported by xen or xen packages needs to be upgraded to 4.15 or higher. [Note] * This bug addresses Dom0 on Focal and later, plus DomU pv/pvh/pygrub on Focal _only_ (unintended inconsistency). * For DomU pv/pvh/pygrub on Jammy and later, see bug 1998026. [Impact]  * Xen fails to boot as Dom0 and DomU PV (Dom0 HVM works)    with the HWE kernel from Jammy (5.15) on Focal.  * Xen 4.11 doesn't have support zstd kernel compression,    which was added in Xen 4.15, but it backports nicely.    (First 3 patches for Dom0, and 2 patches for DomU PV).    ~/git/xen$ git log --oneline RELEASE-4.11.3..RELEASE-4.15.0    ...    8169f82049ef libxenguest: support zstd compressed kernels    d8099d94dfaa libxenguest: add get_unaligned_le32()    ...    d6627cf1b63c x86/Dom0: support zstd compressed kernels    35d2960ae65f lib: introduce xxhash    7c9f81687ad6 introduce unaligned.h    ... [Test Plan]  * On Focal, test Xen with the 5.15 HWE kernel from Jammy,    on the 3 modes (Dom0, DomU PV, and DomU HVM).  * Likewise, check for regressions with the 5.4 GA kernel.  * Basically (full steps in comment #14), on a KVM guest    with serial console enabled for grub/xen/linux kernel:    $ sudo apt install --yes xen-hypervisor-4.11-amd64 linux-image-generic-hwe-20.04-edge    Before:    * Dom0:    - Boot 'Ubuntu GNU/Linux, with Xen 4.11-amd64 and Linux 5.15.0-33-generic'      ...      (XEN) Brought up 2 CPUs      (XEN) Dom0 has maximum 400 PIRQs      (XEN) ELF: not an ELF binary      ...      (XEN) Could not set up DOM0 guest OS    * DomU PV:      $ sudo xl create -c xen-5.15-vm.pv      Parsing config from xen-5.15-vm.pv      xc: error: panic: xc_dom_bzimageloader.c:774: xc_dom_probe_bzimage_kernel: unknown compression format: Invalid kernel      ...    * DomU HVM: (works; it runs in QEMU)      $ sudo xl create -c xen-5.15-vm.hvm      Parsing config from xen-5.15-vm.hvm      [ 0.000000] Linux version 5.15.0-33-generic ...      ...      [ 0.000000] DMI: Xen HVM domU, BIOS 4.11.4-pre 07/04/2022      ...    After: (ppa:mfo/lp1956166)    * Dom0:    - Boot 'Ubuntu GNU/Linux, with Xen 4.11-amd64 and Linux 5.15.0-33-generic'      ...      (XEN) Brought up 2 CPUs      (XEN) Dom0 has maximum 400 PIRQs      (XEN) Xen kernel: 64-bit, lsb, compat32      (XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x4000000      ...      [ 0.000000] Linux version 5.15.0-33-generic ...    * DomU PV:      $ sudo xl create -c xen-5.15-vm.pv      Parsing config from xen-5.15-vm.pv      [ 0.000000] Linux version 5.15.0-33-generic ...      ...      [ 0.000000] Hypervisor detected: Xen PV      ...    * DomU HVM: (still work)      $ sudo xl create -c xen-5.15-vm.hvm      Parsing config from xen-5.15-vm.hvm      [ 0.000000] Linux version 5.15.0-33-generic ...      ...      [ 0.000000] DMI: Xen HVM domU, BIOS 4.11.4-pre 07/04/2022      ... [Where problems could occur]  * Even though the patches _add a lot_ of code to support zstd    (ie, read/decompress), the actual _changes_ to existing code    are usually just calling its decompression functions after    the other compression methods. (And some helper factor-out).  * Regressions would likely manifest in the kernel decompression    functions, i.e., _boot_, so should be quick/easy to find out    (with older/non-zstd compressed kernel versions; eg, GA/5.4). [Other Info]  * Only Focal needs a SRU. The patches are applied in Xen 4.15,    so Kinetic and Jammy (4.16) already have it, and Impish and    Focal (4.11) don't; but Impish is almost EOL, so, only Focal.  * The DomU PV mode hits kernel errors during early boot, and    doesn't get to the initramfs. These issues seem related to    the PV mode only (seen elsewhere, and regardless of kernel    version, 5.4 or 5.15), but it looks like the DomU HVM mode    is more used in practice?    So, theoretically, Ubuntu support for DomU PV wouldn't be    needed, but maybe let's just add it all at once, in case    users are booting other kernels that are patched to work. [Original Bug Description] Ubuntu 22.04 doesn't boot with xen kernels compressed using zstd are only supported in upstream xen 4.15 but xen-4.11 is installed in ubuntu 22.04 together with zstd compressed kernel 5.13.0-19 Either compression needs to be changed to one that is supported by xen or xen packages needs to be upgraded to 4.15 or higher.
2022-11-26 23:19:32 Mauricio Faria de Oliveira xen (Ubuntu Jammy): status In Progress Fix Released
2022-11-26 23:19:36 Mauricio Faria de Oliveira xen (Ubuntu Kinetic): status In Progress Fix Released
2022-12-05 19:55:38 Mauricio Faria de Oliveira xen (Ubuntu): status In Progress Fix Released