| 2021-06-17 14:43:13 |
Dimitri John Ledkov |
bug |
|
|
added bug |
| 2021-06-17 14:43:25 |
Dimitri John Ledkov |
linux (Ubuntu): status |
New |
Incomplete |
|
| 2021-06-17 14:43:30 |
Dimitri John Ledkov |
linux (Ubuntu): assignee |
|
Colin Ian King (colin-king) |
|
| 2021-06-17 14:44:07 |
Colin Ian King |
linux (Ubuntu): importance |
Undecided |
Medium |
|
| 2021-06-17 14:44:09 |
Colin Ian King |
linux (Ubuntu): status |
Incomplete |
In Progress |
|
| 2021-06-22 11:59:19 |
Colin Ian King |
attachment added |
|
raw test data https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1932329/+attachment/5506240/+files/zstd-module-compression.ods |
|
| 2021-06-22 12:01:39 |
Colin Ian King |
attachment added |
|
diff to enable ZSTD compressed kernel modules https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1932329/+attachment/5506241/+files/zstd-kernel-config.diff |
|
| 2021-06-22 12:36:35 |
Ubuntu Foundations Team Bug Bot |
tags |
performance zstd |
patch performance zstd |
|
| 2021-06-22 12:36:36 |
Ubuntu Foundations Team Bug Bot |
bug |
|
|
added subscriber Terry Rudd |
| 2021-10-07 08:25:53 |
Colin Ian King |
linux (Ubuntu): assignee |
Colin Ian King (colin-king) |
|
|
| 2021-10-07 08:26:07 |
Colin Ian King |
linux (Ubuntu): assignee |
|
Dimitri John Ledkov (xnox) |
|
| 2021-10-19 10:51:38 |
Dimitri John Ledkov |
bug task added |
|
initramfs-tools (Ubuntu) |
|
| 2021-10-19 21:10:21 |
daas |
bug |
|
|
added subscriber daasuharo |
| 2021-11-03 21:58:43 |
Launchpad Janitor |
initramfs-tools (Ubuntu): status |
New |
Fix Released |
|
| 2022-01-28 15:57:39 |
Dimitri John Ledkov |
description |
Symbol: MODULE_COMPRESS_ZSTD [=n]
Type : bool
= Impacts to measure and observe =
== Disk space ==
* Inspect linux-modules-* and linux-modules-extra* deb package Installed-Size and Download-Size changes, i.e.
$ apt show linux-modules-5.8.0-53-generic linux-modules-extra-5.8.0-53-generic | grep -e Package: -e Size:
Package: linux-modules-5.8.0-53-generic
Installed-Size: 81.5 MB
Download-Size: 15.5 MB
Package: linux-modules-extra-5.8.0-53-generic
Installed-Size: 215 MB
Download-Size: 41.5 MB
In theory, there should not be a significant change in the Download-size. It is desired that there is a significant reduction in Installed-Size. Modules take up about 300MB and normally one has upto three kernel version installed, resulting in about of 1GB of disk space that one constantly pays for.
== Boot Speed ==
In theory, boot speed may either improve or regress. It depends if disk IO is slower than decompression speed, meaning loading compressed modules is faster.
Also one has to observe the changes in the initrd size. zstd(zstd) compression may result in slight growth, which shouldn't impact boot speed too much.
= Outcomes =
If installed size savings can be achieved without regressing bootspeed we should enable CONFIG_MODULE_COMPRESS_ZSTD=y by default. |
--- initramfs-tools
[Impact]
* Initramfs-tools already supports compressed kernel modules. However, in focal it does so inefficiently. It is always better to have a compressed initramfs of uncommpressed kernel modules, than a compressed initrd of compressed kernel modules. Thus when kernel module compression is turned on, it is prudent for initramfs-tools to pre-uncompress kernel modules when building initramfs.
[Test Plan]
* Compress all kernel modules with xz for a current kernel, check that all of them have .ko.xz extension and no .ko ones available
* Rerun depmod
* Update initramfs with update-initramfs -u
* lsinitramfs contents and check that all kernel modules are present, and are uncompressed (.ko extension)
[Where problems could occur]
* This optimization for compressed kernel modules will make initramfs build time longer (due to decompression) whilst improving bootspeed (overall smaller size of the initrd).
[Other Info]
* Original bug report re kernel feature
Symbol: MODULE_COMPRESS_ZSTD [=n]
Type : bool
= Impacts to measure and observe =
== Disk space ==
* Inspect linux-modules-* and linux-modules-extra* deb package Installed-Size and Download-Size changes, i.e.
$ apt show linux-modules-5.8.0-53-generic linux-modules-extra-5.8.0-53-generic | grep -e Package: -e Size:
Package: linux-modules-5.8.0-53-generic
Installed-Size: 81.5 MB
Download-Size: 15.5 MB
Package: linux-modules-extra-5.8.0-53-generic
Installed-Size: 215 MB
Download-Size: 41.5 MB
In theory, there should not be a significant change in the Download-size. It is desired that there is a significant reduction in Installed-Size. Modules take up about 300MB and normally one has upto three kernel version installed, resulting in about of 1GB of disk space that one constantly pays for.
== Boot Speed ==
In theory, boot speed may either improve or regress. It depends if disk IO is slower than decompression speed, meaning loading compressed modules is faster.
Also one has to observe the changes in the initrd size. zstd(zstd) compression may result in slight growth, which shouldn't impact boot speed too much.
= Outcomes =
If installed size savings can be achieved without regressing bootspeed we should enable CONFIG_MODULE_COMPRESS_ZSTD=y by default. |
|
| 2022-01-28 15:57:54 |
Dimitri John Ledkov |
description |
--- initramfs-tools
[Impact]
* Initramfs-tools already supports compressed kernel modules. However, in focal it does so inefficiently. It is always better to have a compressed initramfs of uncommpressed kernel modules, than a compressed initrd of compressed kernel modules. Thus when kernel module compression is turned on, it is prudent for initramfs-tools to pre-uncompress kernel modules when building initramfs.
[Test Plan]
* Compress all kernel modules with xz for a current kernel, check that all of them have .ko.xz extension and no .ko ones available
* Rerun depmod
* Update initramfs with update-initramfs -u
* lsinitramfs contents and check that all kernel modules are present, and are uncompressed (.ko extension)
[Where problems could occur]
* This optimization for compressed kernel modules will make initramfs build time longer (due to decompression) whilst improving bootspeed (overall smaller size of the initrd).
[Other Info]
* Original bug report re kernel feature
Symbol: MODULE_COMPRESS_ZSTD [=n]
Type : bool
= Impacts to measure and observe =
== Disk space ==
* Inspect linux-modules-* and linux-modules-extra* deb package Installed-Size and Download-Size changes, i.e.
$ apt show linux-modules-5.8.0-53-generic linux-modules-extra-5.8.0-53-generic | grep -e Package: -e Size:
Package: linux-modules-5.8.0-53-generic
Installed-Size: 81.5 MB
Download-Size: 15.5 MB
Package: linux-modules-extra-5.8.0-53-generic
Installed-Size: 215 MB
Download-Size: 41.5 MB
In theory, there should not be a significant change in the Download-size. It is desired that there is a significant reduction in Installed-Size. Modules take up about 300MB and normally one has upto three kernel version installed, resulting in about of 1GB of disk space that one constantly pays for.
== Boot Speed ==
In theory, boot speed may either improve or regress. It depends if disk IO is slower than decompression speed, meaning loading compressed modules is faster.
Also one has to observe the changes in the initrd size. zstd(zstd) compression may result in slight growth, which shouldn't impact boot speed too much.
= Outcomes =
If installed size savings can be achieved without regressing bootspeed we should enable CONFIG_MODULE_COMPRESS_ZSTD=y by default. |
--- initramfs-tools
[Impact]
* Initramfs-tools already supports compressed kernel modules. However, in focal it does so inefficiently. It is always better to have a compressed initramfs of uncommpressed kernel modules, than a compressed initrd of compressed kernel modules. Thus when kernel module compression is turned on, it is prudent for initramfs-tools to pre-uncompress kernel modules when building initramfs.
[Test Plan]
* Compress all kernel modules with xz for a current kernel, check that all of them have .ko.xz extension and no .ko ones available
* Rerun depmod
* Update initramfs with update-initramfs -u
* lsinitramfs contents and check that all kernel modules are present, and are uncompressed (.ko extension)
[Where problems could occur]
* This optimization for compressed kernel modules will make initramfs build time longer (due to decompression) whilst improving bootspeed (overall smaller size of the initrd).
[Other Info]
* Original bug report re kernel feature
--- linux
Symbol: MODULE_COMPRESS_ZSTD [=n]
Type : bool
= Impacts to measure and observe =
== Disk space ==
* Inspect linux-modules-* and linux-modules-extra* deb package Installed-Size and Download-Size changes, i.e.
$ apt show linux-modules-5.8.0-53-generic linux-modules-extra-5.8.0-53-generic | grep -e Package: -e Size:
Package: linux-modules-5.8.0-53-generic
Installed-Size: 81.5 MB
Download-Size: 15.5 MB
Package: linux-modules-extra-5.8.0-53-generic
Installed-Size: 215 MB
Download-Size: 41.5 MB
In theory, there should not be a significant change in the Download-size. It is desired that there is a significant reduction in Installed-Size. Modules take up about 300MB and normally one has upto three kernel version installed, resulting in about of 1GB of disk space that one constantly pays for.
== Boot Speed ==
In theory, boot speed may either improve or regress. It depends if disk IO is slower than decompression speed, meaning loading compressed modules is faster.
Also one has to observe the changes in the initrd size. zstd(zstd) compression may result in slight growth, which shouldn't impact boot speed too much.
= Outcomes =
If installed size savings can be achieved without regressing bootspeed we should enable CONFIG_MODULE_COMPRESS_ZSTD=y by default. |
|
| 2022-01-28 15:58:00 |
Dimitri John Ledkov |
nominated for series |
|
Ubuntu Impish |
|
| 2022-01-28 15:58:00 |
Dimitri John Ledkov |
bug task added |
|
initramfs-tools (Ubuntu Impish) |
|
| 2022-01-28 15:58:00 |
Dimitri John Ledkov |
bug task added |
|
linux (Ubuntu Impish) |
|
| 2022-01-28 15:58:00 |
Dimitri John Ledkov |
nominated for series |
|
Ubuntu Jammy |
|
| 2022-01-28 15:58:00 |
Dimitri John Ledkov |
bug task added |
|
initramfs-tools (Ubuntu Jammy) |
|
| 2022-01-28 15:58:00 |
Dimitri John Ledkov |
bug task added |
|
linux (Ubuntu Jammy) |
|
| 2022-01-28 15:58:00 |
Dimitri John Ledkov |
nominated for series |
|
Ubuntu Focal |
|
| 2022-01-28 15:58:00 |
Dimitri John Ledkov |
bug task added |
|
initramfs-tools (Ubuntu Focal) |
|
| 2022-01-28 15:58:00 |
Dimitri John Ledkov |
bug task added |
|
linux (Ubuntu Focal) |
|
| 2022-01-28 15:58:34 |
Dimitri John Ledkov |
bug task deleted |
linux (Ubuntu Impish) |
|
|
| 2022-01-28 15:58:39 |
Dimitri John Ledkov |
bug task deleted |
linux (Ubuntu Focal) |
|
|
| 2022-01-28 15:59:04 |
Dimitri John Ledkov |
summary |
Benchmark if we can compress kernel modules |
Support compressed kernel modules in initramfs-tools and kernel |
|
| 2022-01-28 15:59:22 |
Dimitri John Ledkov |
description |
--- initramfs-tools
[Impact]
* Initramfs-tools already supports compressed kernel modules. However, in focal it does so inefficiently. It is always better to have a compressed initramfs of uncommpressed kernel modules, than a compressed initrd of compressed kernel modules. Thus when kernel module compression is turned on, it is prudent for initramfs-tools to pre-uncompress kernel modules when building initramfs.
[Test Plan]
* Compress all kernel modules with xz for a current kernel, check that all of them have .ko.xz extension and no .ko ones available
* Rerun depmod
* Update initramfs with update-initramfs -u
* lsinitramfs contents and check that all kernel modules are present, and are uncompressed (.ko extension)
[Where problems could occur]
* This optimization for compressed kernel modules will make initramfs build time longer (due to decompression) whilst improving bootspeed (overall smaller size of the initrd).
[Other Info]
* Original bug report re kernel feature
--- linux
Symbol: MODULE_COMPRESS_ZSTD [=n]
Type : bool
= Impacts to measure and observe =
== Disk space ==
* Inspect linux-modules-* and linux-modules-extra* deb package Installed-Size and Download-Size changes, i.e.
$ apt show linux-modules-5.8.0-53-generic linux-modules-extra-5.8.0-53-generic | grep -e Package: -e Size:
Package: linux-modules-5.8.0-53-generic
Installed-Size: 81.5 MB
Download-Size: 15.5 MB
Package: linux-modules-extra-5.8.0-53-generic
Installed-Size: 215 MB
Download-Size: 41.5 MB
In theory, there should not be a significant change in the Download-size. It is desired that there is a significant reduction in Installed-Size. Modules take up about 300MB and normally one has upto three kernel version installed, resulting in about of 1GB of disk space that one constantly pays for.
== Boot Speed ==
In theory, boot speed may either improve or regress. It depends if disk IO is slower than decompression speed, meaning loading compressed modules is faster.
Also one has to observe the changes in the initrd size. zstd(zstd) compression may result in slight growth, which shouldn't impact boot speed too much.
= Outcomes =
If installed size savings can be achieved without regressing bootspeed we should enable CONFIG_MODULE_COMPRESS_ZSTD=y by default. |
--- initramfs-tools
[Impact]
* Initramfs-tools already supports compressed kernel modules. However, in focal and impish it does so inefficiently. It is always better to have a compressed initramfs of uncommpressed kernel modules, than a compressed initrd of compressed kernel modules. Thus when kernel module compression is turned on, it is prudent for initramfs-tools to pre-uncompress kernel modules when building initramfs.
[Test Plan]
* Compress all kernel modules with xz for a current kernel, check that all of them have .ko.xz extension and no .ko ones available
* Rerun depmod
* Update initramfs with update-initramfs -u
* lsinitramfs contents and check that all kernel modules are present, and are uncompressed (.ko extension)
[Where problems could occur]
* This optimization for compressed kernel modules will make initramfs build time longer (due to decompression) whilst improving bootspeed (overall smaller size of the initrd).
[Other Info]
* Original bug report re kernel feature
--- linux
Symbol: MODULE_COMPRESS_ZSTD [=n]
Type : bool
= Impacts to measure and observe =
== Disk space ==
* Inspect linux-modules-* and linux-modules-extra* deb package Installed-Size and Download-Size changes, i.e.
$ apt show linux-modules-5.8.0-53-generic linux-modules-extra-5.8.0-53-generic | grep -e Package: -e Size:
Package: linux-modules-5.8.0-53-generic
Installed-Size: 81.5 MB
Download-Size: 15.5 MB
Package: linux-modules-extra-5.8.0-53-generic
Installed-Size: 215 MB
Download-Size: 41.5 MB
In theory, there should not be a significant change in the Download-size. It is desired that there is a significant reduction in Installed-Size. Modules take up about 300MB and normally one has upto three kernel version installed, resulting in about of 1GB of disk space that one constantly pays for.
== Boot Speed ==
In theory, boot speed may either improve or regress. It depends if disk IO is slower than decompression speed, meaning loading compressed modules is faster.
Also one has to observe the changes in the initrd size. zstd(zstd) compression may result in slight growth, which shouldn't impact boot speed too much.
= Outcomes =
If installed size savings can be achieved without regressing bootspeed we should enable CONFIG_MODULE_COMPRESS_ZSTD=y by default. |
|
| 2022-07-18 23:03:27 |
Brian Murray |
initramfs-tools (Ubuntu Impish): status |
New |
Won't Fix |
|
| 2023-07-26 13:22:39 |
Dimitri John Ledkov |
bug task deleted |
linux (Ubuntu Jammy) |
|
|
| 2023-07-26 13:22:44 |
Dimitri John Ledkov |
bug task deleted |
linux (Ubuntu) |
|
|
