[FFe] Update zfs-linux to upstream 2.3.1

[John Cabaj]

Would like to update to the 2.3.1 upstream version for the Plucky release due to the following new features:

* RAIDZ Expansion: Add new devices to an existing RAIDZ pool, increasing storage capacity without downtime.
* Fast Dedup: A major performance upgrade to the original OpenZFS deduplication functionality.
* Direct IO: Allows bypassing the ARC for reads/writes, improving performance in scenarios like NVMe devices where caching may hinder efficiency.
* JSON: Optional JSON output for the most used commands.
* Long names: Support for file and directory names up to 1023 characters.
* Bug Fixes: A series of critical bug fixes addressing issues reported in previous versions.
* Numerous performance improvements throughout the code base.
* Add 'zfs-qemu-packages' workflow for RPM building
* Linux 6.13 compat: META
* zpool: allow relative vdev paths
* arc: avoid possible deadlock in arc_read
* Don't try to get mg of hole vdev in removal
* spa: fix signature mismatch for spa_boot_init as eventhandler required
* Better fill empty metaslabs
* suspend_resume_single: clear pool errors on fail
* include: move zio_priority_t into zfs.h
* vdev_file: make FLUSH and TRIM asynchronous
* Fix wrong free function in arc_hdr_decrypt
* vdev_file: unify FreeBSD and Linux implementations
* Fix metaslab group fragmentation math
* range_tree: convert remaining range_* defs to zfs_range_*
* Linux 6.12 compat: Rename range_tree_* to zfs_range_tree_*
* Free memory in an error path in spl-kmem-cache.c
* Update the dataset name in handle after zfs_rename
* zio: do no-op injections just before handing off to vdevs
* Fix "make install" with DESTDIR set
* optimize recv_fix_encryption_hierarchy()
* Add kstats tracking gang allocations
* Expand fragmentation table to reflect larger possibile allocation sizes
* Fix typos in zpool_do_scrub() error messages
* Clarify documentation of zfs destroy on snapshots
* Linux 6.14: BLK_MQ_F_SHOULD_MERGE was removed
* Linux 6.14: dops->d_revalidate now takes four args
* zio: lock parent zios when updating wait counts on reexecute
* Avoid ARC buffer transfrom operations in prefetch
* Add recursive dataset mounting and unmounting support to pam_zfs_key
* Update pin_user_pages() calls for Direct I/O
* Make the vfs.zfs.vdev.raidz_impl sysctl cross-platform
* FreeBSD: Add setting of the VFCF_FILEREV flag
* zinject: add "probe" device injection type
* zinject: make iotype extendable
* ZTS: remove get_arcstat
* ZTS: update existing kstat users to new helper
* ZTS: reimplement kstat helper function
* Fix several typos in the man pages
* zfs-destroy.8: Fix minor formatting typo
* Update RELEASES.md LTS release to 2.2 #16945
* style: remove unnecessary spaces in sa.h
* Makefile.in: pass ARCH for modules_install as well
* zinject: count matches and injections for each handler
* FreeBSD: Use ashift in vdev_check_boot_reserve()
* ZTS: remove empty zpool_add--allow-ashift-mismatch test

[John Cabaj (john-cabaj)]

Ran ubuntu_zfs_smoke_test, ubuntu_zfs_fstest, and ubuntu_zfs_stress from autotest-client-tests (https://git.launchpad.net/~canonical-kernel-team/+git/autotest-client-tests) and encountered no errors.

[John Cabaj (john-cabaj)]

zfs-linux 2.3.0-2ubuntu1 available at https://launchpad.net/~john-cabaj/+archive/ubuntu/zfs-linux/

[Graham Inggs (ginggs)]

Hi John, a quick question, at:

https://github.com/openzfs/zfs/releases/tag/zfs-2.3.1

I see:

Linux: compatible with 4.18 - 6.13 kernels

What is the plan for supporting the 6.14 kernel, expected in plucky?

Is upgrading to zfs-linux 2.3.0 a pre-requisite for that?

[John Cabaj (john-cabaj)]

Hi Graham, thanks for having a look. The present track for zfs-linux on Plucky is the 2.2.7 release:

https://github.com/openzfs/zfs/releases/tag/zfs-2.2.7

Its stated support is for 4.18 - 6.12 kernels.

The 6.14 compat patches (https://github.com/openzfs/zfs/pull/17026/commits) have been applied to zfs 2.2.7 previously, and are included in this 2.3.0 release as well. So this release is not a pre-requisite for 6.14 support, as that's already in the previous zfs-linux release. But it will maintain 6.14 support just the same, along with the features stated in the attached changelog.

[Graham Inggs (ginggs)]

Thanks. There is always a risk that adding new features brings new bugs, but let's get this in early, so it can get some testing during the beta. FFe approved, please go ahead.

[Harshal Prakash Patankar (pharshalp)]

OpenZFS 2.3.1 https://github.com/openzfs/zfs/releases/tag/zfs-2.3.1 already has the 6.14 compatibility patches included (https://github.com/openzfs/zfs/pull/17114). The META file doesn't show 6.14 since 6.14 had not been released before OpenZFS 2.3.1 was released.

If at all Ubuntu decides to upgrade to the 2.3 branch, it would make sense to use 2.3.1 instead of 2.3.0.

[Graham Inggs (ginggs)]

To be clear, going directly to 2.3.1 under this FFe would be fine.

[John Cabaj (john-cabaj)]

2.3.1 just came out a couple of days ago and is still in Debian unstable. I was a bit more comfortable taking 2.3.0 instead as it’s been in Debian for a bit longer.

[John Cabaj (john-cabaj)]

I'll submit updated attachments for 2.3.1, test it out, and push to the same PPA if all looks good. Then I'll sort out a sponsor.

[John Cabaj (john-cabaj)]

Ran ubuntu_zfs_smoke_test, ubuntu_zfs_fstest, and ubuntu_zfs_stress from autotest-client-tests (https://git.launchpad.net/~canonical-kernel-team/+git/autotest-client-tests) and encountered no errors.

[John Cabaj (john-cabaj)]

zfs-linux 2.3.1-1ubuntu1 available at https://launchpad.net/~john-cabaj/+archive/ubuntu/zfs-linux/

[Launchpad Janitor (janitor)]

This bug was fixed in the package zfs-linux - 2.3.1-1ubuntu1

---------------
zfs-linux (2.3.1-1ubuntu1) plucky; urgency=medium

  * Merge from Debian (LP: #2101893)
  * debian/control:
    - drop dependencies on "zfs-modules | zfs-dkms" such that all
      packages can be installed in containers, on hosts that have zfs module
      loaded
  * debian/patches:
    - apply Ubuntu patchset to integrate with zsys
      - adding
        - ubuntu/0002-Revert-etc-systemd-zfs-mount-generator-rewrite-in-C.patch
        - ubuntu/4000-zsys-support.patch
      - removing
        - ubuntu/0001-Revert-etc-systemd-zfs-mount-generator-output-tweaks.patch
        - ubuntu/0001-Revert-etc-systemd-zfs-mount-generator-serialise-han.patch
        - ubuntu/0002-Revert-etc-systemd-zfs-mount-generator-output-tweaks.patch
        - ubuntu/0003-Revert-etc-systemd-zfs-mount-generator-rewrite-in-C.patch
    - ubuntu/0001-Revert-Revert-systemd-Use-non-absolute-paths-in-Exec.patch
    - fixup-abi.patch
    - ubuntu/4510-silently-ignore-modprobe-failure.patch
    - enable 6.14 support via --enable-linux-experimental flag
      - ubuntu/0003-enable-linux-experimental.patch
    - ubuntu/0004-revert-zinject-count-matches-and-injections-for-each-handler.patch
  * debian/rules:
    - enforce abi check on Ubuntu amd64
    - allow kernel version not matching META
  * debian/tests:
    - draid tests fail upstream, so marking failures as expected
      to fail
  * debian/tests/control:
    - reduce testing to smoketest only
    - Ubuntu Kernel regression testing covers zfs testsuite
    - Drop depends on linux-headers-*.

 -- John Cabaj <email address hidden> Thu, 13 Mar 2025 13:18:06 -0500