segfaults, dpkg script failures

[Seth Arnold]

Hello, I had some apt install failures due to zfs segfaults during zfs postinst scripts:

sarnold@millbarge:/var/lib$ sudo apt install -f
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
  ebtables libbrlapi0.6 libenchant1c2a libgspell-1-1 libxen-4.9 libxenstore3.0 linux-headers-5.3.0-29 linux-headers-5.3.0-29-generic linux-image-5.3.0-29-generic
  linux-modules-5.3.0-29-generic linux-modules-extra-5.3.0-29-generic linux-tools-5.3.0-29 linux-tools-5.3.0-29-generic python3-asn1crypto
Use 'sudo apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
3 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
Setting up zfsutils-linux (0.8.3-1ubuntu3) ...
zfs-import-scan.service is a disabled or a static unit, not starting it.
zfs-import-scan.service is a disabled or a static unit, not starting it.
Job for zfs-mount.service failed because the control process exited with error code.
See "systemctl status zfs-mount.service" and "journalctl -xe" for details.
invoke-rc.d: initscript zfs-mount, action "start" failed.
● zfs-mount.service - Mount ZFS filesystems
     Loaded: loaded (/lib/systemd/system/zfs-mount.service; enabled; vendor preset: enabled)
     Active: failed (Result: exit-code) since Tue 2020-02-11 00:46:19 UTC; 5ms ago
       Docs: man:zfs(8)
    Process: 2770075 ExecStart=/sbin/zfs mount -a (code=exited, status=1/FAILURE)
   Main PID: 2770075 (code=exited, status=1/FAILURE)

Feb 11 00:46:19 millbarge systemd[1]: Starting Mount ZFS filesystems...
Feb 11 00:46:19 millbarge zfs[2770075]: cannot mount '/var/lib/AccountsService':
Feb 11 00:46:19 millbarge zfs[2770075]: cannot mount '/var/lib/AccountsService': mount failed
Feb 11 00:46:19 millbarge systemd[1]: zfs-mount.service: Main process exited, code=exited, status=1/FAILURE
Feb 11 00:46:19 millbarge systemd[1]: zfs-mount.service: Failed with result 'exit-code'.
Feb 11 00:46:19 millbarge systemd[1]: Failed to start Mount ZFS filesystems.
dpkg: error processing package zfsutils-linux (--configure):
 installed zfsutils-linux package post-installation script subprocess returned error exit status 1
No apport report written because the error message indicates its a followup error from a previous failure.
                                                                                                          dpkg: dependency problems prevent configuration of zfs-initramfs:
 zfs-initramfs depends on zfsutils-linux (>= 0.8.3-1ubuntu3); however:
  Package zfsutils-linux is not configured yet.

dpkg: error processing package zfs-initramfs (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of zfs-zed:
 zfs-zed depends on zfsutils-linux (>= 0.8.3-1ubuntu3); however:
  Package zfsutils-linux is not configured yet.

dpkg: error processing package zfs-zed (--configure):
 dependency problems - leaving unconfigured
No apport report written because the error message indicates its a followup error from a previous failure.
                                                                                                          Errors were encountered while processing:
 zfsutils-linux
 zfs-initramfs
 zfs-zed
E: Sub-process /usr/bin/dpkg returned an error code (1)
sarnold@millbarge:/var/lib$ sudo dmesg | tail -30
[345819.461404] pci_bus 0000:06: Allocating resources
[345819.461422] pcieport 0000:06:01.0: bridge window [mem 0x00100000-0x000fffff] to [bus 08-3a] add_size 400000 add_align 100000
[345819.461424] pcieport 0000:06:04.0: bridge window [mem 0x00100000-0x000fffff] to [bus 3c-6f] add_size 400000 add_align 100000
[345819.461428] pcieport 0000:06:01.0: BAR 14: no space for [mem size 0x00400000]
[345819.461428] pcieport 0000:06:01.0: BAR 14: failed to assign [mem size 0x00400000]
[345819.461429] pcieport 0000:06:04.0: BAR 14: no space for [mem size 0x00400000]
[345819.461430] pcieport 0000:06:04.0: BAR 14: failed to assign [mem size 0x00400000]
[345819.461431] pcieport 0000:06:04.0: BAR 14: no space for [mem size 0x00400000]
[345819.461432] pcieport 0000:06:04.0: BAR 14: failed to assign [mem size 0x00400000]
[345819.461432] pcieport 0000:06:01.0: BAR 14: no space for [mem size 0x00400000]
[345819.461433] pcieport 0000:06:01.0: BAR 14: failed to assign [mem size 0x00400000]
[345833.001361] show_signal_msg: 34 callbacks suppressed
[345833.001363] zfs[2653666]: segfault at 0 ip 00007f2ff09bbd63 sp 00007f2fec900430 error 4 in libc-2.30.so[7f2ff094d000+178000]
[345833.001369] Code: 48 29 f2 ff 55 70 48 85 c0 7e 4c 48 8b 93 90 00 00 00 48 01 43 10 48 83 fa ff 74 0a 48 01 d0 48 89 83 90 00 00 00 48 8b 43 08 <0f> b6 00 48 83 c4 18 5b 5d 41 5c 41 5d 41 5e 41 5f c3 0f 1f 00 0f
[345833.001370] zfs[2653667]: segfault at 0 ip 00007f2ff0aafa20 sp 00007f2fcfff7498 error 4 in libc-2.30.so[7f2ff094d000+178000]
[345833.001373] Code: 77 c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 48 85 d2 0f 84 56 02 00 00 89 f9 c5 f9 6e c6 c4 e2 7d 78 c0 83 e1 3f 83 f9 20 77 40 <c5> fd 74 0f c5 fd d7 c1 85 c0 0f 85 c0 01 00 00 48 83 ea 20 0f 86
[345834.260172] zfs[2653843]: segfault at 0 ip 00007faf49b07d63 sp 00007faf41ff3430 error 4
[345834.260178] zfs[2653846]: segfault at 0 ip 00007faf49bfba20 sp 00007faf2bff7498 error 4
[345834.260182] in libc-2.30.so[7faf49a99000+178000]
[345834.260190] Code: 48 29 f2 ff 55 70 48 85 c0 7e 4c 48 8b 93 90 00 00 00 48 01 43 10 48 83 fa ff 74 0a 48 01 d0 48 89 83 90 00 00 00 48 8b 43 08 <0f> b6 00 48 83 c4 18 5b 5d 41 5c 41 5d 41 5e 41 5f c3 0f 1f 00 0f
[345834.260193] in libc-2.30.so[7faf49a99000+178000]
[345834.260200] Code: 77 c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 48 85 d2 0f 84 56 02 00 00 89 f9 c5 f9 6e c6 c4 e2 7d 78 c0 83 e1 3f 83 f9 20 77 40 <c5> fd 74 0f c5 fd d7 c1 85 c0 0f 85 c0 01 00 00 48 83 ea 20 0f 86
[359810.082263] Adding 2097148k swap on /dev/zd0. Priority:-2 extents:1 across:2097148k SSDscFS
[359825.530931] traps: zfs[2766389] general protection fault ip:7f9b7ef9ea18 sp:7f9b7d6e3e30 error:0 in libc-2.30.so[7f9b7ef26000+178000]
[359845.482129] zfs[2767293]: segfault at 0 ip 00007f9130d9ad63 sp 00007f912ece3430 error 4 in libc-2.30.so[7f9130d2c000+178000]
[359845.482135] Code: 48 29 f2 ff 55 70 48 85 c0 7e 4c 48 8b 93 90 00 00 00 48 01 43 10 48 83 fa ff 74 0a 48 01 d0 48 89 83 90 00 00 00 48 8b 43 08 <0f> b6 00 48 83 c4 18 5b 5d 41 5c 41 5d 41 5e 41 5f c3 0f 1f 00 0f
[359845.482137] zfs[2767310]: segfault at 0 ip 00007f9130e8ea20 sp 00007f911d7f2498 error 4 in libc-2.30.so[7f9130d2c000+178000]
[359845.482141] Code: 77 c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 48 85 d2 0f 84 56 02 00 00 89 f9 c5 f9 6e c6 c4 e2 7d 78 c0 83 e1 3f 83 f9 20 77 40 <c5> fd 74 0f c5 fd d7 c1 85 c0 0f 85 c0 01 00 00 48 83 ea 20 0f 86
[360118.011629] zfs[2769954]: segfault at 0 ip 00007f4134b29a20 sp 00007f413217d498 error 4 in libc-2.30.so[7f41349c7000+178000]
[360118.011635] Code: 77 c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 48 85 d2 0f 84 56 02 00 00 89 f9 c5 f9 6e c6 c4 e2 7d 78 c0 83 e1 3f 83 f9 20 77 40 <c5> fd 74 0f c5 fd d7 c1 85 c0 0f 85 c0 01 00 00 48 83 ea 20 0f 86

Thanks

ProblemType: Bug
DistroRelease: Ubuntu 20.04
Package: zfsutils-linux 0.8.3-1ubuntu3
ProcVersionSignature: Ubuntu 5.4.0-12.15-generic 5.4.8
Uname: Linux 5.4.0-12-generic x86_64
NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
ApportVersion: 2.20.11-0ubuntu16
Architecture: amd64
Date: Tue Feb 11 00:47:02 2020
ProcEnviron:
 TERM=rxvt-unicode-256color
 PATH=(custom, no user)
 XDG_RUNTIME_DIR=<set>
 LANG=en_US.UTF-8
 SHELL=/bin/bash
SourcePackage: zfs-linux
UpgradeStatus: Upgraded to focal on 2020-01-24 (17 days ago)
modified.conffile..etc.sudoers.d.zfs: [inaccessible: [Errno 13] Permission denied: '/etc/sudoers.d/zfs']

[Seth Arnold (seth-arnold)]

I didn't know that two of my datasets were not mounted:

$ zfs list -oname,canmount,mounted,mountpoint | grep 'on no'
rpool/var/cache on no /var/cache
rpool/var/lib/AccountsService on no /var/lib/AccountsService

Thanks

[Colin Ian King (colin-king)]

I'm not able to reproduce this issue. Is it still a problem?

[Seth Arnold (seth-arnold)]

Hello Colin, I'm not sure:

- I'm now on 5.4.0-17-generic to try to debug a different issue

- I believe I've fixed all the datasets that were failing to mount at boot time due to unexpected files or directories in the mountpoints

- I don't know why zfs was segfaulting in the first place: it was my guess that it was handling the unmountable datasets very poorly, but that's a big guess. (A simple test of this now doesn't segfault.)

I'm not confident that this been fixed; however, it's probably worth ignoring this issue for the time being. (Bug 1861359 feels far more important than this one, for example.)

Thanks

[Colin Ian King (colin-king)]

I've not been able to reproduce this bug, nor seen it occur anywhere else. This was reported on a 5.3 Eoan system, so this is EOL. I'm going to close this bug. If it occurs again please feel free to re-open it.