systemd/248.3-1ubuntu8.2 ADT test failure with linux/5.13.0-29.32

[Stefan Bader]

This is a scripted bug report about ADT failures while running systemd tests for linux/5.13.0-29.32 on impish. Whether this is caused by the dep8 tests of the tested source or the kernel has yet to be determined.

Testing failed on:
    amd64: https://autopkgtest.ubuntu.com/results/autopkgtest-impish/impish/amd64/s/systemd/20220204_114518_6b600@/log.gz
    arm64: https://autopkgtest.ubuntu.com/results/autopkgtest-impish/impish/arm64/s/systemd/20220201_135548_7f169@/log.gz
    ppc64el: https://autopkgtest.ubuntu.com/results/autopkgtest-impish/impish/ppc64el/s/systemd/20220201_110103_b02e4@/log.gz

[Stefan Bader (smb)]

3845c082bc54 block: avoid to quiesce queue in elevator_init_mq
59514c007c4a blk-mq: cancel blk-mq dispatch work in both blk_cleanup_queue and disk_release()

The 59514c007c4a change is a pre-requisite for 3845c082bc54. Both were part of the 2022.01.05 stable update (bug 1956508). The problem is likely that in 5.13 we still have a call to blk_free_devt() in disk_release(). This was after a rework moved into fs/block_dev.c:bdev_free_inode() by:

commit 9451aa0aacaf7ea13d1acfd5de8b63a6e0b24fac
Author: Christoph Hellwig <email address hidden>
Date: Mon Aug 16 14:26:13 2021 +0200

    block: free the extended dev_t minor later

[Kleber Sacilotto de Souza (kleber-souza)]

For the record, this is the stack trace produced by the 'storage' systemd testcase:

Feb 4 12:47:07 autopkgtest kernel: [ 119.567510] BUG: kernel NULL pointer dereference, address: 0000000000000030
Feb 4 12:47:07 autopkgtest kernel: [ 119.568255] #PF: supervisor read access in kernel mode
Feb 4 12:47:07 autopkgtest kernel: [ 119.568712] #PF: error_code(0x0000) - not-present page
Feb 4 12:47:07 autopkgtest kernel: [ 119.569243] PGD 800000000ab43067 P4D 800000000ab43067 PUD b07c067 PMD 0
Feb 4 12:47:07 autopkgtest kernel: [ 119.569880] Oops: 0000 [#1] SMP PTI
Feb 4 12:47:07 autopkgtest kernel: [ 119.570195] CPU: 0 PID: 787 Comm: python3 Not tainted 5.13.0-29-generic #32-Ubuntu
Feb 4 12:47:07 autopkgtest kernel: [ 119.570940] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.14.0-2 04/01/2014
Feb 4 12:47:07 autopkgtest kernel: [ 119.571732] RIP: 0010:blk_mq_cancel_work_sync+0x5/0x60
Feb 4 12:47:07 autopkgtest kernel: [ 119.572232] Code: 4c 89 f7 e8 8d 13 00 00 e9 4b ff ff ff 48 8b 45 d0 49 89 85 e8 00 00 00 31 c0 eb a0 b8 ea ff ff ff eb c1 66 90 0f 1f 44 00 00 <48> 83 7f 30 00 74 45 55 48 89 e5 41 54 49 89 fc 48 8d bf f8 04 00
Feb 4 12:47:07 autopkgtest kernel: [ 119.573881] RSP: 0018:ffffa78a40dd7960 EFLAGS: 00010246
Feb 4 12:47:07 autopkgtest kernel: [ 119.574339] RAX: 0000000000000000 RBX: ffff9b3ec7df7b00 RCX: 0000000000000286
Feb 4 12:47:07 autopkgtest kernel: [ 119.574938] RDX: ffffa78a40dd7920 RSI: ffffffff875ac156 RDI: 0000000000000000
Feb 4 12:47:07 autopkgtest kernel: [ 119.575545] RBP: ffffa78a40dd7978 R08: ffff9b3ecbd347c0 R09: 0000000000000000
Feb 4 12:47:07 autopkgtest kernel: [ 119.576147] R10: 0000000000000000 R11: ffff9b3ec229bb90 R12: ffff9b3ecbd34520
Feb 4 12:47:07 autopkgtest kernel: [ 119.576756] R13: 0000000000000000 R14: 0000000000000000 R15: ffff9b3ec82d21d8
Feb 4 12:47:07 autopkgtest kernel: [ 119.577350] FS: 00007fd4d6a39c00(0000) GS:ffff9b3f3dc00000(0000) knlGS:0000000000000000
Feb 4 12:47:07 autopkgtest kernel: [ 119.578040] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Feb 4 12:47:07 autopkgtest kernel: [ 119.578537] CR2: 0000000000000030 CR3: 000000000b072000 CR4: 00000000000006f0
Feb 4 12:47:07 autopkgtest kernel: [ 119.579168] Call Trace:
Feb 4 12:47:07 autopkgtest kernel: [ 119.579399] <TASK>
Feb 4 12:47:07 autopkgtest kernel: [ 119.579591] ? disk_release+0x24/0xa0
Feb 4 12:47:07 autopkgtest kernel: [ 119.579939] device_release+0x3b/0xa0
Feb 4 12:47:07 autopkgtest kernel: [ 119.580268] kobject_cleanup+0x44/0x150
Feb 4 12:47:07 autopkgtest kernel: [ 119.580617] kobject_put+0x53/0x70
Feb 4 12:47:07 autopkgtest kernel: [ 119.580924] put_device+0x13/0x20
Feb 4 12:47:07 autopkgtest kernel: [ 119.581288] put_disk+0x1b/0x20
Feb 4 12:47:07 autopkgtest kernel: [ 119.581653] sg_device_destroy+0x54/0x90
Feb 4 12:47:07 autopkgtest kernel: [ 119.582003] sg_remove_device+0x128/0x170
Feb 4 12:47:07 autopkgtest kernel: [ 119.582354] device_del+0x138/0x3e0
Feb 4 12:47:07 autopkgtest kernel: [ 119.582659] device_unregister+0x1b/0x60
Feb 4 12:47:07 autopkgtest kernel: [ 119.583002] __scsi_remove_device+0x110/0x150
Feb 4 12:47:07 autopkgtest...

[Ubuntu Kernel Bot (ubuntu-kernel-bot)]

This bug is awaiting verification that the linux/5.13.0-30.33 kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed-impish' to 'verification-done-impish'. If the problem still exists, change the tag 'verification-needed-impish' to 'verification-failed-impish'.

If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed.

See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you!

[Kleber Sacilotto de Souza (kleber-souza)]

Confirmed that systemd storage testacase is now successful with impish:linux 5.13.0-30.33:

amd64 - https://autopkgtest.ubuntu.com/results/autopkgtest-impish/impish/amd64/s/systemd/20220207_183233_91879@/log.gz
arm64 - https://autopkgtest.ubuntu.com/results/autopkgtest-impish/impish/arm64/s/systemd/20220207_164846_df7a7@/log.gz
ppc64el - https://autopkgtest.ubuntu.com/results/autopkgtest-impish/impish/ppc64el/s/systemd/20220207_155813_b0af1@/log.gz

[Łukasz Zemczak (sil2100)]

The verification of the Stable Release Update for linux-hwe-5.13 has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Launchpad Janitor (janitor)]

This bug was fixed in the package linux - 5.13.0-30.33

---------------
linux (5.13.0-30.33) impish; urgency=medium

  * impish/linux: 5.13.0-30.33 -proposed tracker (LP: #1960055)

  * systemd/248.3-1ubuntu8.2 ADT test failure with linux/5.13.0-29.32
    (LP: #1960034)
    - Revert "block: avoid to quiesce queue in elevator_init_mq"
    - Revert "blk-mq: cancel blk-mq dispatch work in both blk_cleanup_queue and
      disk_release()"

linux (5.13.0-29.32) impish; urgency=medium

  * impish/linux: 5.13.0-29.32 -proposed tracker (LP: #1959238)

  * Packaging resync (LP: #1786013)
    - debian/dkms-versions -- update from kernel-versions (main/2022.01.31)

  * CVE-2022-22942
    - SAUCE: drm/vmwgfx: Fix stale file descriptors on failed usercopy

  * CVE-2022-0330
    - drm/i915: Flush TLBs before releasing backing store

  * Impish update: upstream stable patchset 2022-01-05 (LP: #1956508)
    - ACPI: Get acpi_device's parent from the parent field
    - USB: serial: option: add Telit LE910S1 0x9200 composition
    - USB: serial: option: add Fibocom FM101-GL variants
    - usb: dwc2: gadget: Fix ISOC flow for elapsed frames
    - usb: dwc2: hcd_queue: Fix use of floating point literal
    - usb: dwc3: gadget: Ignore NoStream after End Transfer
    - usb: dwc3: gadget: Check for L1/L2/U3 for Start Transfer
    - usb: dwc3: gadget: Fix null pointer exception
    - net: nexthop: fix null pointer dereference when IPv6 is not enabled
    - usb: chipidea: ci_hdrc_imx: fix potential error pointer dereference in probe
    - usb: typec: fusb302: Fix masking of comparator and bc_lvl interrupts
    - usb: hub: Fix usb enumeration issue due to address0 race
    - usb: hub: Fix locking issues with address0_mutex
    - binder: fix test regression due to sender_euid change
    - ALSA: ctxfi: Fix out-of-range access
    - ALSA: hda/realtek: Add quirk for ASRock NUC Box 1100
    - ALSA: hda/realtek: Fix LED on HP ProBook 435 G7
    - media: cec: copy sequence field for the reply
    - Revert "parisc: Fix backtrace to always include init funtion names"
    - HID: wacom: Use "Confidence" flag to prevent reporting invalid contacts
    - staging/fbtft: Fix backlight
    - staging: greybus: Add missing rwsem around snd_ctl_remove() calls
    - staging: rtl8192e: Fix use after free in _rtl92e_pci_disconnect()
    - fuse: release pipe buf after last use
    - xen: don't continue xenstore initialization in case of errors
    - xen: detect uninitialized xenbus in xenbus_init
    - KVM: PPC: Book3S HV: Prevent POWER7/8 TLB flush flushing SLB
    - tracing/uprobe: Fix uprobe_perf_open probes iteration
    - tracing: Fix pid filtering when triggers are attached
    - mmc: sdhci-esdhc-imx: disable CMDQ support
    - mmc: sdhci: Fix ADMA for PAGE_SIZE >= 64KiB
    - mdio: aspeed: Fix "Link is Down" issue
    - powerpc/32: Fix hardlockup on vmap stack overflow
    - PCI: aardvark: Deduplicate code in advk_pcie_rd_conf()
    - PCI: aardvark: Implement re-issuing config requests on CRS response
    - PCI: aardvark: Simplify initialization of rootcap on virtual bridge
    - PCI: aardvark: Fix link training
    - proc/vmcore: fix clearing user buffer by properly using clear_user()
...

[Ubuntu Kernel Bot (ubuntu-kernel-bot)]

This bug is awaiting verification that the linux-oracle-5.13/5.13.0-1019.23~20.04.2 kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed-focal' to 'verification-done-focal'. If the problem still exists, change the tag 'verification-needed-focal' to 'verification-failed-focal'.

If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed.

See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you!

[Stefan Bader (smb)]

From ADT testing: https://autopkgtest.ubuntu.com/results/autopkgtest-focal/focal/arm64/s/systemd/20220310_155736_6a08c@/log.gz

This was previously failing the storage subtest.