Azure: Jammy fio test causes panic

Bug #1996806 reported by Tim Gardner
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
linux-azure (Ubuntu)
Fix Released
Undecided
Unassigned
Jammy
Fix Released
High
Tim Gardner

Bug Description

SRU Justification

[Impact]

During Storage performance tests, 16 disks are attached and fio is ran. The fio command does not consistently result in a kernel panic, but the test runs fio enough times to result in consistent kernel panic. The panic is most often observed on instances with many cores and disks.

[Test Case]

Using an instance with 96 cores and 16 disks:

sudo fio --ioengine=libaio --bs=1024K --filename=/dev/sda:/dev/sdb:/dev/sdc:/dev/sdd:/dev/sde:/dev/sdf:/dev/sdg:/dev/sdh:/dev/sdi:/dev/sdj:/dev/sdk:/dev/sdl:/dev/sdm:/dev/sdn:/dev/sdo:/dev/sdp --readwrite=read --runtime=120 --iodepth=32 --numjob=96 --name=iteration23 --direct=1 --size=8192M --group_reporting --overwrite=1

Test results from Microsoft and myself are positive. No panics were observed.

[Regression Potential]

The fix is an upstream patch from 5.17, commit 0bd2fbee9d0b7f801a9c0264d90b1e0d8053f395 ('scsi: storvsc: Fix unsigned comparison to zero'). Regression potential is low.

[Other Info]

SF: #00346757

Tim Gardner (timg-tpi)
affects: linux (Ubuntu) → linux-azure (Ubuntu)
Changed in linux-azure (Ubuntu):
assignee: nobody → Tim Gardner (timg-tpi)
importance: Undecided → High
status: New → In Progress
Changed in linux-azure (Ubuntu Jammy):
assignee: nobody → Tim Gardner (timg-tpi)
importance: Undecided → High
status: New → In Progress
Changed in linux-azure (Ubuntu):
status: In Progress → Fix Released
assignee: Tim Gardner (timg-tpi) → nobody
importance: High → Undecided
Revision history for this message
Tim Gardner (timg-tpi) wrote :
Tim Gardner (timg-tpi)
description: updated
Tim Gardner (timg-tpi)
Changed in linux-azure (Ubuntu Jammy):
status: In Progress → Fix Released
Tim Gardner (timg-tpi)
tags: added: verification-done-jammy
tags: added: verification-done-focal
Revision history for this message
Ubuntu Kernel Bot (ubuntu-kernel-bot) wrote :

This bug is awaiting verification that the linux-azure/5.15.0-1030.37 kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed-jammy' to 'verification-done-jammy'. If the problem still exists, change the tag 'verification-needed-jammy' to 'verification-failed-jammy'.

If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed.

See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you!

tags: added: kernel-spammed-jammy-linux-azure verification-needed-jammy
removed: verification-done-jammy
Revision history for this message
Tim Gardner (timg-tpi) wrote :

Microsoft tested and accepted. Marking verification-done-jammy

tags: added: verification-done-jammy
removed: verification-needed-jammy
Revision history for this message
Ubuntu Kernel Bot (ubuntu-kernel-bot) wrote :

This bug is awaiting verification that the linux-azure-5.15/5.15.0-1033.40~20.04.1 kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed-focal' to 'verification-done-focal'. If the problem still exists, change the tag 'verification-needed-focal' to 'verification-failed-focal'.

If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed.

See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you!

tags: added: kernel-spammed-focal-linux-azure-5.15 verification-needed-focal
removed: verification-done-focal
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.