scsi_eh_* process using idle CPU after upgrade to kernel 6.5
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
linux |
Confirmed
|
High
|
|||
linux (Ubuntu) |
Confirmed
|
Undecided
|
Unassigned | ||
linux-aws-6.5 (Ubuntu) |
Confirmed
|
Undecided
|
Unassigned | ||
linux-hwe-6.5 (Ubuntu) |
Confirmed
|
Undecided
|
Unassigned | ||
linux-meta-hwe-6.5 (Ubuntu) |
Confirmed
|
Undecided
|
Unassigned | ||
linux-signed-hwe-6.5 (Ubuntu) |
Confirmed
|
Undecided
|
Unassigned |
Bug Description
Possibly related to https:/
Getting alerts from monitoring tools about high average CPU usage. Machine reporting the following:
root@server:~# uptime
17:04:34 up 14 days, 6:33, 2 users, load average: 15.66, 15.88, 15.94
root@server:~# top -d 1
top - 17:04:49 up 14 days, 6:33, 2 users, load average: 15.59, 15.85, 15.93
Tasks: 223 total, 1 running, 222 sleeping, 0 stopped, 0 zombie
%Cpu(s): 0.7 us, 1.4 sy, 0.0 ni, 49.3 id, 48.6 wa, 0.0 hi, 0.0 si, 0.0 st
MiB Mem : 7896.6 total, 1772.6 free, 1163.9 used, 4960.0 buff/cache
MiB Swap: 2048.0 total, 1784.6 free, 263.4 used. 6431.6avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
88 root 20 0 0 0 0 D 55.4 0.0 11275:46 scsi_eh_1
root@server:~# lsb_release -rd
Description: Ubuntu 22.04.3 LTS
Release: 22.04
root@server:~# apt-cache policy linux-image-
linux-image-
Installed: 6.5.0.14.14~22.04.6
Candidate: 6.5.0.14.14~22.04.7
Version table:
6.
500 http://
500 http://
*** 6.5.0.14.14~22.04.6 100
100 /var/lib/
5.15.0.25.27 500
500 http://
ProblemType: Bug
DistroRelease: Ubuntu 22.04
Package: linux-image-
ProcVersionSign
Uname: Linux 6.5.0-14-generic x86_64
ApportVersion: 2.20.11-0ubuntu82.5
Architecture: amd64
CasperMD5CheckR
Date: Wed Jan 10 17:02:50 2024
ProcEnviron:
TERM=xterm-
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
SourcePackage: linux-signed-
UpgradeStatus: Upgraded to jammy on 2023-05-02 (253 days ago)
---
ProblemType: Bug
ApportVersion: 2.20.11-0ubuntu82.5
Architecture: amd64
CasperMD5CheckR
DistroRelease: Ubuntu 22.04
Package: linux-image-
PackageArchitec
ProcEnviron:
TERM=xterm-
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcVersionSign
Tags: jammy third-party-
Uname: Linux 6.5.0-14-generic x86_64
UpgradeStatus: Upgraded to jammy on 2023-05-02 (253 days ago)
UserGroups: N/A
_MarkForUpload: True
---
ProblemType: Bug
AlsaDevices:
total 0
crw-rw---- 1 root audio 116, 1 Dec 27 10:31 seq
crw-rw---- 1 root audio 116, 33 Dec 27 10:31 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.20.11-0ubuntu82.5
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
CRDA: N/A
CasperMD5CheckR
DistroRelease: Ubuntu 22.04
HibernationDevice: #RESUME=
IwConfig:
lo no wireless extensions.
eth0 no wireless extensions.
Lsusb: Error: command ['lsusb'] failed with exit code 1:
Lsusb-t:
Lsusb-v: Error: command ['lsusb', '-v'] failed with exit code 1:
MachineType: VMware, Inc. VMware Virtual Platform
Package: linux (not installed)
PciMultimedia:
ProcEnviron:
TERM=xterm-
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcFB: 0 vmwgfxdrmfb
ProcKernelCmdLine: BOOT_IMAGE=
ProcVersionSign
RelatedPackageV
linux-
linux-
linux-firmware 20220329.
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
Tags: jammy
Uname: Linux 6.5.0-14-generic x86_64
UpgradeStatus: Upgraded to jammy on 2023-05-02 (253 days ago)
UserGroups: N/A
_MarkForUpload: True
dmi.bios.date: 11/12/2020
dmi.bios.release: 4.6
dmi.bios.vendor: Phoenix Technologies LTD
dmi.bios.version: 6.00
dmi.board.name: 440BX Desktop Reference Platform
dmi.board.vendor: Intel Corporation
dmi.board.version: None
dmi.chassis.
dmi.chassis.type: 1
dmi.chassis.vendor: No Enclosure
dmi.chassis.
dmi.ec.
dmi.modalias: dmi:bvnPhoenixT
dmi.product.name: VMware Virtual Platform
dmi.product.
dmi.sys.vendor: VMware, Inc.
---
ProblemType: Bug
ApportVersion: 2.20.11-0ubuntu82.5
Architecture: amd64
CasperMD5CheckR
DistroRelease: Ubuntu 22.04
Package: linux-image-
PackageArchitec
ProcEnviron:
TERM=xterm-
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcVersionSign
Tags: jammy third-party-
Uname: Linux 6.5.0-17-generic x86_64
UnreportableReason: This does not seem to be an official Ubuntu package. Please retry after updating the indexes of available packages, if that does not work then remove related third party packages and try again.
UpgradeStatus: Upgraded to jammy on 2023-05-02 (266 days ago)
UserGroups: N/A
_MarkForUpload: True
---
ProblemType: Bug
ApportVersion: 2.20.11-0ubuntu82.5
Architecture: amd64
CasperMD5CheckR
DistroRelease: Ubuntu 22.04
Package: linux-image-
PackageArchitec
ProcEnviron:
TERM=xterm-
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcVersionSign
Tags: jammy third-party-
Uname: Linux 6.5.0-17-generic x86_64
UnreportableReason: This does not seem to be an official Ubuntu package. Please retry after updating the indexes of available packages, if that does not work then remove related third party packages and try again.
UpgradeStatus: Upgraded to jammy on 2023-05-02 (266 days ago)
UserGroups: N/A
_MarkForUpload: True
Changed in kernel: | |
importance: | Unknown → High |
status: | Unknown → Confirmed |
Overview:
Several users report that after upgrading from 6.4.12 to 6.5 the process scsi_eh_1 will constantly consume >10% CPU resources. This happens most often in VMs.
Steps to Reproduce:
- Create a VM (e.g. VMware Fusion)
- Create an SCSI disk
- Connect a virtual CD ROM (IDE)
- Boot a 6.4.12 kernel
- Boot a 6.5 kernel
Actual Results:
- no issues for the 6.4.12 kernel
- scsi_eh consumes too much CPU with the 6.5 kernel
Expected Results:
scsi_eh should not consume significant resources.
Build Date & Hardware:
Linux arch 6.5.2-arch1-1 #1 SMP PREEMPT_DYNAMIC Wed, 06 Sep 2023 21:01:01 +0000 x86_64 GNU/Linux
inside a VMware Fusion VM
Additional Builds and Platforms:
Other users were able to reproduce the error on bare metal hardware.
Additional Information:
More details can be found in this thread: /bbs.archlinux. org/viewtopic. php?id= 288723
https:/
The users loqs and leonshaw helped to narrow it down to this commit:
https:/ /git.kernel. org/pub/ scm/linux/ kernel/ git/torvalds/ linux.git/ commit/ ?id=624885209f3 1eb9985bf51abe2 04ecbffe2fdeea
good: 6.4.0-rc1- 1-00007- g152e52fb6ff1 1-00008- g624885209f31
bad: 6.4.0-rc1-