random CSR_RESET errors in iwlwifi appear under kinetic

Bug #1992194 reported by Jack Howarth
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
linux (Ubuntu)
Confirmed
Undecided
Unassigned
Kinetic
Won't Fix
Undecided
Unassigned

Bug Description

A Gigabyte GC-WBAX210 WIFI 6E Aorus PCI card worked fine under Ubuntu 22.04 LTS but under Ubuntu 22.10 fails to initialize properly half of the time. When this occurs, the kern.log shows...

Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581395] iwlwifi 0000:05:00.0: CSR_RESET = 0x10
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581410] iwlwifi 0000:05:00.0: Host monitor block 0x0 vector 0x0
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581427] iwlwifi 0000:05:00.0: value [iter 0]: 0x3f7d8830
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581443] iwlwifi 0000:05:00.0: value [iter 1]: 0x3f7d8830
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581459] iwlwifi 0000:05:00.0: value [iter 2]: 0x3f7d8430
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581474] iwlwifi 0000:05:00.0: value [iter 3]: 0x3f7d8830
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581490] iwlwifi 0000:05:00.0: value [iter 4]: 0x3f7d8430
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581505] iwlwifi 0000:05:00.0: value [iter 5]: 0x3f7d8830
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581521] iwlwifi 0000:05:00.0: value [iter 6]: 0x3f7d8430
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581537] iwlwifi 0000:05:00.0: value [iter 7]: 0x3f7d0830
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581552] iwlwifi 0000:05:00.0: value [iter 8]: 0x3f7d0430
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581568] iwlwifi 0000:05:00.0: value [iter 9]: 0x3f7d8830
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581583] iwlwifi 0000:05:00.0: value [iter 10]: 0x3f7d0430
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581599] iwlwifi 0000:05:00.0: value [iter 11]: 0x3f7d8830
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581614] iwlwifi 0000:05:00.0: value [iter 12]: 0x3f7d0430
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581630] iwlwifi 0000:05:00.0: value [iter 13]: 0x3f7d8830
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581646] iwlwifi 0000:05:00.0: value [iter 14]: 0x3f7d0c30
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581659] iwlwifi 0000:05:00.0: Host monitor block 0x0 vector 0x1
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581675] iwlwifi 0000:05:00.0: value [iter 0]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581691] iwlwifi 0000:05:00.0: value [iter 1]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581706] iwlwifi 0000:05:00.0: value [iter 2]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581722] iwlwifi 0000:05:00.0: value [iter 3]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581737] iwlwifi 0000:05:00.0: value [iter 4]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581753] iwlwifi 0000:05:00.0: value [iter 5]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581768] iwlwifi 0000:05:00.0: value [iter 6]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581784] iwlwifi 0000:05:00.0: value [iter 7]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581799] iwlwifi 0000:05:00.0: value [iter 8]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581815] iwlwifi 0000:05:00.0: value [iter 9]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581830] iwlwifi 0000:05:00.0: value [iter 10]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581845] iwlwifi 0000:05:00.0: value [iter 11]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581861] iwlwifi 0000:05:00.0: value [iter 12]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581877] iwlwifi 0000:05:00.0: value [iter 13]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581893] iwlwifi 0000:05:00.0: value [iter 14]: 0x040066c2
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581906] iwlwifi 0000:05:00.0: Host monitor block 0x0 vector 0x6
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581922] iwlwifi 0000:05:00.0: value [iter 0]: 0xb00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581938] iwlwifi 0000:05:00.0: value [iter 1]: 0xe00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581953] iwlwifi 0000:05:00.0: value [iter 2]: 0xb00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581969] iwlwifi 0000:05:00.0: value [iter 3]: 0xe00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.581984] iwlwifi 0000:05:00.0: value [iter 4]: 0xb00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582000] iwlwifi 0000:05:00.0: value [iter 5]: 0xe00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582015] iwlwifi 0000:05:00.0: value [iter 6]: 0xb00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582031] iwlwifi 0000:05:00.0: value [iter 7]: 0xe00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582046] iwlwifi 0000:05:00.0: value [iter 8]: 0xb00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582061] iwlwifi 0000:05:00.0: value [iter 9]: 0xe00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582077] iwlwifi 0000:05:00.0: value [iter 10]: 0xb00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582092] iwlwifi 0000:05:00.0: value [iter 11]: 0xe00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582282] iwlwifi 0000:05:00.0: value [iter 12]: 0xf00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582464] iwlwifi 0000:05:00.0: value [iter 13]: 0xe00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582638] iwlwifi 0000:05:00.0: value [iter 14]: 0xa00c7c75
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582806] iwlwifi 0000:05:00.0: Host monitor block 0x22 vector 0x0
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.582976] iwlwifi 0000:05:00.0: value [iter 0]: 0x00000000
Oct 2 10:59:26 howarth-X570-UD kernel: [ 5.583157] iwlwifi: probe of 0000:05:00.0 failed with error -110

compared to a successful initialization which shows...

Oct 2 11:00:00 howarth-X570-UD kernel: [ 5.473105] iwlwifi 0000:05:00.0: enabling device (0000 -> 0002)
Oct 2 11:00:00 howarth-X570-UD kernel: [ 5.474187] iwlwifi 0000:05:00.0: Direct firmware load for iwlwifi-ty-a0-gf-a0-72.ucode failed with error -2
Oct 2 11:00:00 howarth-X570-UD kernel: [ 5.475714] iwlwifi 0000:05:00.0: api flags index 2 larger than supported by driver
Oct 2 11:00:00 howarth-X570-UD kernel: [ 5.475723] iwlwifi 0000:05:00.0: TLV_FW_FSEQ_VERSION: FSEQ Version: 0.0.2.36
Oct 2 11:00:00 howarth-X570-UD kernel: [ 5.476150] iwlwifi 0000:05:00.0: loaded firmware version 71.058653f6.0 ty-a0-gf-a0-71.ucode op_mode iwlmvm
Oct 2 11:00:00 howarth-X570-UD kernel: [ 5.680828] iwlwifi 0000:05:00.0: Detected Intel(R) Wi-Fi 6 AX210 160MHz, REV=0x420
Oct 2 11:00:00 howarth-X570-UD kernel: [ 5.829996] iwlwifi 0000:05:00.0: loaded PNVM version 881c99e1
Oct 2 11:00:00 howarth-X570-UD kernel: [ 5.841619] iwlwifi 0000:05:00.0: Detected RF GF, rfid=0x10d000
Oct 2 11:00:00 howarth-X570-UD kernel: [ 5.910248] iwlwifi 0000:05:00.0: base HW address: 28:df:eb:5b:80:97
Oct 2 11:00:00 howarth-X570-UD kernel: [ 5.925699] iwlwifi 0000:05:00.0 wlp5s0: renamed from wlan0

ProblemType: Bug
DistroRelease: Ubuntu 22.10
Package: linux-generic 5.19.0.19.19
ProcVersionSignature: Ubuntu 5.19.0-19.19-generic 5.19.7
Uname: Linux 5.19.0-19-generic x86_64
NonfreeKernelModules: nvidia_modeset nvidia
ApportVersion: 2.23.1-0ubuntu1
Architecture: amd64
AudioDevicesInUse:
 USER PID ACCESS COMMAND
 /dev/snd/controlC1: howarth 1839 F.... wireplumber
 /dev/snd/controlC2: howarth 1839 F.... wireplumber
 /dev/snd/controlC0: howarth 1839 F.... wireplumber
 /dev/snd/seq: howarth 1835 F.... pipewire
CRDA: N/A
CasperMD5CheckResult: pass
CurrentDesktop: ubuntu:GNOME
Date: Fri Oct 7 13:42:48 2022
InstallationDate: Installed on 2022-03-31 (189 days ago)
InstallationMedia: Ubuntu 22.04 LTS "Jammy Jellyfish" - Alpha amd64 (20220326)
MachineType: Gigabyte Technology Co., Ltd. X570 UD
ProcEnviron:
 TERM=xterm-256color
 PATH=(custom, no user)
 XDG_RUNTIME_DIR=<set>
 LANG=en_US.UTF-8
 SHELL=/bin/bash
ProcFB: 0 EFI VGA
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-5.19.0-19-generic root=UUID=5436e544-69ea-41e9-b626-c5e8d95b5207 ro quiet splash vt.handoff=7
PulseList: Error: command ['pacmd', 'list'] failed with exit code 1: No PulseAudio daemon running, or not running as session daemon.
RelatedPackageVersions:
 linux-restricted-modules-5.19.0-19-generic N/A
 linux-backports-modules-5.19.0-19-generic N/A
 linux-firmware 20220923.gitf09bebf3-0ubuntu1
SourcePackage: linux
UpgradeStatus: Upgraded to kinetic on 2022-09-29 (7 days ago)
dmi.bios.date: 01/18/2021
dmi.bios.release: 5.17
dmi.bios.vendor: American Megatrends Inc.
dmi.bios.version: F32
dmi.board.asset.tag: Default string
dmi.board.name: X570 UD
dmi.board.vendor: Gigabyte Technology Co., Ltd.
dmi.board.version: x.x
dmi.chassis.asset.tag: Default string
dmi.chassis.type: 3
dmi.chassis.vendor: Default string
dmi.chassis.version: Default string
dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvrF32:bd01/18/2021:br5.17:svnGigabyteTechnologyCo.,Ltd.:pnX570UD:pvrDefaultstring:rvnGigabyteTechnologyCo.,Ltd.:rnX570UD:rvrx.x:cvnDefaultstring:ct3:cvrDefaultstring:skuDefaultstring:
dmi.product.family: X570 MB
dmi.product.name: X570 UD
dmi.product.sku: Default string
dmi.product.version: Default string
dmi.sys.vendor: Gigabyte Technology Co., Ltd.

Revision history for this message
Jack Howarth (jwhowarth) wrote :
Revision history for this message
Ubuntu Kernel Bot (ubuntu-kernel-bot) wrote : Status changed to Confirmed

This change was made by a bot.

Changed in linux (Ubuntu):
status: New → Confirmed
Revision history for this message
Jack Howarth (jwhowarth) wrote (last edit ):

Looking through the various bug reports against iwlwifi in bugzilla related to iwlwifi driver initialization failures and previous workarounds, I added...

options iwlwifi power_save=0
options iwlmvm power_scheme=1
options iwlwifi uapsd_disable=1

to /etc/modprobe.d/iwlwifi.conf. Tentatively, this seems to have suppressed the "CSR_RESET = 0x10" failures in this driver. I would note that the occurance of these failures was reduced under the 5.19.0-21.21 kernel package but not entirely eliminated.

Revision history for this message
Jack Howarth (jwhowarth) wrote :

Apparently the options workaround doesn't completely eliminate the bug. It still occurs around five percent of the time when booting kinetic.

Revision history for this message
Jack Howarth (jwhowarth) wrote :

Unfortunately, this bug has gotten worse under 5.19.0-23.24 despite the options hack. On a cold boot, about half the time the iwlwifi driver shows the bug.

Revision history for this message
Jack Howarth (jwhowarth) wrote :

It appears that this is fixable with a BIOS update on the Gigabyte X570 UD v1.1 motherboard. Upgrading from the F32 stable BIOS release to the F34 stable BIOS release captures the following change from the F33g beta BIOS release...

3. Fix USB 2.0 devices stability and compatibility

which makes sense as the Gigabyte GC-WBAX210 WIFI 6E Aorus PCI card is connected to a motherboard USB 2.0 connector. Since updating to F34, the boot issues with iwlwifi have disappeared. It would still be nice for upstream to make the iwlwifi drivers as robust to BIOS defects as the Windows drivers which always worked fine under F32.

Revision history for this message
Jack Howarth (jwhowarth) wrote :

Upgrading the BIOS to capture the USB 2.0 fixes significantly reduced the occurance of this bug but unfortunately doesn't totally eliminate it. I should note that the Ubuntu 22.04 LTS kernels initially suffered from this bug to a small degree but that by 22.04.1 LTS, the issue was extremely rare. It is unfortunate how fragile iwlwifi is.

Revision history for this message
Jack Howarth (jwhowarth) wrote :

After many false starts, the following similar RedHat bug report, gave me a hint to a workaround that suppresses the CSR_RESET errors in iwlwifi.

https://bugzilla.redhat.com/show_bug.cgi?id=2138790

Bug 2138790 - No WiFi on T16 Intel Gen 12th Alder Lake Wifi 6E AX 211 [NEEDINFO]

This bug report cites the following kernel commit as being the source of the bug.

https://github.com/torvalds/linux/blob/4fe89d07dcc2804c8b562f6c7896a45643d34b2f/drivers/net/wireless/intel/iwlwifi/iwl-io.c#L478-L483

Noticing this section in that file...

/*
  * Wait for clock stabilization; once stabilized, access to
  * device-internal resources is supported, e.g. iwl_write_prph()
  * and accesses to uCode SRAM.
  */

 err = iwl_poll_bit(trans, CSR_GP_CNTRL, poll_ready, poll_ready, 25000);
 if (err < 0) {
  IWL_DEBUG_INFO(trans, "Failed to wake NIC\n");

  iwl_dump_host_monitor(trans);
 }

... I decided to disable the BIOS setting for "Wake On LAN" in the Power section of the Gigabyte X570 UD v1.1 F37d BIOS (which is on by default).

So far this change has fully suppressed the CSR_RESET bug. Disabling "Wake On LAN" in BIOS is sufficient without resorting to...

options iwlwifi power_save=0
options iwlmvm power_scheme=1
options iwlwifi uapsd_disable=1

in /etc/modprobe.d/iwlwifi.conf.

Revision history for this message
Utkarsh Gupta (utkarsh) wrote :

Ubuntu 22.10 (Kinetic Kudu) has reached end of life, so this bug will not be fixed for that specific release.

Changed in linux (Ubuntu Kinetic):
status: Confirmed → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.