Sound w/SOF driver sporadically fails on Lenovo Carbon X1 gen 7

[Eugene Crosser]

Now and then, the notebooks stops producing any sound, and program that try to use sound output freeze for many seconds. There is a repeating sequence on messages in `dmesg`:

[116525.402057] sof-audio-pci 0000:00:1f.3: error: ipc timed out for 0x80010000 size 120
[116525.402081] sof-audio-pci 0000:00:1f.3: status: fw entered - code 00000005
[116525.402338] sof-audio-pci 0000:00:1f.3: error: can't enter idle
[116525.402342] sof-audio-pci 0000:00:1f.3: error: trace point 00004000
[116525.402346] sof-audio-pci 0000:00:1f.3: error: panic at src/lib/agent.c:50
[116525.402350] sof-audio-pci 0000:00:1f.3: error: DSP Firmware Oops
[116525.402356] sof-audio-pci 0000:00:1f.3: EXCCAUSE 0x0000003f EXCVADDR 0x00000000 PS 0x00060925 SAR 0x00000000
[116525.402361] sof-audio-pci 0000:00:1f.3: EPC1 0x00000000 EPC2 0xbe00d30e EPC3 0x00000000 EPC4 0x00000000
[116525.402365] sof-audio-pci 0000:00:1f.3: EPC5 0x00000000 EPC6 0x00000000 EPC7 0x00000000 DEPC 0x00000000
[116525.402369] sof-audio-pci 0000:00:1f.3: EPS2 0x00060d20 EPS3 0x00000000 EPS4 0x00000000 EPS5 0x00000000
[116525.402374] sof-audio-pci 0000:00:1f.3: EPS6 0x00000000 EPS7 0x00000000 INTENABL 0x00000000 INTERRU 0x00000222
[116525.402378] sof-audio-pci 0000:00:1f.3: stack dump from 0xbe04f5b0
[116525.402385] sof-audio-pci 0000:00:1f.3: 0xbe04f5b0: be00fc00 be04f5e0 be062180 00000001
[116525.402391] sof-audio-pci 0000:00:1f.3: 0xbe04f5b4: 00000000 00000000 00000032 00000000
[116525.402396] sof-audio-pci 0000:00:1f.3: 0xbe04f5b8: 69cd0100 15655b6c 602aeaf8 ffff93a4
[116525.402401] sof-audio-pci 0000:00:1f.3: 0xbe04f5bc: 00000000 ffff93a4 00000000 303a3030
[116525.402406] sof-audio-pci 0000:00:1f.3: 0xbe04f5c0: 00000078 00000000 602aea98 ffff93a4
[116525.402411] sof-audio-pci 0000:00:1f.3: 0xbe04f5c4: 6bdcfb58 ffff93a4 5d006830 ffff93a4
[116525.402416] sof-audio-pci 0000:00:1f.3: 0xbe04f5c8: 6ba37218 ffff93a4 82317aaf ffffbca5
[116525.402421] sof-audio-pci 0000:00:1f.3: 0xbe04f5cc: 6ba37220 ffff93a4 023179f8 ffffbca5
[116525.402446] sof-audio-pci 0000:00:1f.3: error: hda irq intsts 0x00000000 intlctl 0xc0000081 rirb 00
[116525.402450] sof-audio-pci 0000:00:1f.3: error: dsp irq ppsts 0x00000000 adspis 0x00000000
[116525.402471] sof-audio-pci 0000:00:1f.3: error: host status 0x00000000 dsp status 0x00000000 mask 0x00000003
[116525.402475] sof-audio-pci 0000:00:1f.3: error: waking up any trace sleepers
[116525.402481] sof-audio-pci 0000:00:1f.3: error: failed to set dai config for iDisp1
[116525.402486] sof-audio-pci 0000:00:1f.3: ASoC: can't set iDisp1 Pin hw params: -110
[116525.402498] iDisp1: ASoC: hw_params BE failed -110
[116525.402502] HDMI1: ASoC: hw_params BE failed -110

This _might_ be the upstream bug https://github.com/thesofproject/sof/issues/2828

ProblemType: Bug
DistroRelease: Ubuntu 20.04
Package: linux-image-5.4.0-33-generic 5.4.0-33.37
ProcVersionSignature: Ubuntu 5.4.0-33.37-generic 5.4.34
Uname: Linux 5.4.0-33-generic x86_64
ApportVersion: 2.20.11-0ubuntu27.2
Architecture: amd64
AudioDevicesInUse:
 USER PID ACCESS COMMAND
 /dev/snd/controlC0: crosser 42712 F.... pulseaudio
CasperMD5CheckResult: skip
CurrentDesktop: ubuntu:GNOME
Date: Sun May 31 20:40:20 2020
InstallationDate: Installed on 2020-01-02 (149 days ago)
InstallationMedia: Ubuntu 19.10 "Eoan Ermine" - Alpha amd64 (20190802)
MachineType: LENOVO 20QDCTO1WW
ProcFB: 0 i915drmfb
ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-5.4.0-33-generic root=/dev/mapper/vgubuntu-root ro quiet splash vt.handoff=7
RelatedPackageVersions:
 linux-restricted-modules-5.4.0-33-generic N/A
 linux-backports-modules-5.4.0-33-generic N/A
 linux-firmware 1.187
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 05/13/2020
dmi.bios.vendor: LENOVO
dmi.bios.version: N2HET50W (1.33 )
dmi.board.asset.tag: Not Available
dmi.board.name: 20QDCTO1WW
dmi.board.vendor: LENOVO
dmi.board.version: SDK0J40709 WIN
dmi.chassis.asset.tag: No Asset Information
dmi.chassis.type: 10
dmi.chassis.vendor: LENOVO
dmi.chassis.version: None
dmi.modalias: dmi:bvnLENOVO:bvrN2HET50W(1.33):bd05/13/2020:svnLENOVO:pn20QDCTO1WW:pvrThinkPadX1Carbon7th:rvnLENOVO:rn20QDCTO1WW:rvrSDK0J40709WIN:cvnLENOVO:ct10:cvrNone:
dmi.product.family: ThinkPad X1 Carbon 7th
dmi.product.name: 20QDCTO1WW
dmi.product.sku: LENOVO_MT_20QD_BU_Think_FM_ThinkPad X1 Carbon 7th
dmi.product.version: ThinkPad X1 Carbon 7th
dmi.sys.vendor: LENOVO

[Ubuntu Kernel Bot (ubuntu-kernel-bot)]

This change was made by a bot.

[Tuomas Suutari (tuomas-suutari)]

I have the same problem with Lenovo T14 (Gen 1), which seems to have a similar sound device:

00:1f.3 Audio device [0403]: Intel Corporation Device [8086:02c8] (prog-if 80)
        Subsystem: Lenovo Device [17aa:22b1]
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64
        Interrupt: pin A routed to IRQ 171
        Region 0: Memory at ef83c000 (64-bit, non-prefetchable) [size=16K]
        Region 4: Memory at eea00000 (64-bit, non-prefetchable) [size=1M]
        Capabilities: [50] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [80] Vendor Specific Information: Len=14 <?>
        Capabilities: [60] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee00858 Data: 0000
        Kernel driver in use: sof-audio-pci
        Kernel modules: snd_hda_intel, snd_sof_pci

This is what I've got to my dmesg when the sound stopped working:

[127623.194131] sof-audio-pci 0000:00:1f.3: error : DSP panic!
[127623.194155] sof-audio-pci 0000:00:1f.3: status: fw entered - code 00000005
[127623.194394] sof-audio-pci 0000:00:1f.3: error: can't enter idle
[127623.194398] sof-audio-pci 0000:00:1f.3: error: trace point 00004000
[127623.194402] sof-audio-pci 0000:00:1f.3: error: panic at src/lib/agent.c:50
[127623.194409] sof-audio-pci 0000:00:1f.3: error: DSP Firmware Oops
[127623.194427] sof-audio-pci 0000:00:1f.3: EXCCAUSE 0x0000003f EXCVADDR 0x00000000 PS 0x00060925 SAR 0x00000000
[127623.194431] sof-audio-pci 0000:00:1f.3: EPC1 0x00000000 EPC2 0xbe00d30e EPC3 0x00000000 EPC4 0x00000000
[127623.194434] sof-audio-pci 0000:00:1f.3: EPC5 0x00000000 EPC6 0x00000000 EPC7 0x00000000 DEPC 0x00000000
[127623.194438] sof-audio-pci 0000:00:1f.3: EPS2 0x00060d20 EPS3 0x00000000 EPS4 0x00000000 EPS5 0x00000000
[127623.194440] sof-audio-pci 0000:00:1f.3: EPS6 0x00000000 EPS7 0x00000000 INTENABL 0x00000000 INTERRU 0x00000222
[127623.194443] sof-audio-pci 0000:00:1f.3: stack dump from 0xbe04f5b0
[127623.194451] sof-audio-pci 0000:00:1f.3: 0xbe04f5b0: be00fc00 be04f5e0 be062380 00000000
[127623.194454] sof-audio-pci 0000:00:1f.3: 0xbe04f5b4: 00000000 00000000 00000032 00000000
[127623.194457] sof-audio-pci 0000:00:1f.3: 0xbe04f5b8: fb35de00 fc28026c 7a64e018 ffff952e
[127623.194461] sof-audio-pci 0000:00:1f.3: 0xbe04f5bc: 0090be70 ffffa4f2 c0edc5f9 ffffffff
[127623.194463] sof-audio-pci 0000:00:1f.3: 0xbe04f5c0: a9716c98 ffffffff 6ead97c0 ffff952e
[127623.194467] sof-audio-pci 0000:00:1f.3: 0xbe04f5c4: 00000000 00000000 00000000 00000000
[127623.194471] sof-audio-pci 0000:00:1f.3: 0xbe04f5c8: 002cbb98 ffffa4f2 0090bf48 ffffa4f2
[127623.194475] sof-audio-pci 0000:00:1f.3: 0xbe04f5cc: 00000000 00000000 00000000 00000000
[127623.194478] sof-audio-pci 0000:00:1f.3: error: waking up any trace sleepers
[127714.180370] sof-audio-pci 0000:00:1f.3: error: ...

[Tuomas Suutari (tuomas-suutari)]

If this is indeed the same issue as in https://github.com/thesofproject/sof/issues/2828, then the problem should be fixed by upgrading the SOF firmware to 1.6 version.

I'll give it a try by installing directly from https://github.com/thesofproject/sof-bin/tree/stable-v1.6

I will let you know if that fixed the issue. So far it looks good, but I'll have to use the system for couple days to be sure.

If the newer firmware fixes the issue, is it possible to get it to the linux-firmware package for Ubuntu 20.04?

[Tuomas Suutari (tuomas-suutari)]

It seems that the 1.6 version of the SOF firmware fixes the issue for me. Haven't got any of those DSP panic messages anymore after the update and before the update they occurred almost every day.

Is there anything I can do to help in making this fix to be included to linux-firmware package?

Eugene: Have you tried if your issue is fixed by the newer firmware?

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[Tuomas Suutari (tuomas-suutari)]

Now that the new SOF firmware is included in the linux-firmware package (see bug #1900809) the audio stack has been much more stable for me. Unfortunately there has been still one audio stack crash after the firmware upgrade, but it probably was another issue, since the dmesg didn't contain similar "DSP panic" messages then. If that new crash happens again, I'll open a new bug.

However, I think this issue could be closed as fixed.

[Eugene Crosser (crosser)]

I had this happen again about a week ago, though it happens very rarely now.