missing firmware reported when updating initramfs

[fossfreedom]

[SRU Justification]

[Impact]

Some kernel firmwares might be landed after linux-firmware forked for
each series, or for LTS series, kernels of new versions may claim
additional ones that were not previously available. This leaves devices
fail to function correctly while they ought to.

With a checking script that enumerates all the blobs available in
upstream repo and in the Ubuntu fork of a given series, e.g. hirsute,
iterate through all the installed kernel modules of a given version to
check if claimed firmware blobs are available in Ubuntu's fork.
Following kernel version/series have been checked:

  * 5.11.0-14-generic/hirsute
  * 5.8.0-48-generic/groovy
  * 5.4.0-70-generic/focal
  * 5.6.0-1052-oem/focal
  * 5.8.0-48-generic/focal
  * 5.10.0-1019-oem/focal
  * 4.15.0-140-generic/bionic
  * 4.18.0-25-generic/bionic
  * 5.0.0-65-generic/bionic
  * 5.4.0-70-generic/bionic

And it gives following files were missing in at least one of above cases:

  * amdgpu/arcturus_asd.bin
  * amdgpu/arcturus_gpu_info.bin
  * amdgpu/arcturus_mec.bin
  * amdgpu/arcturus_mec2.bin
  * amdgpu/arcturus_rlc.bin
  * amdgpu/arcturus_sdma.bin
  * amdgpu/arcturus_smc.bin
  * amdgpu/arcturus_sos.bin
  * amdgpu/arcturus_ta.bin
  * amdgpu/arcturus_vcn.bin
  * amdgpu/navi12_asd.bin
  * amdgpu/navi12_ce.bin
  * amdgpu/navi12_dmcu.bin
  * amdgpu/navi12_gpu_info.bin
  * amdgpu/navi12_me.bin
  * amdgpu/navi12_mec.bin
  * amdgpu/navi12_mec2.bin
  * amdgpu/navi12_pfp.bin
  * amdgpu/navi12_rlc.bin
  * amdgpu/navi12_sdma.bin
  * amdgpu/navi12_sdma1.bin
  * amdgpu/navi12_smc.bin
  * amdgpu/navi12_sos.bin
  * amdgpu/navi12_ta.bin
  * amdgpu/navi12_vcn.bin
  * amdgpu/navy_flounder_ce.bin
  * amdgpu/navy_flounder_dmcub.bin
  * amdgpu/navy_flounder_me.bin
  * amdgpu/navy_flounder_mec.bin
  * amdgpu/navy_flounder_mec2.bin
  * amdgpu/navy_flounder_pfp.bin
  * amdgpu/navy_flounder_rlc.bin
  * amdgpu/navy_flounder_sdma.bin
  * amdgpu/navy_flounder_smc.bin
  * amdgpu/navy_flounder_sos.bin
  * amdgpu/navy_flounder_ta.bin
  * amdgpu/navy_flounder_vcn.bin
  * amdgpu/oland_uvd.bin
  * amdgpu/pitcairn_uvd.bin
  * amdgpu/renoir_asd.bin
  * amdgpu/renoir_ce.bin
  * amdgpu/renoir_gpu_info.bin
  * amdgpu/renoir_me.bin
  * amdgpu/renoir_mec.bin
  * amdgpu/renoir_mec2.bin
  * amdgpu/renoir_pfp.bin
  * amdgpu/renoir_rlc.bin
  * amdgpu/renoir_sdma.bin
  * amdgpu/renoir_ta.bin
  * amdgpu/renoir_vcn.bin
  * amdgpu/sienna_cichlid_ce.bin
  * amdgpu/sienna_cichlid_dmcub.bin
  * amdgpu/sienna_cichlid_me.bin
  * amdgpu/sienna_cichlid_mec.bin
  * amdgpu/sienna_cichlid_mec2.bin
  * amdgpu/sienna_cichlid_pfp.bin
  * amdgpu/sienna_cichlid_rlc.bin
  * amdgpu/sienna_cichlid_sdma.bin
  * amdgpu/sienna_cichlid_smc.bin
  * amdgpu/sienna_cichlid_sos.bin
  * amdgpu/sienna_cichlid_ta.bin
  * amdgpu/sienna_cichlid_vcn.bin
  * amdgpu/tahiti_uvd.bin
  * amdgpu/vega20_ta.bin
  * amdgpu/verde_uvd.bin
  * atmel/wilc1000_wifi_firmware-1.bin
  * cmmb_vega_12mhz.inp
  * cmmb_venice_12mhz.inp
  * dvb_nova_12mhz.inp
  * dvb_nova_12mhz_b0.inp
  * i915/bxt_guc_33.0.0.bin
  * i915/glk_guc_33.0.0.bin
  * i915/icl_guc_33.0.0.bin
  * i915/kbl_guc_33.0.0.bin
  * i915/skl_guc_33.0.0.bin
  * i915/tgl_dmc_ver2_04.bin
  * i915/tgl_huc_7.5.0.bin
  * isdbt_nova_12mhz.inp
  * isdbt_nova_12mhz_b0.inp
  * isdbt_rio.inp
  * iwlwifi-Qu-b0-hr-b0-59.ucode
  * iwlwifi-Qu-b0-jf-b0-50.ucode
  * iwlwifi-Qu-b0-jf-b0-59.ucode
  * iwlwifi-Qu-c0-hr-b0-50.ucode
  * iwlwifi-Qu-c0-hr-b0-59.ucode
  * iwlwifi-QuZ-a0-hr-b0-50.ucode
  * iwlwifi-QuZ-a0-hr-b0-59.ucode
  * iwlwifi-QuZ-a0-jf-b0-50.ucode
  * iwlwifi-QuZ-a0-jf-b0-59.ucode
  * iwlwifi-cc-a0-50.ucode
  * iwlwifi-cc-a0-59.ucode
  * mediatek/mt7663pr2h.bin
  * mellanox/mlxsw_spectrum-13.2000.1886.mfa2
  * mellanox/mlxsw_spectrum-13.2008.1310.mfa2
  * mellanox/mlxsw_spectrum2-29.2008.1310.mfa2
  * mellanox/mlxsw_spectrum3-30.2008.1310.mfa2
  * mrvl/sdsd8977_combo_v2.bin
  * mrvl/sdsd8997_combo_v4.bin
  * rtl_nic/rtl8125a-3.fw
  * rtl_nic/rtl8168fp-3.fw
  * rtw88/rtw8822c_wow_fw.bin
  * sms1xxx-hcw-55xxx-dvbt-02.fw
  * sms1xxx-hcw-55xxx-isdbt-02.fw
  * sms1xxx-nova-a-dvbt-01.fw
  * sms1xxx-nova-b-dvbt-01.fw
  * sms1xxx-stellar-dvbt-01.fw
  * tdmb_nova_12mhz.inp

[Fix]

  * af1ca28f amdgpu: add arcturus firmware
  * c82cb463 amdgpu: update sienna cichlid firmware for 20.50
  * 25451a4f amdgpu: update navi12 firmware for 20.50
  * 2542ba7a amdgpu: update renoir firmware for 20.50
  * a29bdb2e amdgpu: add initial support for navy flounder
  * 54c797a6 amdgpu: add sienna cichlid firmware for 20.45
  * 7c81cc27 amdgpu: update renoir firmware for 20.45
    - [F] SKIPPED: other renoir firmware blobs are of a older version
  * 68ce0fb9 amdgpu: update navi12 firmware for 20.45
  * 65370dba rtw88: RTL8822C: Update firmware to v9.9.4
    - SKIPPED: rtw88/rtw8822c_fw.bin is of a older version
  * e371b7cd Revert "rtw88: RTL8822C: Update firmware to v9.9.4"
    - SKIPPED: rtw88/rtw8822c_fw.bin is of a older version
  * c93834e1 rtw88: RTL8822C: Update firmware to v9.9.4
    - SKIPPED: rtw88/rtw8822c_fw.bin is of a older version
  * 4f41e9d6 iwlwifi: update and add new FWs from core56-54 release
    - SKIPPED: this updates existing firmware blobs
  * 9f46d48e amdgpu: update renoir firmware for 20.40
    - [F] SKIPPED: other renoir firmware blobs are of a older version
  * 1696e2ed amdgpu: update navi12 firmware for 20.40
  * eb3aa1fa Mellanox: Add new mlxsw_spectrum firmware xx.2008.1310
  * 74bd44fc amdgpu: add navi12 firmware from 20.30
  * 1bcdc9af i915: Add HuC firwmare v7.5.0 for TGL
  * c331aa9c amdgpu: update vega20 firmware for 20.30
  * d89e9b1a amdgpu: update renoir firmware for 20.30
  * 9bc37890 linux-firmware: update NXP SDSD-8997 firmware image
  * f39b6872 Update binary firmware for MT7663 based devices to include firmware offload feature and low power feature.
  * 7169ab32 linux-firmware: wilc1000: add wilc1000 v15.4 FW
  * 1a0c0c22 amdgpu: add UVD firmware for SI asics
  * e96c1212 amdgpu: update renoir firmware from 20.20 release
  * f73f82cd amdgpu: add vega20 TA firmware from 20.20 release
  * c2e313be rtw88: RTL8822C: update firmware version to v9.9
    - SKIPPED: rtw88/rtw8822c_fw.bin is of a older version
  * 2ae99744 iwlwifi: update FWs to core47-142 release
    - SKIPPED: this updates existing firmware blobs
  * 9a0b0f49 amdgpu: update renoir firmware for 20.10
  * 236ec455 linux-firmware: add firmware for MT7663 Wifi/BT combo device
  * 6d9f3991 amdgpu: add renoir firmware for 19.50
  * e8a0f4c9 rtl_nic: add firmware rtl8168fp-3
  * e4ea25f5 drm/i915/firmware: Add v2.04 of DMC for TGL
  * f667c005 rtl_nic: add firmware rtl8125a-3
  * ebd40c66 Mellanox: Add new mlxsw_spectrum firmware 13.2000.1886
  * 7e431c5d rtw88: RTL8822C: add WoW firmware v7.3
    - SKIPPED: rtw88/rtw8822c_fw.bin is of a older version
  * 05dbae66 drm/i915/firmware: Add v33 of GuC for ICL
  * 786f17a3 drm/i915/firmware: Add v33 of GuC for KBL
  * aae0eb58 drm/i915/firmware: Add v33 of GuC for SKL
  * 9cf240f6 drm/i915/firmware: Add v33 of GuC for GLK
  * 8a0a6a64 drm/i915/firmware: Add v33 of GuC for BXT
  * 2206320b linux-firmware: add Marvell SD8977 firmware image
  * 52b23a93 linux-firmware: add Marvell SD8997 firmware image
  * d2adbb0b linux-firmware: Add firmware files for Siano DTV devices
    - SKIPPED: this commit was explicitly reverted in LP: #1401711

[Test Case]

* The same script is used to make sure as many blobs are installed as
  possible.
* Also make sure only blob addition were made. No existing blob touched.

[Where problems could occur]

While this is to backport firmwares claimed by current kernel drivers,
devices previously failed to be successfully initialized due to the lack
of corresponding firmware will then be enabled. This may introduce new
issues carried by those devices.

[Other Info]

Unstable is not tested/nominated, because it should be following upstream closely and this issue should most like happen after a developing series being release.

========== original bug description ==========

I'm seeing the following:

update-initramfs: Generating /boot/initrd.img-5.11.0-13-generic
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_gpu_info.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_gpu_info.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_ta.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_sos.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_toc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_asd.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_ta.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_asd.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_sos.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_rlc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_mec2.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_mec.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_rlc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_mec2.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_mec.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_me.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_pfp.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_ce.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_rlc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_mec2.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_mec.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_me.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_pfp.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_ce.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_sdma.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_sdma.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_sdma.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/sienna_cichlid_mes.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi10_mes.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_vcn.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_vcn.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_vcn.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_smc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_smc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/dimgrey_cavefish_dmcub.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/vangogh_dmcub.bin for module amdgpu
Processing triggers for hicolor-icon-theme (0.17-2) ...
Processing triggers for cups (2.3.3op2-3ubuntu3) ...
Processing triggers for gnome-menus (3.36.0-1ubuntu1) ...
Processing triggers for libglib2.0-0:amd64 (2.67.5-2) ...
Processing triggers for libc-bin (2.33-0ubuntu4) ...
Processing triggers for man-db (2.9.4-2) ...
Processing triggers for dbus (1.12.20-1ubuntu3) ...

ProblemType: Bug
DistroRelease: Ubuntu 21.04
Package: linux-image-5.11.0-11-generic 5.11.0-11.12
ProcVersionSignature: Ubuntu 5.11.0-11.12-generic 5.11.0
Uname: Linux 5.11.0-11-generic x86_64
ApportVersion: 2.20.11-0ubuntu61
Architecture: amd64
AudioDevicesInUse:
 USER PID ACCESS COMMAND
 /dev/snd/controlC1: dad 2584 F.... pulseaudio
 /dev/snd/controlC0: dad 2584 F.... pulseaudio
CasperMD5CheckResult: unknown
CurrentDesktop: Budgie:GNOME
Date: Fri Apr 2 12:27:30 2021
InstallationDate: Installed on 2021-02-08 (52 days ago)
InstallationMedia: Ubuntu-Budgie 21.04 "Hirsute Hippo" - Alpha amd64 (20210208)
MachineType: TUXEDO TUXEDO Pulse 15 Gen1
ProcFB: 0 amdgpudrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-5.11.0-11-generic root=UUID=dca66736-5282-45e6-a144-59d3339a8d0f ro quiet splash
RebootRequiredPkgs: network-manager
RelatedPackageVersions:
 linux-restricted-modules-5.11.0-11-generic N/A
 linux-backports-modules-5.11.0-11-generic N/A
 linux-firmware 1.196
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 12/08/2020
dmi.bios.release: 5.16
dmi.bios.vendor: American Megatrends Inc.
dmi.bios.version: N.1.07.A02
dmi.board.asset.tag: Standard
dmi.board.name: PULSE1501
dmi.board.vendor: TUXEDO
dmi.board.version: Standard
dmi.chassis.asset.tag: Standard
dmi.chassis.type: 10
dmi.chassis.vendor: TUXEDO
dmi.chassis.version: Standard
dmi.ec.firmware.release: 1.4
dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvrN.1.07.A02:bd12/08/2020:br5.16:efr1.4:svnTUXEDO:pnTUXEDOPulse15Gen1:pvrStandard:rvnTUXEDO:rnPULSE1501:rvrStandard:cvnTUXEDO:ct10:cvrStandard:
dmi.product.family: RENOIR
dmi.product.name: TUXEDO Pulse 15 Gen1
dmi.product.sku: PULSE1501
dmi.product.version: Standard
dmi.sys.vendor: TUXEDO

[Ubuntu Kernel Bot (ubuntu-kernel-bot)]

This change was made by a bot.

[RoyK (roysk)]

I just saw this on an HP EliteBook 725 G2

[You-Sheng Yang (vicamo)]

Attach a small script to enumerate and compare kernel claimed firmware
blobs and those actually exist in upstream/ubuntu linux-firmware
package. Also the output of possible combinations from Focal and on.

[You-Sheng Yang (vicamo)]

Maybe to integrate https://salsa.debian.org/kernel-team/initramfs-tools/-/commit/a7718dcce49a5c1dc025dd22de52b05e4ce8b004 ("Add firmware for built-in drivers") to the script in the future. There is no extra missing firmware found so far.

[You-Sheng Yang (vicamo)]

And those for Bionic.

[You-Sheng Yang (vicamo)]

PPA: https://launchpad.net/~vicamo/+archive/ubuntu/ppa-1922350

[You-Sheng Yang (vicamo)]

update checker script used.

[You-Sheng Yang (vicamo)]

Note that not all the missing files listed in the original bug description are going to be backported. Some of them might just be unavailable even in upstream, e.g. amdgpu/vangogh_rlc.bin.

[You-Sheng Yang (vicamo)]

SRU:
* hirsute: https://lists.ubuntu.com/archives/kernel-team/2021-April/119170.html
* groovy: https://lists.ubuntu.com/archives/kernel-team/2021-April/119172.html
* focal: https://lists.ubuntu.com/archives/kernel-team/2021-April/119175.html

[You-Sheng Yang (vicamo)]

bionic: https://lists.ubuntu.com/archives/kernel-team/2021-April/119192.html

[Brian Murray (brian-murray)]

The Groovy Gorilla has reached end of life, so this bug will not be fixed for that release

[Brian Murray (brian-murray)]

The Hirsute Hippo has reached End of Life, so this bug will not be fixed for that release.

[Juerg Haefliger (juergh)]

Closing this as won't fix. We can revisit and open new bugs if specific firmware blobs are needed and can be tested by the reporter. As discussed on the mailing list [1], we're not blindly adding firmwares that initramfs-tools complains are missing.

[1] https://lists.ubuntu.com/archives/kernel-team/2021-April/119192.html