Support Sony IMX471 camera sensor for Intel IPU7 platforms

Bug #2107320 reported by You-Sheng Yang
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
ipu6-drivers (Ubuntu)
Fix Released
High
You-Sheng Yang
Noble
Won't Fix
Undecided
Unassigned
Plucky
Fix Released
High
You-Sheng Yang
linux (Ubuntu)
In Progress
High
You-Sheng Yang
Noble
Won't Fix
Undecided
Unassigned
Plucky
In Progress
High
You-Sheng Yang
linux-oem-6.11 (Ubuntu)
Invalid
Undecided
Unassigned
Noble
Fix Committed
High
You-Sheng Yang
Plucky
Invalid
Undecided
Unassigned
linux-oem-6.14 (Ubuntu)
Invalid
Undecided
Unassigned
Noble
Fix Committed
High
You-Sheng Yang
Plucky
Invalid
Undecided
Unassigned

Bug Description

[SRU Justification]

[ Impact ]

To support Sony IMX471 camera sensor for Intel IPU7 platforms.

$ cat /sys/bus/i2c/devices/i2c-SONY471A\:00/modalias
acpi:SONY471A:SONY471A:

[ Test Plan ]

1. Install -proposed kernel oem-6.11/noble or linux-oem-6.14/noble
```
$ sudo apt-get install --no-install-recommends --yes \
    linux-oem-22.04b \
    linux-modules-ipu6-oem-22.04b \
    linux-modules-ipu7-oem-22.04b \
    linux-modules-usbio-oem-22.04b \
    linux-modules-vision-oem-22.04b
$ sudo apt-get install --no-install-recommends --yes \
    linux-oem-22.04c \
    linux-modules-ipu6-oem-22.04c \
    linux-modules-ipu7-oem-22.04c \
    linux-modules-usbio-oem-22.04c \
    linux-modules-vision-oem-22.04c
```

2. To verify dkms changes, install -proposed intel-ipu6-dkms.
```
$ sudo apt-get install --no-install-recommends --yes intel-ipu6-dkms
```

3. Check if the driver has correctly bound:
```
$ sudo dmesg|grep ipu
[sudo] password for ubuntu:
[ 2.597305] intel-ipu7 intel-ipu7: enabling device (0000 -> 0002)
[ 2.597314] intel-ipu7 intel-ipu7: Device 0x645d (rev: 0x4)
[ 2.597316] intel-ipu7 intel-ipu7: IPU7 PCI BAR0 base 204e000000 BAR2 base 2051342000
[ 2.597379] intel-ipu7 intel-ipu7: IPU7 PCI BAR0 mapped at 0000000071f8c99a
[ 2.599734] intel-ipu7 intel-ipu7: IPU7 SKU 0 in secure mode mask 0x0
[ 2.612679] intel-ipu7 intel-ipu7: firmware cpd file: intel/ipu/ipu7_fw.bin
[ 2.616023] intel-ipu7 intel-ipu7: FW binary0 info:
[ 2.616028] intel-ipu7 intel-ipu7: Name: psys
[ 2.616029] intel-ipu7 intel-ipu7: Version: 1.1.9.240627135220
[ 2.616030] intel-ipu7 intel-ipu7: Timestamp: build_id:331942702
[ 2.616030] intel-ipu7 intel-ipu7: Commit: commit_id:d84f5c35
[ 2.616031] intel-ipu7 intel-ipu7: FW binary1 info:
[ 2.616032] intel-ipu7 intel-ipu7: Name: isys
[ 2.616033] intel-ipu7 intel-ipu7: Version: 1.1.9.240627135318
[ 2.616033] intel-ipu7 intel-ipu7: Timestamp: build_id:3823931988
[ 2.616034] intel-ipu7 intel-ipu7: Commit: commit_id:d84f5c35
[ 2.627021] intel-ipu7 intel-ipu7: Found supported sensor SONY471A:00
[ 2.627030] intel-ipu7 intel-ipu7: Connected 1 cameras
[ 2.631837] intel-ipu7 intel-ipu7: Sending BOOT_LOAD to CSE
[ 2.695710] intel-ipu7 intel-ipu7: Sending AUTHENTICATE_RUN to CSE
[ 2.723665] intel-ipu7 intel-ipu7: CSE authenticate_run done
[ 2.808690] intel_ipu7_isys.isys intel_ipu7.isys.40: bind imx471 0-0010 nlanes is 4 port is 0
[ 2.808776] intel_ipu7_isys.isys intel_ipu7.isys.40: All sensor registration completed.
[ 2.847769] intel_ipu7_psys.psys intel_ipu7.psys.40: psys probe minor: 0
```

4. Try access via gstreamer plugin via the video device hidden from general users:
```
$ sudo gst-launch-1.0 icamerasrc ! \
    video/x-raw,format=NV12,width=1280,height=720 ! \
    videoconvert ! \
    autovideosink
```

5. Try access webcam from https://webcamtests.com

[ Where problems could occur ]

The changes only take effect for kernels >= v6.10. And while this is a new driver that is not yet upstreamed, it's has no effect to existing systems.

[ Other Info ]

Targets Questing and Plucky because all the oem-6.11/noble, oem-6.14/noble, linux/plucky kernels compile against intel-ipu6-dkms from Plucky.

---
ProblemType: Bug
ApportVersion: 2.28.1-0ubuntu3.5
Architecture: amd64
AudioDevicesInUse:
 USER PID ACCESS COMMAND
 /dev/snd/seq: ubuntu 1485 F.... pipewire
CRDA: N/A
CasperMD5CheckMismatches: ./casper/initrd ./casper/minimal.standard.live.hotfix.size ./casper/minimal.standard.live.size ./casper/minimal.manifest ./casper/minimal.standard.manifest ./casper/minimal.standard.size ./casper/minimal.hotfix.size ./casper/minimal.standard.live.hotfix.squashfs ./casper/minimal.standard.hotfix.squashfs ./casper/minimal.standard.hotfix.size ./casper/minimal.hotfix.squashfs ./casper/minimal.standard.live.manifest ./casper/minimal.size ./boot/grub/grub.cfg
CasperMD5CheckResult: fail
DistributionChannelDescriptor:
 # This is the distribution channel descriptor for Ubuntu 24.04 for Lenovo
 # For more information see http://wiki.ubuntu.com/DistributionChannelDescriptor
 canonical-oem-sutton-noble-oem-24.04b-20250324-102
DistroRelease: Ubuntu 24.04
InstallationDate: Installed on 2025-04-11 (4 days ago)
InstallationMedia: Ubuntu OEM 24.04.1 LTS "Noble Numbat" - Release amd64 (20250324)
IwConfig:
 lo no wireless extensions.

 wlp0s20f3 no wireless extensions.

 enx5c925ed71200 no wireless extensions.
MachineType: LENOVO 21QBZCJYCN
Package: linux (not installed)
ProcFB: 0 xedrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-6.11.0-1018-oem root=UUID=b1410b75-f8a9-400c-ba64-32769442a6f4 ro quiet splash vt.handoff=7
ProcVersionSignature: Ubuntu 6.11.0-1018.18-oem 6.11.11
RelatedPackageVersions:
 linux-restricted-modules-6.11.0-1018-oem N/A
 linux-backports-modules-6.11.0-1018-oem N/A
 linux-firmware 20240318.git3b128b60-0ubuntu2.11
Tags: noble
Uname: Linux 6.11.0-1018-oem x86_64
UpgradeStatus: No upgrade log present (probably fresh install)
UserGroups: N/A
_MarkForUpload: True
dmi.bios.date: 03/17/2025
dmi.bios.release: 1.12
dmi.bios.vendor: LENOVO
dmi.bios.version: N4DET29W (1.12 )
dmi.board.asset.tag: Not Available
dmi.board.name: 21QBZCJYCN
dmi.board.vendor: LENOVO
dmi.board.version: SDK0T76576 WIN
dmi.chassis.asset.tag: No Asset Tag
dmi.chassis.type: 10
dmi.chassis.vendor: LENOVO
dmi.chassis.version: None
dmi.ec.firmware.release: 1.11
dmi.modalias: dmi:bvnLENOVO:bvrN4DET29W(1.12):bd03/17/2025:br1.12:efr1.11:svnLENOVO:pn21QBZCJYCN:pvrThinkPadX9-14Gen1:rvnLENOVO:rn21QBZCJYCN:rvrSDK0T76576WIN:cvnLENOVO:ct10:cvrNone:skuLENOVO_MT_21QB_BU_Think_FM_ThinkPadX9-14Gen1:
dmi.product.family: ThinkPad X9-14 Gen 1
dmi.product.name: 21QBZCJYCN
dmi.product.sku: LENOVO_MT_21QB_BU_Think_FM_ThinkPad X9-14 Gen 1
dmi.product.version: ThinkPad X9-14 Gen 1
dmi.sys.vendor: LENOVO

You-Sheng Yang (vicamo)
description: updated
You-Sheng Yang (vicamo)
Changed in ipu6-drivers (Ubuntu Noble):
status: New → Won't Fix
Changed in ipu6-drivers (Ubuntu Plucky):
status: New → Confirmed
Changed in linux (Ubuntu Noble):
status: New → Won't Fix
Changed in linux (Ubuntu Plucky):
status: New → Confirmed
Changed in linux-oem-6.14 (Ubuntu Noble):
status: New → Confirmed
Changed in linux-oem-6.14 (Ubuntu Plucky):
status: New → Invalid
Revision history for this message
You-Sheng Yang (vicamo) wrote (last edit ):
Revision history for this message
You-Sheng Yang (vicamo) wrote : AlsaInfo.txt

apport information

tags: added: apport-collected noble
description: updated
Revision history for this message
You-Sheng Yang (vicamo) wrote : CurrentDmesg.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : Lspci.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : Lspci-vt.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : Lsusb.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : Lsusb-t.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : Lsusb-v.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : ProcCpuinfo.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : ProcCpuinfoMinimal.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : ProcEnviron.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : ProcInterrupts.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : ProcModules.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : RfKill.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : UdevDb.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : WifiSyslog.txt

apport information

Revision history for this message
You-Sheng Yang (vicamo) wrote : acpidump.txt

apport information

You-Sheng Yang (vicamo)
Changed in linux-oem-6.11 (Ubuntu Noble):
assignee: nobody → You-Sheng Yang (vicamo)
importance: Undecided → High
status: New → Confirmed
Changed in linux-oem-6.11 (Ubuntu Plucky):
status: New → Invalid
You-Sheng Yang (vicamo)
description: updated
You-Sheng Yang (vicamo)
Changed in linux-oem-6.11 (Ubuntu Noble):
status: Confirmed → In Progress
Changed in ipu6-drivers (Ubuntu):
assignee: nobody → You-Sheng Yang (vicamo)
importance: Undecided → High
status: Confirmed → In Progress
Changed in ipu6-drivers (Ubuntu Plucky):
assignee: nobody → You-Sheng Yang (vicamo)
importance: Undecided → High
status: Confirmed → In Progress
Changed in linux (Ubuntu):
assignee: nobody → You-Sheng Yang (vicamo)
importance: Undecided → High
status: Confirmed → In Progress
Changed in linux (Ubuntu Plucky):
assignee: nobody → You-Sheng Yang (vicamo)
importance: Undecided → High
status: Confirmed → In Progress
Changed in linux-oem-6.14 (Ubuntu Noble):
assignee: nobody → You-Sheng Yang (vicamo)
importance: Undecided → High
status: Confirmed → In Progress
Revision history for this message
You-Sheng Yang (vicamo) wrote : Re: [Bug 2107320] Re: Support Sony IMX471 camera sensor for Intel IPU7 platforms

Attached debdiffs for ipu6-drivers/questing and plucky. They are
completely identical except for the target series and debian versions.

Also uploaded to https://launchpad.net/~vicamo/+archive/ubuntu/sru for
ease of reference.

Need sponsor.

You-Sheng Yang (vicamo)
description: updated
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package ipu6-drivers - 0~git202411190607.0ad49882-0ubuntu4

---------------
ipu6-drivers (0~git202411190607.0ad49882-0ubuntu4) questing; urgency=medium

  * Support Sony IMX471 camera sensor for Intel IPU7 platforms (LP: #2107320)
    - add imx471 sensor driver
    - add imx471 into dkms

  * Fix lintian warning old-fsf-address-in-copyright-file

 -- You-Sheng Yang <email address hidden> Tue, 15 Apr 2025 14:21:23 +0800

Changed in ipu6-drivers (Ubuntu):
status: In Progress → Fix Released
Revision history for this message
Timo Aaltonen (tjaalton) wrote : Please test proposed package

Hello You-Sheng, or anyone else affected,

Accepted ipu6-drivers into plucky-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/ipu6-drivers/0~git202411190607.0ad49882-0ubuntu4~25.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-plucky to verification-done-plucky. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-plucky. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in ipu6-drivers (Ubuntu Plucky):
status: In Progress → Fix Committed
tags: added: verification-needed verification-needed-plucky
Revision history for this message
You-Sheng Yang (vicamo) wrote (last edit ):

Verified ipu6-drivers/0~git202411190607.0ad49882-0ubuntu4~25.04.1 on 202504-36638. Built against linux-oem-6.14 and linux-oem-6.11 kernel, tested gstreamer command line and webcamtests website.

tags: added: verification-done verification-done-plucky
removed: verification-needed verification-needed-plucky
AceLan Kao (acelankao)
Changed in linux-oem-6.11 (Ubuntu Noble):
status: In Progress → Fix Committed
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package ipu6-drivers - 0~git202411190607.0ad49882-0ubuntu4~25.04.1

---------------
ipu6-drivers (0~git202411190607.0ad49882-0ubuntu4~25.04.1) plucky; urgency=medium

  * Support Sony IMX471 camera sensor for Intel IPU7 platforms (LP: #2107320)
    - add imx471 sensor driver
    - add imx471 into dkms

  * Fix lintian warning old-fsf-address-in-copyright-file

 -- You-Sheng Yang <email address hidden> Tue, 15 Apr 2025 14:21:23 +0800

Changed in ipu6-drivers (Ubuntu Plucky):
status: Fix Committed → Fix Released
Revision history for this message
Timo Aaltonen (tjaalton) wrote : Update Released

The verification of the Stable Release Update for ipu6-drivers has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

AceLan Kao (acelankao)
Changed in linux-oem-6.14 (Ubuntu Noble):
status: In Progress → Fix Committed
Revision history for this message
Ubuntu Kernel Bot (ubuntu-kernel-bot) wrote :

This bug is awaiting verification that the linux-oem-6.11/6.11.0-1023.23 kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed-noble-linux-oem-6.11' to 'verification-done-noble-linux-oem-6.11'. If the problem still exists, change the tag 'verification-needed-noble-linux-oem-6.11' to 'verification-failed-noble-linux-oem-6.11'.

If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed.

See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you!

tags: added: kernel-spammed-noble-linux-oem-6.11-v2 verification-needed-noble-linux-oem-6.11
removed: verification-done
AceLan Kao (acelankao)
tags: added: verification-done-noble-linux-oem-6.11
removed: verification-needed-noble-linux-oem-6.11
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.