[SRU Justification]
[Impact]
There are new platforms with MIPI camera based on Intel IPU6(Imaging
Processing Unit version 6) currently unsupported in Ubuntu.
[Fix]
Intel IPU6 can be enabled by integration of following kernel driver,
firmware, userspace HAL libraries as well as a GStreamer source element:
* https://github.com/intel/ipu6-drivers
* https://github.com/intel/ipu6-camera-bins
* https://github.com/intel/ipu6-camera-hal
* https://github.com/intel/icamerasrc
This patchset took kernel patches from intel/ipu6-drivers.
[Test Case]
With kernel/firmware properly installed, the hardware should be ready for
further development:
$ dmesg | grep ipu
intel-ipu6 intel-ipu: enabling device (0000 -> 0002)
intel-ipu6 intel-ipu: Device 0x9a19 (rev: 0x1)
intel-ipu6 intel-ipu: physical base address 0x6054000000
intel-ipu6 intel-ipu: mapped as: 0x0000000097793328
intel-ipu6 intel-ipu: IPU in secure mode
intel-ipu6 intel-ipu: IPC reset done
intel-ipu6 intel-ipu: cpd file name: intel/ipu6_fw.bin
intel-ipu6 intel-ipu: FW version: 20201222
intel-ipu6 intel-ipu: Sending BOOT_LOAD to CSE
intel-ipu6 intel-ipu: Sending AUTHENTICATE_RUN to CSE
intel-ipu6 intel-ipu: CSE authenticate_run done
intel-ipu6 intel-ipu: IPU driver version 1.0
intel-ipu6-psys intel-ipu6-psys0: pkg_dir entry count:8
intel-ipu6-psys intel-ipu6-psys0: psys probe minor: 0
intel-ipu6-isys intel-ipu6-isys0: bind ov01a1s 20-0036 nlanes is 1
port is 1
intel-ipu6-isys intel-ipu6-isys0: All sensor registration completed.
intel-ipu6-isys intel-ipu6-isys0: stream on ov01a1s 20-0036
There should be nearly 24 video4linux devices created under /dev.
[Where problems could occur]
MIPI camera through Intel IPU6 takes also firmware blobs loaded in
runtime from user space, addtional softwares are also required to
fully enable it for oridinary use. The exposed video devices are hidden
from general users and a relay daemon+v4l2loopback is used to enable
use from existing applications.
>From kernel's point of view, there is still a known issue that it takes
root priviledge to access these devices.
[Other Info]
So far Intel has no plan to commit this driver to upstream yet, so it's
only nominated for oem-5.10. It will only be nominated to generic
kernels when the plan/requirements have changed.
The original driver Kconfig would disable VIDEO_IPU3_CIO2, but that's
reverted to avoid unnecessary changes to existing users.
========== original bug description ==========
The Intel imaging processing unit version 6, found in Intel SoCs and used for capturing images and video from a camera sensor is enabled by integration of following kernel driver, firmware, userspace HAL libraries as well as a GStreamer source element:
* https://github.com/intel/ipu6-drivers
* https://github.com/intel/ipu6-camera-bins
* https://github.com/intel/ipu6-camera-hal
* https://github.com/intel/icamerasrc
With all components properly installed, the hardware should be ready for further development:
intel-ipu6 intel-ipu: enabling device (0000 -> 0002)
intel-ipu6 intel-ipu: Device 0x9a19 (rev: 0x1)
intel-ipu6 intel-ipu: physical base address 0x6054000000
intel-ipu6 intel-ipu: mapped as: 0x0000000097793328
intel-ipu6 intel-ipu: IPU in secure mode
intel-ipu6 intel-ipu: IPC reset done
intel-ipu6 intel-ipu: cpd file name: intel/ipu6_fw.bin
intel-ipu6 intel-ipu: FW version: 20201222
intel-ipu6 intel-ipu: Sending BOOT_LOAD to CSE
intel-ipu6 intel-ipu: Sending AUTHENTICATE_RUN to CSE
intel-ipu6 intel-ipu: CSE authenticate_run done
intel-ipu6 intel-ipu: IPU driver version 1.0
intel-ipu6-psys intel-ipu6-psys0: pkg_dir entry count:8
intel-ipu6-psys intel-ipu6-psys0: psys probe minor: 0
intel-ipu6-isys intel-ipu6-isys0: bind ov01a1s 20-0036 nlanes is 1 port is 1
intel-ipu6-isys intel-ipu6-isys0: All sensor registration completed.
intel-ipu6-isys intel-ipu6-isys0: stream on ov01a1s 20-0036
This one equips an OV01A1S sensor, and HM11B1 is also supported.
---
ProblemType: Bug
ApportVersion: 2.20.11-0ubuntu27.16
Architecture: amd64
AudioDevicesInUse:
USER PID ACCESS COMMAND
/dev/snd/controlC0: u 1721 F.... pulseaudio
CasperMD5CheckResult: skip
Dependencies:
DistributionChannelDescriptor:
# This is the distribution channel descriptor for the OEM CDs
# For more information see http://wiki.ubuntu.com/DistributionChannelDescriptor
canonical-oem-somerville-focal-amd64-20200502-85+fossa-mewtwo+X74
DistroRelease: Ubuntu 20.04
InstallationDate: Installed on 2021-03-25 (0 days ago)
InstallationMedia: Ubuntu 20.04 "Focal" - Build amd64 LIVE Binary 20200502-05:58
MachineType: Dell Inc. Latitude 9420
Package: linux-oem-5.10
PackageArchitecture: all
ProcEnviron:
TERM=xterm-256color
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcFB: 0 i915drmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-5.10.0-1019-oem root=UUID=f7f15afa-43c6-46b8-b917-89735875cb39 ro
ProcVersionSignature: Ubuntu 5.10.0-1019.20-oem 5.10.18
PulseList: Error: command ['pacmd', 'list'] failed with exit code 1: No PulseAudio daemon running, or not running as session daemon.
RelatedPackageVersions:
linux-restricted-modules-5.10.0-1019-oem N/A
linux-backports-modules-5.10.0-1019-oem N/A
linux-firmware 1.187.10+lp1921345.1.intel.ipu6
Tags: focal third-party-packages
Uname: Linux 5.10.0-1019-oem x86_64
UnreportableReason: This is not an official Ubuntu package. Please remove any third party package and try again.
UpgradeStatus: No upgrade log present (probably fresh install)
UserGroups: N/A
_MarkForUpload: True
dmi.bios.date: 01/25/2021
dmi.bios.release: 89.5
dmi.bios.vendor: Dell Inc.
dmi.bios.version: 89.5.23
dmi.board.vendor: Dell Inc.
dmi.chassis.type: 10
dmi.chassis.vendor: Dell Inc.
dmi.modalias: dmi:bvnDellInc.:bvr89.5.23:bd01/25/2021:br89.5:svnDellInc.:pnLatitude9420:pvr:rvnDellInc.:rn:rvr:cvnDellInc.:ct10:cvr:
dmi.product.family: Latitude
dmi.product.name: Latitude 9420
dmi.product.sku: 0A32
dmi.sys.vendor: Dell Inc.
PPA: https:/