The infiniband port can not display during ubuntu server 22.04 installation

[shangsong]

SUMMARY: Jammy ISO is not loading ib_iboip module when a system contains an Infiniband device. Also the ISO is missing the rdma-core stack that is necessary for interacting with IB devices.

1.Fresh install the ubuntu server 22.04 on Lenovo server with "ThinkSystem Mellanox ConnectX-6 HDR100/100GbE QSFP56 2-port PCIe VPI Adapter" and "infiniband mode"

2.The network port about infiniband(ibX) can not be found.

3.The network port can be found after finish the installation.

The other info:
The network port(ib0/ib1) can be detected during RHEL 8.5 installation

[shangsong (shangsong2)]

The module ib_ipoib is not loaded during installation, is this an known issue and whether there has already method to workaround it?

[Jeff Lane  (bladernr)]

can you boot the installer, drop to a shell before starting install, load ib_ipoib, and then does the installer see the IB device?

[Jeff Lane  (bladernr)]

Adding a kernel task, two possible issues:
1: installer env is missing a driver
2: if the driver is loaded, does subiquity see and manage the device?

[Ubuntu Kernel Bot (ubuntu-kernel-bot)]

This bug is missing log files that will aid in diagnosing the problem. While running an Ubuntu kernel (not a mainline or third-party kernel) please enter the following command in a terminal window:

apport-collect 1968716

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

[shangsong (shangsong2)]

Hi Jeff,
  The IB device can be seen by installer subiquity after load ib_ipoib manually.

[shangsong (shangsong2)]

Sorry for the following inaccurate decription:
3.The network port can be found after finish the installation.
-->The IB device can not be seen directly after the installation, it still need install package "rdma-core" (The package can not be found in the ISO image, install it via command "apt install rdma-core"), after check the package , it will generate /etc/rdma/modules/infiniband.conf and the config file will load ib_ipoib automatically when OS boot.

[shangsong (shangsong2)]

Fail to run apport-collect, would you please check the sosreport firstly?

[shangsong (shangsong2)]

Hi Jeff,
  Although now we can load the module manually when install with ISO.
But it is impossible for infiniband PXE installation. Therefore if there has a method to load the module automatically during installation or the future release can add the module into modprobe list?

[Jeff Lane  (bladernr)]

Is it possible to drop to a shell during the install and run `apport-collect 1968716` before you add the rdma-core and ib_ipoib modules?

[Jeff Lane  (bladernr)]

Also, per your Comment #10 you have gone from teh ISO to PXE booting which are two different things... Have you tried this in MAAS? Does MAAS see the IB devices when commissioning, and can you deploy using the IB device to PXE via MAAS?