Comment 0 for bug 1665436

Revision history for this message
bugproxy (bugproxy) wrote :

---Problem Description---
This bugzilla is for tracking that the pciutils tool needs to be updated to support pci gen4 cards. Mellanox CX5 card is a pci gen4 card and when I do the following commands I get error. I do not see these errors with Mellanox CX4 which is pci gen3 card.
In a system, with Mellanox CX4 and CX5 IB with SRIOV:
lspci | grep Mell
0001:01:00.0 Infiniband controller: Mellanox Technologies MT28800 Family [ConnectX-5 Ex]
0001:01:00.1 Infiniband controller: Mellanox Technologies MT28800 Family [ConnectX-5 Ex]
0001:01:00.2 Infiniband controller: Mellanox Technologies MT28800 Family [ConnectX-5 Virtual Function]
0002:01:00.0 Infiniband controller: Mellanox Technologies MT27700 Family [ConnectX-4]
0002:01:00.1 Infiniband controller: Mellanox Technologies MT27700 Family [ConnectX-4]
0002:01:00.2 Infiniband controller: Mellanox Technologies MT27700 Family [ConnectX-4 Virtual Function]
If I do this command with CX4 is ok
virsh nodedev-detach pci_0002_01_00_2
Device pci_0002_01_00_2 detached
but if I do this with CX5 it fails:
virsh nodedev-detach pci_0001_01_00_2
error: Failed to detach device pci_0001_01_00_2
error: malformed 'speed' attribute: (null)

This is what I see with CX5:
lspci -vv -s 0001:01:00.2 | grep Speed
LnkCap: Port #0, Speed unknown, Width x16, ASPM not supported, Exit Latency L0s unlimited, L1 unlimited
LnkSta: Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

and this is what I see for CX4
lspci -vv -s 0002:01:00.2 | grep Speed
LnkCap: Port #0, Speed 8GT/s, Width x16, ASPM not supported, Exit Latency L0s unlimited, L1 unlimited
LnkSta: Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

---Additional Hardware Info---
using Mellanox CX5 card that is pci gen4
 lspci -vv -s 0001:01:00.0 | grep Speed
                LnkCap: Port #0, Speed unknown, Width x16, ASPM not supported, Exit Latency L0s unlimited, L1 unlimited
                LnkSta: Speed 8GT/s, Width x16, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                LnkCtl2: Target Link Speed: Unknown, EnterCompliance- SpeedDis-

Machine Type = P8

---Steps to Reproduce---
 just plug a pci gen4 card to the system and do this command
lspci -vv -s 0001:01:00.0 | grep Speed
                LnkCap: Port #0, Speed unknown, Width x16, ASPM not supported, Exit Latency L0s unlimited, L1 unlimited
                LnkSta: Speed 8GT/s, Width x16, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                LnkCtl2: Target Link Speed: Unknown, EnterCompliance- SpeedDis-
Will see the speed unknown.

Userspace tool common name: pciutils

The patch is already in the pci utils tree:
commit 9628600bbbeffc4ec6dc48943ee091a5d3eca18b
Author: Gavin Shan <email address hidden>
Date: Wed Feb 15 10:53:45 2017 +1100

    lspci: Support GEN4 speed (16GT/s)

    This enables "lspci" to show GEN4 speed (16GT/s) properly according
    to the contents in register PCI_EXP_LNKCAP, PCI_EXP_LNKSTA and
    PCI_EXP_LNKCTL2.

IBM is asking for the patch to go into 17.04 as well s 16.04.3.