We suspect this is a device (hw/fw) issue, however, not NetworkManager
or kernel (driver bnxt_en). I've added the kernel for the driver impact
(just in case, for now). This is really to eliminate all other causes
and confirm whether it's the device at root cause).
NIC
--------
Product Name: Broadcom Adv. Dual 10G SFP+ Ethernet
5e:00.1 Ethernet controller: Broadcom Inc. and subsidiaries
BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller (rev 01)
We suspect this is a device (hw/fw) issue, however, not NetworkManager
or kernel (driver bnxt_en). I've added the kernel for the driver impact
(just in case, for now). This is really to eliminate all other causes
and confirm whether it's the device at root cause).
NIC
--------
Product Name: Broadcom Adv. Dual 10G SFP+ Ethernet
5e:00.1 Ethernet controller: Broadcom Inc. and subsidiaries
BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller (rev 01)
NIC Driver/FW rom-version: statistics: yes
-------------------
driver: bnxt_en
version: 1.10.0
firmware-version: 214.0.253.1/pkg 21.40.25.31
expansion-
bus-info: 0000:5e:00.1
supports-
Kernel
---------
5.0.0-37-generic #40~18.04.1-Ubuntu SMP Thu Nov 14 12:06:39 UTC 2019
(appears to be an issue on all kernel versions)
Environment Configuration ------- ------- ------- -
-------
active-backup bonding mode
(having the active backup up *might* potentially be the problem,
but it might just be the device itself).
The exact same distro, kernel, applications and configuration
works fine with a different NIC (Broadcom 10g bnx2x).
There were quite a few total tpa_abort stats counts (1118473)
during the duration of a 2 minute iperf test.
Hoping to get more information from other users seeing the
same issue.