mlx5_core ovs/ovn hardware offload - asymmetric network performance

Bug #1907447 reported by James Page
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
charm-ovn-chassis
New
Undecided
Unassigned

Bug Description

Ubuntu: Focal
OpenStack: Ussuri
OVN: 20.03.1
OVS: 2.12.1

Mellanox ConnectX 5 Ex cards connected to 100G TOR Cumulus switches in MLAG configuration.

Leaf and Spine network topology between racks.

8 core instances
Ubuntu: Focal

iperf -P4 -c XXXX -e

performance between to instances on different hypervisors is consistent by asymmetric - ~90Gbps in one direction, and ~30Gbps in the other.

some dmesg entries that might be pertinent (similar messages on both hypervisors):

[92583.318283] mlx5_core 0000:81:00.1 enp129s0f1: Matching on GENEVE options: can't match on 0 data field
[92583.318286] mlx5_core 0000:81:00.0 enp129s0f0: Matching on GENEVE options: can't match on 0 data field
[92693.121984] mlx5_core 0000:81:00.1: cmd_work_handler:887:(pid 1137976): failed to allocate command entry
[92693.131803] vport 31 error -11 reading stats

VF's for hardware offloaded ports are allocated on enp129s0f0

Monitoring the representator port on the hypervisor the initial TCP setup is observed but not the main iperf test (so offloading appears to be working).

Tags: ps5
Revision history for this message
James Page (james-page) wrote :

[94427.800683] mlx5_core 0000:81:00.0 enp129s0f0: Matching on GENEVE options: can't match on 0 data field

may be a clue here as I only see that on one side of the link.

tags: added: ps5
description: updated
James Page (james-page)
summary: - mlx5_core hardware offload - asymmetric network performance
+ mlx5_core ovs/ovn hardware offload - asymmetric network performance
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.