|-------------------------------------------------------------------------------+----------------------------------------------------------------|
| client (saenger) - 10.228.68.199                                              | server (segers) - 10.228.68.119                                |
|-------------------------------------------------------------------------------+----------------------------------------------------------------|
| sudo modprobe ib_umad                                                         |                                                                |
| sudo modprobe hns-roce-hw-v2                                                  |                                                                |
| sudo apt install -y perftest                                                  | sudo modprobe ib_umad                                          |
|                                                                               | sudo modprobe hns-roce-hw-v2                                   |
|                                                                               | sudo apt install -y perftest                                   |
| ib_atomic_bw -d hns_0 -A CMP_AND_SWAP -e &                                    |                                                                |
|                                                                               | ib_atomic_bw -d hns_0 -A CMP_AND_SWAP -e &                     |
|                                                                               | echo 7 > /proc/sys/kernel/printk                               |
|                                                                               | echo 1 > /sys/class/net/enp189s0f0/device/sriov_numvfs         |
|                                                                               | echo help > /sys/kernel/debug/hns3/0000\:bd\:00.0/cmd          |
|                                                                               | ethtool -s enp189s0f0 msglvl 0x0                               |
|                                                                               | ethtool -s enp189s0f0 msglvl probe on                          |
|                                                                               | fping 10.228.68.199 # OK                                       |
|                                                                               | sudo modprobe rdma_ucm # needed for next command               |
|                                                                               | ib_send_bw -d hns_0 -x 0 -c RC --use-srq -R &                  |
|                                                                               | ib_send_bw -d hns_0 -x 0 -c RC --use-srq -R 10.228.68.119 &    |
| ib_send_bw -d hns_0 -x 0 -c RC --use-srq -R --run_infinitely &                |                                                                |
| ib_send_bw -d hns_0 -x 0 -c RC --use-srq -R 10.228.68.119 --run_infinitely[*] |                                                                |
|                                                                               | sudo apt install -y netperf                                    |
|                                                                               | sudo ethtool -N enp189s0f0 rx-flow-hash udp4 sdfn              |
|                                                                               | watch -d -n 1 "ethtool -S enp189s0f0 | grep rxq | grep pktnum" |
|                                                                               | sudo ethtool -N enp189s0f0 rx-flow-hash udp4 d                 |
| sudo apt install -y netperf                                                   |                                                                |
| netperf -H 10.228.68.119 -t UDP_STREAM -l 10 -- -m 10240                      |                                                                |
| netperf -H 10.228.68.119 -t UDP_STREAM -l 10 -- -m 10240                      |                                                                |
| netperf -H 10.228.68.119 -t UDP_STREAM -l 10 -- -m 10240                      |                                                                |
|                                                                               | ^c previous ib_send_bw commands                                |
|                                                                               | ib_send_bw -d hns_0 -n 5 -s1024 -S 3 -x 3                      |
| ib_send_bw -d hns_0 -n 5 -s1024 -S 3 -x 3 10.228.68.11                        |                                                                |
| sudo ufw disable                                                              |                                                                |
|                                                                               | sudo ufw disable                                               |

[*]
Command failed:
hr_qp->port_num= 0x1
Unexpected CM event bl blka 8
Unable to perform rdma_client function
Unable to init the socket connection