syslog after restart driver: Jan 5 09:29:24 qa-h-vrt-044 systemd[1]: Reached target Host and Network Name Lookups. Jan 5 09:29:24 qa-h-vrt-044 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Jan 5 09:29:24 qa-h-vrt-044 systemd[1]: Starting Notify NFS peers of a restart... Jan 5 09:29:24 qa-h-vrt-044 rpc.statd[7847]: Version 1.2.8 starting Jan 5 09:29:24 qa-h-vrt-044 rpc.statd[7847]: Flags: TI-RPC Jan 5 09:29:24 qa-h-vrt-044 sm-notify[7846]: Version 1.2.8 starting Jan 5 09:29:24 qa-h-vrt-044 systemd[1]: Started Notify NFS peers of a restart. Jan 5 09:29:24 qa-h-vrt-044 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Jan 5 09:29:24 qa-h-vrt-044 kernel: [57029.219054] FS-Cache: Loaded Jan 5 09:29:24 qa-h-vrt-044 kernel: [57029.236040] FS-Cache: Netfs 'nfs' registered for caching Jan 5 09:29:28 qa-h-vrt-044 kernel: [57033.623710] mlx4_en: enp65s0: Close port called Jan 5 09:29:28 qa-h-vrt-044 kernel: [57033.884115] mlx4_en 0000:41:00.0: removed PHC Jan 5 09:29:28 qa-h-vrt-044 kernel: [57033.885654] mlx4_en: enp65s0d1: Close port called Jan 5 09:29:28 qa-h-vrt-044 systemd[1]: Stopping ifup for enp65s0... Jan 5 09:29:28 qa-h-vrt-044 ifdown[7896]: Cannot find device "enp65s0" Jan 5 09:29:29 qa-h-vrt-044 ifdown[7896]: Cannot find device "enp65s0" Jan 5 09:29:29 qa-h-vrt-044 systemd[1]: Stopped ifup for enp65s0. Jan 5 09:29:29 qa-h-vrt-044 systemd[1]: Stopping ifup for enp65s0d1... Jan 5 09:29:29 qa-h-vrt-044 ifdown[7961]: Cannot find device "enp65s0d1" Jan 5 09:29:29 qa-h-vrt-044 ifdown[7961]: Cannot find device "enp65s0d1" Jan 5 09:29:29 qa-h-vrt-044 systemd[1]: Stopped ifup for enp65s0d1. Jan 5 09:29:30 qa-h-vrt-044 ntpd[3243]: Deleting interface #430 enp65s0, 58.96.65.1#123, interface stats: received=0, sent=0, dropped=0, active_time=51866 secs Jan 5 09:29:30 qa-h-vrt-044 ntpd[3243]: Deleting interface #431 enp65s0d1, 59.96.65.1#123, interface stats: received=0, sent=0, dropped=0, active_time=51866 secs Jan 5 09:29:30 qa-h-vrt-044 ntpd[3243]: Deleting interface #434 enp65s0, fe80::f652:14ff:fe7a:5aa1%237#123, interface stats: received=0, sent=0, dropped=0, active_time=51864 secs Jan 5 09:29:30 qa-h-vrt-044 ntpd[3243]: Deleting interface #435 enp65s0d1, fe80::f652:14ff:fe7a:5aa2%238#123, interface stats: received=0, sent=0, dropped=0, active_time=51864 secs Jan 5 09:29:30 qa-h-vrt-044 kernel: [57035.623955] mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014) Jan 5 09:29:30 qa-h-vrt-044 kernel: [57035.623975] mlx4_core: Initializing 0000:41:00.0 Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.567497] mlx4_core 0000:41:00.0: PCIe link speed is 8.0GT/s, device supports 8.0GT/s Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.567499] mlx4_core 0000:41:00.0: PCIe link width is x8, device supports x8 Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.744910] mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014) Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.745014] mlx4_en 0000:41:00.0: Activating port:1 Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.753650] mlx4_en: 0000:41:00.0: Port 1: Using 192 TX rings Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.753651] mlx4_en: 0000:41:00.0: Port 1: Using 8 RX rings Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.753653] mlx4_en: 0000:41:00.0: Port 1: frag:0 - size:1522 prefix:0 stride:1536 Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.762547] mlx4_en: 0000:41:00.0: Port 1: Initializing port Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.762853] mlx4_en 0000:41:00.0: registered PHC clock Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.765187] mlx4_en 0000:41:00.0: Activating port:2 Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.765637] mlx4_core 0000:41:00.0 enp65s0: renamed from eth0 Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.773726] mlx4_en: 0000:41:00.0: Port 2: Using 192 TX rings Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.773728] mlx4_en: 0000:41:00.0: Port 2: Using 8 RX rings Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.773730] mlx4_en: 0000:41:00.0: Port 2: frag:0 - size:1522 prefix:0 stride:1536 Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.782636] mlx4_en: 0000:41:00.0: Port 2: Initializing port Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.798325] mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v2.2-1 (Feb 2014) Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.799448] mlx4_ib_add: counter index 2 for port 1 allocated 1 Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.799450] mlx4_ib_add: counter index 3 for port 2 allocated 1 Jan 5 09:29:35 qa-h-vrt-044 systemd[1]: Started ifup for enp65s0. Jan 5 09:29:35 qa-h-vrt-044 systemd[1]: Found device MT27520 Family [ConnectX-3 Pro]. Jan 5 09:29:35 qa-h-vrt-044 kernel: [57040.905306] mlx4_en: enp65s0: frag:0 - size:1522 prefix:0 stride:1536 Jan 5 09:29:36 qa-h-vrt-044 kernel: [57041.013717] IPv6: ADDRCONF(NETDEV_UP): enp65s0: link is not ready Jan 5 09:29:36 qa-h-vrt-044 kernel: [57041.014037] mlx4_core 0000:41:00.0 enp65s0d1: renamed from eth0 Jan 5 09:29:36 qa-h-vrt-044 systemd[1]: Reloading OpenBSD Secure Shell server. Jan 5 09:29:36 qa-h-vrt-044 systemd[1]: Reloaded OpenBSD Secure Shell server. Jan 5 09:29:36 qa-h-vrt-044 systemd[1]: Started ifup for enp65s0d1. Jan 5 09:29:36 qa-h-vrt-044 systemd[1]: Found device MT27520 Family [ConnectX-3 Pro]. Jan 5 09:29:36 qa-h-vrt-044 kernel: [57041.118709] mlx4_en: enp65s0d1: frag:0 - size:1522 prefix:0 stride:1536 Jan 5 09:29:36 qa-h-vrt-044 kernel: [57041.330182] IPv6: ADDRCONF(NETDEV_UP): enp65s0d1: link is not ready Jan 5 09:29:36 qa-h-vrt-044 systemd[1]: Reloading OpenBSD Secure Shell server. Jan 5 09:29:36 qa-h-vrt-044 libvirtd[3159]: udev_monitor_receive_device returned NULL Jan 5 09:29:36 qa-h-vrt-044 systemd[1]: Reloaded OpenBSD Secure Shell server. Jan 5 09:29:40 qa-h-vrt-044 systemd[1]: Stopping ifup for enp4s0f0... Jan 5 09:29:40 qa-h-vrt-044 ifdown[8414]: Cannot find device "enp4s0f0" Jan 5 09:29:40 qa-h-vrt-044 ifdown[8414]: Cannot find device "enp4s0f0" Jan 5 09:29:40 qa-h-vrt-044 systemd[1]: Stopped ifup for enp4s0f0. Jan 5 09:29:41 qa-h-vrt-044 systemd[1]: Stopping ifup for enp4s0f1... Jan 5 09:29:41 qa-h-vrt-044 ifdown[8456]: Cannot find device "enp4s0f1" Jan 5 09:29:41 qa-h-vrt-044 ifdown[8456]: Cannot find device "enp4s0f1" Jan 5 09:29:41 qa-h-vrt-044 systemd[1]: Stopped ifup for enp4s0f1. Jan 5 09:29:42 qa-h-vrt-044 systemd[1]: Stopping ifup for enp6s0f0... Jan 5 09:29:42 qa-h-vrt-044 ifdown[8503]: Cannot find device "enp6s0f0" Jan 5 09:29:42 qa-h-vrt-044 ifdown[8503]: Cannot find device "enp6s0f0" Jan 5 09:29:42 qa-h-vrt-044 systemd[1]: Stopped ifup for enp6s0f0. Jan 5 09:29:42 qa-h-vrt-044 kernel: [57047.320721] mlx4_en: enp65s0: Link Up Jan 5 09:29:42 qa-h-vrt-044 kernel: [57047.425673] mlx4_en: enp65s0d1: Link Up Jan 5 09:29:42 qa-h-vrt-044 kernel: [57047.672235] IPv6: ADDRCONF(NETDEV_CHANGE): enp65s0: link becomes ready Jan 5 09:29:42 qa-h-vrt-044 kernel: [57047.672446] IPv6: ADDRCONF(NETDEV_CHANGE): enp65s0d1: link becomes ready Jan 5 09:29:42 qa-h-vrt-044 systemd[1]: Stopping ifup for enp6s0f1... Jan 5 09:29:42 qa-h-vrt-044 ifdown[8548]: Cannot find device "enp6s0f1" Jan 5 09:29:42 qa-h-vrt-044 ifdown[8548]: Cannot find device "enp6s0f1" Jan 5 09:29:42 qa-h-vrt-044 systemd[1]: Stopped ifup for enp6s0f1. Jan 5 09:29:42 qa-h-vrt-044 kernel: [57047.851795] (0000:06:00.1): E-Switch: disable SRIOV: active vports(1) mode(0) Jan 5 09:29:42 qa-h-vrt-044 kernel: [57047.855021] (0000:06:00.1): E-Switch: cleanup Jan 5 09:29:43 qa-h-vrt-044 kernel: [57048.874889] (0000:06:00.0): E-Switch: disable SRIOV: active vports(1) mode(0) Jan 5 09:29:43 qa-h-vrt-044 kernel: [57048.876446] (0000:06:00.0): E-Switch: cleanup Jan 5 09:29:44 qa-h-vrt-044 kernel: [57049.939679] (0000:04:00.1): E-Switch: disable SRIOV: active vports(1) mode(0) Jan 5 09:29:44 qa-h-vrt-044 kernel: [57049.943203] (0000:04:00.1): E-Switch: cleanup Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Listen normally on 436 enp65s0 58.96.65.1:123 Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Listen normally on 437 enp65s0d1 59.96.65.1:123 Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Listen normally on 438 enp65s0 [fe80::f652:14ff:fe7a:5aa1%239]:123 Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Listen normally on 439 enp65s0d1 [fe80::f652:14ff:fe7a:5aa2%240]:123 Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Deleting interface #412 enp4s0f0, 50.96.65.1#123, interface stats: received=0, sent=0, dropped=0, active_time=52015 secs Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Deleting interface #413 enp4s0f1, 54.96.65.1#123, interface stats: received=0, sent=0, dropped=0, active_time=52015 secs Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Deleting interface #414 enp6s0f0, 57.96.65.1#123, interface stats: received=0, sent=0, dropped=0, active_time=52015 secs Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Deleting interface #415 enp6s0f1, 56.96.65.1#123, interface stats: received=0, sent=0, dropped=0, active_time=52015 secs Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Deleting interface #416 enp4s0f0, fe80::e61d:2dff:fef3:dde4%227#123, interface stats: received=0, sent=0, dropped=0, active_time=52015 secs Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Deleting interface #417 enp4s0f1, fe80::e61d:2dff:fef3:dde5%228#123, interface stats: received=0, sent=0, dropped=0, active_time=52015 secs Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Deleting interface #418 enp6s0f0, fe80::e61d:2dff:fea3:a9c8%229#123, interface stats: received=0, sent=0, dropped=0, active_time=52015 secs Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: Deleting interface #419 enp6s0f1, fe80::e61d:2dff:fea3:a9c9%230#123, interface stats: received=0, sent=0, dropped=0, active_time=52015 secs Jan 5 09:29:45 qa-h-vrt-044 ntpd[3243]: new interface(s) found: waking up resolver Jan 5 09:29:45 qa-h-vrt-044 kernel: [57050.945152] (0000:04:00.0): E-Switch: disable SRIOV: active vports(1) mode(0) Jan 5 09:29:45 qa-h-vrt-044 kernel: [57050.946459] (0000:04:00.0): E-Switch: cleanup Jan 5 09:29:47 qa-h-vrt-044 kernel: [57051.982647] mlx5_core 0000:04:00.0: firmware version: 14.17.2020 Jan 5 09:29:47 qa-h-vrt-044 kernel: [57052.825482] (0000:04:00.0): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384) Jan 5 09:29:47 qa-h-vrt-044 kernel: [57052.827413] mlx5_core 0000:04:00.1: firmware version: 14.17.2020 Jan 5 09:29:48 qa-h-vrt-044 kernel: [57053.688495] (0000:04:00.1): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384) Jan 5 09:29:48 qa-h-vrt-044 kernel: [57053.690831] mlx5_core 0000:06:00.0: firmware version: 12.17.2020 Jan 5 09:29:49 qa-h-vrt-044 kernel: [57054.570904] (0000:06:00.0): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384) Jan 5 09:29:49 qa-h-vrt-044 kernel: [57054.573173] mlx5_core 0000:06:00.1: firmware version: 12.17.2020 Jan 5 09:29:50 qa-h-vrt-044 kernel: [57055.434365] (0000:06:00.1): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384) Jan 5 09:29:50 qa-h-vrt-044 kernel: [57055.437579] mlx5_core 0000:04:00.0: MLX5E: StrdRq(1) RqSz(16) StrdSz(64) RxCqeCmprss(0) Jan 5 09:29:50 qa-h-vrt-044 kernel: [57055.569568] mlx5_core 0000:04:00.0 enp4s0f0: renamed from eth0 Jan 5 09:29:50 qa-h-vrt-044 kernel: [57055.571774] mlx5_core 0000:04:00.1: MLX5E: StrdRq(1) RqSz(16) StrdSz(64) RxCqeCmprss(0) Jan 5 09:29:50 qa-h-vrt-044 systemd[1]: Started ifup for enp4s0f0. Jan 5 09:29:50 qa-h-vrt-044 systemd[1]: Found device MT27710 Family [ConnectX-4 Lx]. Jan 5 09:29:50 qa-h-vrt-044 kernel: [57055.722053] mlx5_core 0000:06:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(1) RxCqeCmprss(0) Jan 5 09:29:50 qa-h-vrt-044 kernel: [57055.922609] mlx5_core 0000:04:00.0 enp4s0f0: Link up Jan 5 09:29:50 qa-h-vrt-044 kernel: [57055.928001] mlx5_core 0000:04:00.1 enp4s0f1: renamed from eth0 Jan 5 09:29:50 qa-h-vrt-044 kernel: [57055.961275] mlx5_core 0000:06:00.0 enp6s0f0: renamed from eth1 Jan 5 09:29:50 qa-h-vrt-044 kernel: [57055.964089] mlx5_core 0000:06:00.1: MLX5E: StrdRq(0) RqSz(1024) StrdSz(1) RxCqeCmprss(0) Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Reloading OpenBSD Secure Shell server. Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Reloaded OpenBSD Secure Shell server. Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Started ifup for enp4s0f1. Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Found device MT27710 Family [ConnectX-4 Lx]. Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Started ifup for enp6s0f0. Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Found device MT27700 Family [ConnectX-4]. Jan 5 09:29:51 qa-h-vrt-044 kernel: [57056.291877] mlx5_core 0000:04:00.1 enp4s0f1: Link up Jan 5 09:29:51 qa-h-vrt-044 kernel: [57056.303124] mlx5_ib: Mellanox Connect-IB Infiniband driver v2.2-1 (Feb 2014) Jan 5 09:29:51 qa-h-vrt-044 libvirtd[3159]: nl_recv returned with error: No buffer space available Jan 5 09:29:51 qa-h-vrt-044 libvirtd[3159]: udev_monitor_receive_device returned NULL Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Reloading OpenBSD Secure Shell server. Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Reloaded OpenBSD Secure Shell server. Jan 5 09:29:51 qa-h-vrt-044 kernel: [57056.459696] mlx5_core 0000:06:00.0 enp6s0f0: Link up Jan 5 09:29:51 qa-h-vrt-044 kernel: [57056.461535] mlx5_core 0000:06:00.1 enp6s0f1: renamed from eth0 Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Reloading OpenBSD Secure Shell server. Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Reloaded OpenBSD Secure Shell server. Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Started ifup for enp6s0f1. Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Found device MT27700 Family [ConnectX-4]. Jan 5 09:29:51 qa-h-vrt-044 kernel: [57056.745896] mlx5_core 0000:06:00.1 enp6s0f1: Link up Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Reloading OpenBSD Secure Shell server. Jan 5 09:29:51 qa-h-vrt-044 systemd[1]: Reloaded OpenBSD Secure Shell server. Jan 5 09:29:51 qa-h-vrt-044 libvirtd[3159]: nl_recv returned with error: No buffer space available Jan 5 09:29:51 qa-h-vrt-044 libvirtd[3159]: udev_monitor_receive_device returned NULL Jan 5 09:29:55 qa-h-vrt-044 ntpd[3243]: Listen normally on 440 enp4s0f0 50.96.65.1:123 Jan 5 09:29:55 qa-h-vrt-044 ntpd[3243]: Listen normally on 441 enp4s0f1 54.96.65.1:123 Jan 5 09:29:55 qa-h-vrt-044 ntpd[3243]: Listen normally on 442 enp6s0f0 57.96.65.1:123 Jan 5 09:29:55 qa-h-vrt-044 ntpd[3243]: Listen normally on 443 enp6s0f1 56.96.65.1:123 Jan 5 09:29:55 qa-h-vrt-044 ntpd[3243]: Listen normally on 444 enp4s0f0 [fe80::e61d:2dff:fef3:dde4%241]:123 Jan 5 09:29:55 qa-h-vrt-044 ntpd[3243]: Listen normally on 445 enp4s0f1 [fe80::e61d:2dff:fef3:dde5%242]:123 Jan 5 09:29:55 qa-h-vrt-044 ntpd[3243]: Listen normally on 446 enp6s0f0 [fe80::e61d:2dff:fea3:a9c8%243]:123 Jan 5 09:29:55 qa-h-vrt-044 ntpd[3243]: Listen normally on 447 enp6s0f1 [fe80::e61d:2dff:fea3:a9c9%244]:123 Jan 5 09:29:55 qa-h-vrt-044 ntpd[3243]: new interface(s) found: waking up resolver The server indeed have cards with SRIOV capabilities. In total, the server contains about 4 cards. How can I show the full libvirt, so It will help you to check the issue?