we get sporadic networking adapter resets resulting in a loss of service. kernel log:
Oct 28 10:57:08 puno01 kernel: [2306272.568264] ffff881f35400000 ffff881f37e30940 0000000000000008 0000000000000024
Oct 28 10:57:08 puno01 kernel: [2306272.568274] Call Trace:
Oct 28 10:57:08 puno01 kernel: [2306272.568276] <IRQ> [<ffffffff81729f76>] dump_stack+0x64/0x82
Oct 28 10:57:08 puno01 kernel: [2306272.568299] [<ffffffff8106987d>] warn_slowpath_common+0x7d/0xa0
Oct 28 10:57:08 puno01 kernel: [2306272.568305] [<ffffffff810698ec>] warn_slowpath_fmt+0x4c/0x50
Oct 28 10:57:08 puno01 kernel: [2306272.568312] [<ffffffff8164d786>] dev_watchdog+0x276/0x280
Oct 28 10:57:08 puno01 kernel: [2306272.568318] [<ffffffff8164d510>] ? dev_graft_qdisc+0x80/0x80
Oct 28 10:57:08 puno01 kernel: [2306272.568327] [<ffffffff810767d6>] call_timer_fn+0x36/0x150
Oct 28 10:57:08 puno01 kernel: [2306272.568332] [<ffffffff8164d510>] ? dev_graft_qdisc+0x80/0x80
Oct 28 10:57:08 puno01 kernel: [2306272.568338] [<ffffffff810777cf>] run_timer_softirq+0x21f/0x310
Oct 28 10:57:08 puno01 kernel: [2306272.568347] [<ffffffff8106ee9c>] __do_softirq+0xfc/0x310
Oct 28 10:57:08 puno01 kernel: [2306272.568354] [<ffffffff8106f425>] irq_exit+0x105/0x110
Oct 28 10:57:08 puno01 kernel: [2306272.568365] [<ffffffff8143a755>] xen_evtchn_do_upcall+0x35/0x50
Oct 28 10:57:08 puno01 kernel: [2306272.568378] [<ffffffff8173c53e>] xen_do_hypervisor_callback+0x1e/0x30
Oct 28 10:57:08 puno01 kernel: [2306272.568380] <EOI> [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
Oct 28 10:57:08 puno01 kernel: [2306272.568393] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
Oct 28 10:57:08 puno01 kernel: [2306272.568402] [<ffffffff8100ad70>] ? xen_safe_halt+0x10/0x20
Oct 28 10:57:08 puno01 kernel: [2306272.568414] [<ffffffff8101daff>] ? default_idle+0x1f/0x100
Oct 28 10:57:08 puno01 kernel: [2306272.568420] [<ffffffff8101e416>] ? arch_cpu_idle+0x26/0x30
Oct 28 10:57:08 puno01 kernel: [2306272.568429] [<ffffffff810c1be1>] ? cpu_startup_entry+0xc1/0x2b0
Oct 28 10:57:08 puno01 kernel: [2306272.568438] [<ffffffff81011178>] ? cpu_bringup_and_idle+0x18/0x20
Oct 28 10:57:08 puno01 kernel: [2306272.568441] ---[ end trace 52192aef6937b28d ]---
Oct 28 10:57:08 puno01 kernel: [2306272.568633] igb 0000:04:00.0 eth0: Reset adapter
Oct 28 10:57:08 puno01 kernel: [2306272.586016] xenbr0: port 1(eth0) entered disabled state
Oct 28 10:57:08 puno01 kernel: [2306272.600491] igb 0000:04:00.1 eth1: Reset adapter
Oct 28 10:57:12 puno01 kernel: [2306276.123402] igb: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
:
we moved from kernel 3.13.0-88-generic to 4.4.0-45-generic, but the issue keeps reapearing sporadicly (apr 1 - 2 times a month). so the adapter reset happend on
using ubuntu Ubuntu 14.04 LTS
we get sporadic networking adapter resets resulting in a loss of service. kernel log:
Oct 28 10:57:08 puno01 kernel: [2306272.568264] ffff881f35400000 ffff881f37e30940 0000000000000008 0000000000000024 f76>] dump_stack+ 0x64/0x82 87d>] warn_slowpath_ common+ 0x7d/0xa0 8ec>] warn_slowpath_ fmt+0x4c/ 0x50 786>] dev_watchdog+ 0x276/0x280 510>] ? dev_graft_ qdisc+0x80/ 0x80 7d6>] call_timer_ fn+0x36/ 0x150 510>] ? dev_graft_ qdisc+0x80/ 0x80 7cf>] run_timer_ softirq+ 0x21f/0x310 e9c>] __do_softirq+ 0xfc/0x310 425>] irq_exit+ 0x105/0x110 755>] xen_evtchn_ do_upcall+ 0x35/0x50 53e>] xen_do_ hypervisor_ callback+ 0x1e/0x30 3aa>] ? xen_hypercall_ sched_op+ 0xa/0x20 3aa>] ? xen_hypercall_ sched_op+ 0xa/0x20 d70>] ? xen_safe_ halt+0x10/ 0x20 aff>] ? default_ idle+0x1f/ 0x100 416>] ? arch_cpu_ idle+0x26/ 0x30 be1>] ? cpu_startup_ entry+0xc1/ 0x2b0 178>] ? cpu_bringup_ and_idle+ 0x18/0x20
Oct 28 10:57:08 puno01 kernel: [2306272.568274] Call Trace:
Oct 28 10:57:08 puno01 kernel: [2306272.568276] <IRQ> [<ffffffff81729
Oct 28 10:57:08 puno01 kernel: [2306272.568299] [<ffffffff81069
Oct 28 10:57:08 puno01 kernel: [2306272.568305] [<ffffffff81069
Oct 28 10:57:08 puno01 kernel: [2306272.568312] [<ffffffff8164d
Oct 28 10:57:08 puno01 kernel: [2306272.568318] [<ffffffff8164d
Oct 28 10:57:08 puno01 kernel: [2306272.568327] [<ffffffff81076
Oct 28 10:57:08 puno01 kernel: [2306272.568332] [<ffffffff8164d
Oct 28 10:57:08 puno01 kernel: [2306272.568338] [<ffffffff81077
Oct 28 10:57:08 puno01 kernel: [2306272.568347] [<ffffffff8106e
Oct 28 10:57:08 puno01 kernel: [2306272.568354] [<ffffffff8106f
Oct 28 10:57:08 puno01 kernel: [2306272.568365] [<ffffffff8143a
Oct 28 10:57:08 puno01 kernel: [2306272.568378] [<ffffffff8173c
Oct 28 10:57:08 puno01 kernel: [2306272.568380] <EOI> [<ffffffff81001
Oct 28 10:57:08 puno01 kernel: [2306272.568393] [<ffffffff81001
Oct 28 10:57:08 puno01 kernel: [2306272.568402] [<ffffffff8100a
Oct 28 10:57:08 puno01 kernel: [2306272.568414] [<ffffffff8101d
Oct 28 10:57:08 puno01 kernel: [2306272.568420] [<ffffffff8101e
Oct 28 10:57:08 puno01 kernel: [2306272.568429] [<ffffffff810c1
Oct 28 10:57:08 puno01 kernel: [2306272.568438] [<ffffffff81011
Oct 28 10:57:08 puno01 kernel: [2306272.568441] ---[ end trace 52192aef6937b28d ]---
Oct 28 10:57:08 puno01 kernel: [2306272.568633] igb 0000:04:00.0 eth0: Reset adapter
Oct 28 10:57:08 puno01 kernel: [2306272.586016] xenbr0: port 1(eth0) entered disabled state
Oct 28 10:57:08 puno01 kernel: [2306272.600491] igb 0000:04:00.1 eth1: Reset adapter
Oct 28 10:57:12 puno01 kernel: [2306276.123402] igb: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
:
we moved from kernel 3.13.0-88-generic to 4.4.0-45-generic, but the issue keeps reapearing sporadicly (apr 1 - 2 times a month). so the adapter reset happend on
cat /proc/version_ signature 88.135- generic 3.13.11-ckt39
Ubuntu 3.13.0-
and on
cat /proc/version_ signature 66~14.04. 1-generic 4.4.21
Ubuntu 4.4.0-45.
lspci-vnvn.log are attached.