[ 1396.100005] NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [md1_raid10:350] [ 1396.100005] Modules linked in: intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul gpio_ich glue_helper 8250_fintek ablk_helper shpchp ioatdma i7core_edac cryptd serio_raw lpc_ich i5500_temp edac_core joydev input_leds mac_hid ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 xt_hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 ipt_REJECT nf_reject_ipv4 xt_comment nf_log_ipv4 nf_log_common xt_LOG xt_limit xt_tcpudp xt_addrtype nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ip6table_filter ip6_tables nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_ftp nf_nat nf_conntrack_ftp nf_conntrack iptable_filter ip_tables x_tables autofs4 raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq hid_generic raid1 igb [ 1396.100005] usbhid i2c_algo_bit raid0 mpt2sas dca raid_class multipath ptp pata_acpi psmouse hid scsi_transport_sas pps_core linear [ 1396.100005] CPU: 2 PID: 350 Comm: md1_raid10 Tainted: G I L 4.2.0-040200rc5-generic #201508030228 [ 1396.100005] Hardware name: Supermicro B8DT6/B8DT6, BIOS 080015 03/03/2010 [ 1396.100005] task: ffff8803315ee400 ti: ffff88032f2e0000 task.ti: ffff88032f2e0000 [ 1396.100005] RIP: 0010:[] [] bio_copy_data+0x18a/0x3d0 [ 1396.100005] RSP: 0018:ffff88032f2e3c98 EFLAGS: 00000246 [ 1396.100005] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 [ 1396.100005] RDX: 0000000000000001 RSI: ffff88032e104000 RDI: ffff88032c0f5000 [ 1396.100005] RBP: ffff88032f2e3d08 R08: 0000000000000002 R09: ffff8803315ee400 [ 1396.100005] R10: ffff88032d5e3600 R11: 0000000000001000 R12: 0000000200000000 [ 1396.100005] R13: 0000000000000000 R14: ffff88033159a200 R15: ffff88032f2e3bf8 [ 1396.100005] FS: 0000000000000000(0000) GS:ffff880333a80000(0000) knlGS:0000000000000000 [ 1396.100005] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [ 1396.100005] CR2: 00007f5eb618c000 CR3: 0000000001c0d000 CR4: 00000000000006e0 [ 1396.100005] Stack: [ 1396.100005] ffffffff81013683 ffff8803315ee400 0000000000000002 0000000000000000 [ 1396.100005] ffff88032d5e3600 ffff8803315ee400 0000000000000002 ffff88033019d400 [ 1396.100005] ffff88062e8e3400 0000000000000001 0000000000000001 ffff88032ebe7018 [ 1396.100005] Call Trace: [ 1396.100005] [] ? __switch_to+0x1f3/0x570 [ 1396.100005] [] raid10d+0xef1/0x1490 [raid10] [ 1396.100005] [] ? try_to_del_timer_sync+0x4f/0x70 [ 1396.100005] [] md_thread+0x117/0x130 [ 1396.100005] [] ? prepare_to_wait_event+0xf0/0xf0 [ 1396.100005] [] ? find_pers+0x80/0x80 [ 1396.100005] [] kthread+0xc9/0xe0 [ 1396.100005] [] ? kthread_create_on_node+0x180/0x180 [ 1396.100005] [] ret_from_fork+0x3f/0x70 [ 1396.100005] [] ? kthread_create_on_node+0x180/0x180 [ 1396.100005] Code: 8b 45 a0 41 83 a9 60 09 00 00 01 41 8b 91 60 09 00 00 85 d2 0f 88 2e 01 00 00 48 8b 45 98 83 a8 60 09 00 00 01 8b 80 60 09 00 00 <85> c0 0f 88 4b 01 00 00 48 8b 45 c8 48 f7 40 18 80 02 00 00 74 [ 1409.444005] INFO: rcu_sched self-detected stall on CPU { 2} (t=195019 jiffies g=46316 c=46315 q=0) [ 1409.456073] INFO: rcu_sched detected stalls on CPUs/tasks: { 2} (detected by 7, t=195021 jiffies, g=46316, c=46315, q=0) [ 1409.456074] Task dump for CPU 2: [ 1409.456077] md1_raid10 R running task 0 350 2 0x00000008 [ 1409.456081] ffffffffc01c7af1 ffff88062e8e34a8 ffff88032ebe6fc0 ffff88062e8e3400 [ 1409.456083] ffffffff810dcf1f 000000802f2e3da8 0000000000000001 ffff88032d5e3600 [ 1409.456084] ffff880300000001 ffff880300000000 ffff88062e8e3400 0000000000000010 [ 1409.456085] Call Trace: [ 1409.456092] [] ? raid10d+0xef1/0x1490 [raid10] [ 1409.456095] [] ? try_to_del_timer_sync+0x4f/0x70 [ 1409.456100] [] ? md_thread+0x117/0x130 [ 1409.456104] [] ? prepare_to_wait_event+0xf0/0xf0 [ 1409.456106] [] ? find_pers+0x80/0x80 [ 1409.456109] [] ? kthread+0xc9/0xe0 [ 1409.456111] [] ? kthread_create_on_node+0x180/0x180 [ 1409.456114] [] ? ret_from_fork+0x3f/0x70 [ 1409.456116] [] ? kthread_create_on_node+0x180/0x180 [ 1409.444005] Task dump for CPU 2: [ 1409.444005] md1_raid10 R running task 0 350 2 0x00000008 [ 1409.444005] ffffffff81c51a40 ffff880333a83d88 ffffffff810a0f6f 0000000000000002 [ 1409.444005] ffffffff81c51a40 ffff880333a83da8 ffffffff810a36bd 0000000000000083 [ 1409.444005] 0000000000000003 ffff880333a83dd8 ffffffff810d5584 ffff880333a97340 [ 1409.444005] Call Trace: [ 1409.444005] [] sched_show_task+0xaf/0x110 [ 1409.444005] [] dump_cpu_task+0x3d/0x50 [ 1409.444005] [] rcu_dump_cpu_stacks+0x84/0xc0 [ 1409.444005] [] rcu_check_callbacks+0x44a/0x720 [ 1409.444005] [] ? account_process_tick+0x60/0x170 [ 1409.444005] [] ? tick_sched_do_timer+0x30/0x30 [ 1409.444005] [] update_process_times+0x39/0x60 [ 1409.444005] [] tick_sched_handle.isra.15+0x25/0x60 [ 1409.444005] [] tick_sched_timer+0x44/0x80 [ 1409.444005] [] __hrtimer_run_queues+0xe4/0x200 [ 1409.444005] [] hrtimer_interrupt+0xa8/0x1a0 [ 1409.444005] [] local_apic_timer_interrupt+0x39/0x60 [ 1409.444005] [] smp_apic_timer_interrupt+0x45/0x60 [ 1409.444005] [] apic_timer_interrupt+0x6b/0x70 [ 1409.444005] [] ? bio_copy_data+0x141/0x3d0 [ 1409.444005] [] ? bio_copy_data+0x152/0x3d0 [ 1409.444005] [] ? __switch_to+0x1f3/0x570 [ 1409.444005] [] raid10d+0xef1/0x1490 [raid10] [ 1409.444005] [] ? try_to_del_timer_sync+0x4f/0x70 [ 1409.444005] [] md_thread+0x117/0x130 [ 1409.444005] [] ? prepare_to_wait_event+0xf0/0xf0 [ 1409.444005] [] ? find_pers+0x80/0x80 [ 1409.444005] [] kthread+0xc9/0xe0 [ 1409.444005] [] ? kthread_create_on_node+0x180/0x180 [ 1409.444005] [] ret_from_fork+0x3f/0x70 [ 1409.444005] [] ? kthread_create_on_node+0x180/0x180 [ 1436.100005] NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [md1_raid10:350] [ 1436.100005] Modules linked in: intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul gpio_ich glue_helper 8250_fintek ablk_helper shpchp ioatdma i7core_edac cryptd serio_raw lpc_ich i5500_temp edac_core joydev input_leds mac_hid ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 xt_hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 ipt_REJECT nf_reject_ipv4 xt_comment nf_log_ipv4 nf_log_common xt_LOG xt_limit xt_tcpudp xt_addrtype nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ip6table_filter ip6_tables nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_ftp nf_nat nf_conntrack_ftp nf_conntrack iptable_filter ip_tables x_tables autofs4 raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq hid_generic raid1 igb [ 1436.100005] usbhid i2c_algo_bit raid0 mpt2sas dca raid_class multipath ptp pata_acpi psmouse hid scsi_transport_sas pps_core linear [ 1436.100005] CPU: 2 PID: 350 Comm: md1_raid10 Tainted: G I L 4.2.0-040200rc5-generic #201508030228 [ 1436.100005] Hardware name: Supermicro B8DT6/B8DT6, BIOS 080015 03/03/2010 [ 1436.100005] task: ffff8803315ee400 ti: ffff88032f2e0000 task.ti: ffff88032f2e0000 [ 1436.100005] RIP: 0010:[] [] bio_copy_data+0xea/0x3d0 [ 1436.100005] RSP: 0018:ffff88032f2e3c98 EFLAGS: 00000287 [ 1436.100005] RAX: 0000000000001000 RBX: 0000000000000000 RCX: 0000000000000000 [ 1436.100005] RDX: 0000000000000000 RSI: ffffea000cb840c0 RDI: ffffea000cb03d40 [ 1436.100005] RBP: ffff88032f2e3d08 R08: 0000000000000002 R09: ffff8803315ee400 [ 1436.100005] R10: ffff88032d5e3600 R11: 0000000000001000 R12: 0000000200000000 [ 1436.100005] R13: 0000000000000000 R14: ffff88033159a200 R15: ffff88032f2e3bf8 [ 1436.100005] FS: 0000000000000000(0000) GS:ffff880333a80000(0000) knlGS:0000000000000000 [ 1436.100005] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [ 1436.100005] CR2: 00007f5eb618c000 CR3: 0000000001c0d000 CR4: 00000000000006e0 [ 1436.100005] Stack: [ 1436.100005] ffffffff81013683 ffff8803315ee400 0000000000000002 0000000000000000 [ 1436.100005] ffff88032d5e3600 ffff8803315ee400 0000000000000002 ffff88033019d400 [ 1436.100005] ffff88062e8e3400 0000000000000001 0000000000000001 ffff88032ebe7018 [ 1436.100005] Call Trace: [ 1436.100005] [] ? __switch_to+0x1f3/0x570 [ 1436.100005] [] raid10d+0xef1/0x1490 [raid10] [ 1436.100005] [] ? try_to_del_timer_sync+0x4f/0x70 [ 1436.100005] [] md_thread+0x117/0x130 [ 1436.100005] [] ? prepare_to_wait_event+0xf0/0xf0 [ 1436.100005] [] ? find_pers+0x80/0x80 [ 1436.100005] [] kthread+0xc9/0xe0 [ 1436.100005] [] ? kthread_create_on_node+0x180/0x180 [ 1436.100005] [] ret_from_fork+0x3f/0x70 [ 1436.100005] [] ? kthread_create_on_node+0x180/0x180 [ 1436.100005] Code: 4d a8 44 03 5b 0c 48 8b 33 8b 5b 08 03 50 0c 48 8b 38 8b 40 08 44 29 fb 44 39 eb 41 0f 47 dd 44 39 e3 41 0f 47 dc 44 29 f0 39 c3 <0f> 47 d8 41 83 81 60 09 00 00 01 41 83 81 60 09 00 00 01 4c 89