kernel BUG at "/build/linux-lts-xenial-UweaL0/linux-lts-xenial-4.4.0/arch/x86/kvm/mmu.c:1366!"

[LE QUANG LONG]

My OpenStack system have just an accident of crash one compute host.

Compute host information:
$ lsb_release -rd
Description: Ubuntu 14.04.5 LTS
Release: 14.04

$ uname -a
Linux compute2.hn.vnpt 4.4.0-62-generic #83~14.04.1-Ubuntu SMP Wed Jan 18 18:10:30 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

When I checked syslog in this compute, I found this log as issue happened. This log begins with:
"kernel BUG at /build/linux-lts-xenial-UweaL0/linux-lts-xenial-4.4.0/arch/x86/kvm/mmu.c:1366!
Oct 15 14:10:13 compute2 kernel: [12845630.282893] invalid opcode: 0000 [#1] SMP "

And after that, CPUs stuck in turn.

Could it be a bug in kernel of Ubuntu 14.04.5??

Oct 15 14:10:13 compute2 kernel: [12845630.278635] ------------[ cut here ]------------
Oct 15 14:10:13 compute2 kernel: [12845630.279881] kernel BUG at /build/linux-lts-xenial-UweaL0/linux-lts-xenial-4.4.0/arch/x86/kvm/mmu.c:1366!
Oct 15 14:10:13 compute2 kernel: [12845630.282893] invalid opcode: 0000 [#1] SMP
Oct 15 14:10:13 compute2 kernel: [12845630.284590] Modules linked in: nf_conntrack_netlink xt_multiport xt_set ip6table_raw ip6table_mangle nf_conntrack_ipv6 xt_CT xt_connmark xt_mac xt_comment xt_physdev br_netfilter ip_set_hash_net ip_set nfnetlink iptable_raw vhost_net vhost macvtap macvlan veth xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi vport_vxlan openvswitch nf_defrag_ipv6 nf_conntrack intel_rapl x86_pkg_temp_thermal intel_powerclamp ipmi_ssif coretemp kvm_intel ipmi_devintf kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel mxm_wmi aes_x86_64 dcdbas dm_multipath lrw gf128mul glue_helper ablk_helper cryptd sb_edac shpchp edac_core mei_me ipmi_si lpc_ich mei acpi_power_meter 8250_fintek ipmi_msghandler wmi mac_hid 8021q garp mrp stp llc bonding lp parport bnx2x vxlan ip6_udp_tunnel tg3 udp_tunnel ahci ptp mdio megaraid_sas libahci libcrc32c pps_core fjes
Oct 15 14:10:13 compute2 kernel: [12845630.336464] CPU: 28 PID: 27482 Comm: qemu-system-x86 Not tainted 4.4.0-62-generic #83~14.04.1-Ubuntu
Oct 15 14:10:13 compute2 kernel: [12845630.346071] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.3.4 11/08/2016
Oct 15 14:10:13 compute2 kernel: [12845630.356285] task: ffff8820bbc00000 ti: ffff882753484000 task.ti: ffff882753484000
Oct 15 14:10:13 compute2 kernel: [12845630.367252] RIP: 0010:[<ffffffffc0546923>] [<ffffffffc0546923>] kvm_zap_rmapp+0x53/0x60 [kvm]
Oct 15 14:10:13 compute2 kernel: [12845630.379079] RSP: 0018:ffff882753487bf8 EFLAGS: 00010246
Oct 15 14:10:13 compute2 kernel: [12845630.385225] RAX: 0000000000000001 RBX: ffffc90057d1bfa0 RCX: ffff8827c00d7a40
Oct 15 14:10:13 compute2 kernel: [12845630.397478] RDX: ffff8827c00d7a40 RSI: ffff88492f36efa0 RDI: ffff88492f36efa0
Oct 15 14:10:13 compute2 kernel: [12845630.409829] RBP: ffff882753487c08 R08: 0000000000000000 R09: 0000000000000000
Oct 15 14:10:13 compute2 kernel: [12845630.422338] R10: ffffc9003ae9c000 R11: 0000000000240000 R12: ffff88154ad1c000
Oct 15 14:10:13 compute2 kernel: [12845630.434840] R13: ffffffffc0546930 R14: 0000000000000000 R15: ffffc9003ae9c008
Oct 15 14:10:13 compute2 kernel: [12845630.447328] FS: 00007f8bfb7fe700(0000) GS:ffff8827de980000(0000) knlGS:0000000000000000
Oct 15 14:10:13 compute2 kernel: [12845630.459840] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Oct 15 14:10:13 compute2 kernel: [12845630.466113] CR2: 0000000000160000 CR3: 00000004323fa000 CR4: 00000000003426e0
Oct 15 14:10:13 compute2 kernel: [12845630.478424] Stack:
Oct 15 14:10:13 compute2 kernel: [12845630.484373] 0000000000000001 ffff88154ad1c000 ffff882753487c18 ffffffffc054693e
Oct 15 14:10:13 compute2 kernel: [12845630.496332] ffff882753487cb8 ffffffffc0542fd9 ffff88154ad1c048 ffff88154ad1c038
Oct 15 14:10:13 compute2 kernel: [12845630.508296] 00007f8be3e00000 00007f8bdc400000 ffffc9003aea6008 ffffc9003ae9c008
Oct 15 14:10:13 compute2 kernel: [12845630.520294] Call Trace:
Oct 15 14:10:13 compute2 kernel: [12845630.526169] [<ffffffffc054693e>] kvm_unmap_rmapp+0xe/0x20 [kvm]
Oct 15 14:10:13 compute2 kernel: [12845630.532063] [<ffffffffc0542fd9>] kvm_handle_hva_range+0x119/0x170 [kvm]
Oct 15 14:10:13 compute2 kernel: [12845630.537896] [<ffffffffc054d407>] kvm_unmap_hva_range+0x17/0x20 [kvm]
Oct 15 14:10:13 compute2 kernel: [12845630.543627] [<ffffffffc05284e3>] kvm_mmu_notifier_invalidate_range_start+0x53/0x90 [kvm]
Oct 15 14:10:13 compute2 kernel: [12845630.554752] [<ffffffff811d72a5>] __mmu_notifier_invalidate_range_start+0x55/0x80
Oct 15 14:10:13 compute2 kernel: [12845630.566010] [<ffffffff811bd139>] change_protection_range+0x859/0x870
Oct 15 14:10:13 compute2 kernel: [12845630.571743] [<ffffffff810b2f35>] ? pick_next_entity+0xa5/0x160
Oct 15 14:10:13 compute2 kernel: [12845630.577365] [<ffffffff811bd164>] change_protection+0x14/0x30
Oct 15 14:10:13 compute2 kernel: [12845630.582874] [<ffffffff811d4d2c>] change_prot_numa+0x1c/0x40
Oct 15 14:10:13 compute2 kernel: [12845630.588249] [<ffffffff810b01b8>] task_numa_work+0x1f8/0x2f0
Oct 15 14:10:13 compute2 kernel: [12845630.593516] [<ffffffff8109b336>] task_work_run+0x86/0xb0
Oct 15 14:10:13 compute2 kernel: [12845630.598650] [<ffffffff81079836>] exit_to_usermode_loop+0x73/0xa2
Oct 15 14:10:13 compute2 kernel: [12845630.603700] [<ffffffff81003a6e>] syscall_return_slowpath+0x4e/0x60
Oct 15 14:10:13 compute2 kernel: [12845630.608662] [<ffffffff81802e98>] int_ret_from_sys_call+0x25/0x8f
Oct 15 14:10:13 compute2 kernel: [12845630.613525] Code: 48 8b 32 48 85 f6 74 1a f6 06 01 74 1e 4c 89 e7 e8 33 ff ff ff 48 8b 13 b8 01 00 00 00 48 85 d2 75 d2 5b 41 5c 5d c3 31 c0 eb f7 <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89
Oct 15 14:10:13 compute2 kernel: [12845630.628271] RIP [<ffffffffc0546923>] kvm_zap_rmapp+0x53/0x60 [kvm]
Oct 15 14:10:13 compute2 kernel: [12845630.633153] RSP <ffff882753487bf8>
Oct 15 14:10:13 compute2 kernel: [12845630.644544] ---[ end trace 3e431ef71f0a5351 ]---
Oct 15 14:10:40 compute2 kernel: [12845656.234883] NMI watchdog: BUG: soft lockup - CPU#60 stuck for 22s! [qemu-system-x86:27480]
Oct 15 14:10:40 compute2 kernel: [12845656.242967] NMI watchdog: BUG: soft lockup - CPU#62 stuck for 22s! [qemu-system-x86:27483]
Oct 15 14:10:40 compute2 kernel: [12845656.243240] Modules linked in: nf_conntrack_netlink xt_multiport xt_set ip6table_raw ip6table_mangle nf_conntrack_ipv6 xt_CT xt_connmark xt_mac xt_comment xt_physdev br_netfilter ip_set_hash_net ip_set nfnetlink iptable_raw vhost_net vhost macvtap macvlan veth xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi vport_vxlan openvswitch nf_defrag_ipv6 nf_conntrack intel_rapl x86_pkg_temp_thermal intel_powerclamp ipmi_ssif coretemp kvm_intel ipmi_devintf kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel mxm_wmi aes_x86_64 dcdbas dm_multipath lrw gf128mul glue_helper ablk_helper cryptd sb_edac shpchp edac_core mei_me ipmi_si lpc_ich mei acpi_power_meter 8250_fintek ipmi_msghandler wmi mac_hid 8021q garp mrp stp llc bonding lp parport bnx2x vxlan ip6_udp_tunnel tg3 udp_tunnel ahci ptp mdio megaraid_sas libahci libcrc32c pps_core fjes
Oct 15 14:10:40 compute2 kernel: [12845656.243416] CPU: 62 PID: 27483 Comm: qemu-system-x86 Tainted: G D 4.4.0-62-generic #83~14.04.1-Ubuntu
Oct 15 14:10:40 compute2 kernel: [12845656.243425] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.3.4 11/08/2016
Oct 15 14:10:40 compute2 kernel: [12845656.243449] task: ffff8820bbc04600 ti: ffff88235591c000 task.ti: ffff88235591c000
Oct 15 14:10:40 compute2 kernel: [12845656.243587] RIP: 0010:[<ffffffff810c66e7>] [<ffffffff810c66e7>] native_queued_spin_lock_slowpath+0x117/0x170
Oct 15 14:10:40 compute2 kernel: [12845656.243588] RSP: 0018:ffff88235591fbc8 EFLAGS: 00000202
Oct 15 14:10:40 compute2 kernel: [12845656.243590] RAX: 0000000000000000 RBX: ffff880433218000 RCX: ffff8827dedd7940
Oct 15 14:10:40 compute2 kernel: [12845656.243590] RDX: 0000000000440101 RSI: 0000000000fc0000 RDI: ffff88154ad1c000
Oct 15 14:10:40 compute2 kernel: [12845656.243591] RBP: ffff88235591fbc8 R08: 0000000000000101 R09: ffff88235591fc08
Oct 15 14:10:40 compute2 kernel: [12845656.243592] R10: 00007f8bde67e000 R11: 00000000000003f0 R12: 000000023a87e548
Oct 15 14:10:40 compute2 kernel: [12845656.243592] R13: 0000000000000000 R14: 0000000000000000 R15: 000000000a3acadc
Oct 15 14:10:40 compute2 kernel: [12845656.243593] FS: 00007f8bfaffd700(0000) GS:ffff8827dedc0000(0000) knlGS:00000000ffeda000
Oct 15 14:10:40 compute2 kernel: [12845656.243595] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Oct 15 14:10:40 compute2 kernel: [12845656.243595] CR2: 0000000008537000 CR3: 00000004323fa000 CR4: 00000000003426e0
Oct 15 14:10:40 compute2 kernel: [12845656.243602] Stack:
Oct 15 14:10:40 compute2 kernel: [12845656.243623] ffff88235591fbd8 ffffffff811832e7 ffff88235591fbe8 ffffffff818029a0
Oct 15 14:10:40 compute2 kernel: [12845656.243628] ffff88235591fc48 ffffffffc054c12a ffff88235591fc07 0100ffffc055735b
Oct 15 14:10:40 compute2 kernel: [12845656.243629] 0000000100000000 000000000122df1a 000000000023a87e ffff880433218000
Oct 15 14:10:40 compute2 kernel: [12845656.243630] Call Trace:
Oct 15 14:10:40 compute2 kernel: [12845656.243718] [<ffffffff811832e7>] queued_spin_lock_slowpath+0xb/0xf
Oct 15 14:10:40 compute2 kernel: [12845656.243748] [<ffffffff818029a0>] _raw_spin_lock+0x20/0x30
Oct 15 14:10:40 compute2 kernel: [12845656.244420] [<ffffffffc054c12a>] tdp_page_fault+0x19a/0x240 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.244759] [<ffffffffc0543f14>] kvm_mmu_page_fault+0x24/0x110 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.244982] [<ffffffffc13f7026>] handle_ept_violation+0x96/0x180 [kvm_intel]
Oct 15 14:10:40 compute2 kernel: [12845656.245000] [<ffffffffc13fdda8>] vmx_handle_exit+0x288/0xbf0 [kvm_intel]
Oct 15 14:10:40 compute2 kernel: [12845656.245537] [<ffffffffc0539644>] vcpu_enter_guest+0x8b4/0x10a0 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.245616] [<ffffffff8108b3c2>] ? __set_task_blocked+0x32/0x70
Oct 15 14:10:40 compute2 kernel: [12845656.246386] [<ffffffffc0540a44>] kvm_arch_vcpu_ioctl_run+0xc4/0x3d0 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.246713] [<ffffffffc0526f7b>] kvm_vcpu_ioctl+0x2ab/0x640 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.246773] [<ffffffff810b2f35>] ? pick_next_entity+0xa5/0x160
Oct 15 14:10:40 compute2 kernel: [12845656.246805] [<ffffffff81213abd>] do_vfs_ioctl+0x2dd/0x4c0
Oct 15 14:10:40 compute2 kernel: [12845656.247084] [<ffffffffc053522e>] ? kvm_on_user_return+0x6e/0xa0 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.247087] [<ffffffff81213d19>] SyS_ioctl+0x79/0x90
Oct 15 14:10:40 compute2 kernel: [12845656.247089] [<ffffffff81802d36>] entry_SYSCALL_64_fastpath+0x16/0x75
Oct 15 14:10:40 compute2 kernel: [12845656.247176] Code: 30 48 98 48 81 c2 40 79 01 00 48 03 14 c5 40 8f f3 81 48 89 0a 8b 41 08 85 c0 75 0d f3 90 8b 41 08 85 c0 74 f7 eb 02 f3 90 8b 17 <66> 85 d2 75 f7 39 f2 66 90 75 0f 89 d0 be 01 00 00 00 f0 0f b1
Oct 15 14:10:40 compute2 kernel: [12845656.274928] NMI watchdog: BUG: soft lockup - CPU#70 stuck for 22s! [qemu-system-x86:27481]
Oct 15 14:10:40 compute2 kernel: [12845656.275153] Modules linked in: nf_conntrack_netlink xt_multiport xt_set ip6table_raw ip6table_mangle nf_conntrack_ipv6 xt_CT xt_connmark xt_mac xt_comment xt_physdev br_netfilter ip_set_hash_net ip_set nfnetlink iptable_raw vhost_net vhost macvtap macvlan veth xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi vport_vxlan openvswitch nf_defrag_ipv6 nf_conntrack intel_rapl x86_pkg_temp_thermal intel_powerclamp ipmi_ssif coretemp kvm_intel ipmi_devintf kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel mxm_wmi aes_x86_64 dcdbas dm_multipath lrw gf128mul glue_helper ablk_helper cryptd sb_edac shpchp edac_core mei_me ipmi_si lpc_ich mei acpi_power_meter 8250_fintek ipmi_msghandler wmi mac_hid 8021q garp mrp stp llc bonding lp parport bnx2x vxlan ip6_udp_tunnel tg3 udp_tunnel ahci ptp mdio megaraid_sas libahci libcrc32c pps_core fjes
Oct 15 14:10:40 compute2 kernel: [12845656.275418] CPU: 70 PID: 27481 Comm: qemu-system-x86 Tainted: G D L 4.4.0-62-generic #83~14.04.1-Ubuntu
Oct 15 14:10:40 compute2 kernel: [12845656.275420] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.3.4 11/08/2016
Oct 15 14:10:40 compute2 kernel: [12845656.275423] task: ffff882102473800 ti: ffff880161174000 task.ti: ffff880161174000
Oct 15 14:10:40 compute2 kernel: [12845656.275507] RIP: 0010:[<ffffffff810c672e>] [<ffffffff810c672e>] native_queued_spin_lock_slowpath+0x15e/0x170
Oct 15 14:10:40 compute2 kernel: [12845656.275514] RSP: 0018:ffff880161177bc8 EFLAGS: 00000202
Oct 15 14:10:40 compute2 kernel: [12845656.275521] RAX: 0000000000440101 RBX: ffff884f14110000 RCX: 0000000000000001
Oct 15 14:10:40 compute2 kernel: [12845656.275522] RDX: 0000000000000101 RSI: 0000000000000001 RDI: ffff88154ad1c000
Oct 15 14:10:40 compute2 kernel: [12845656.275523] RBP: ffff880161177bc8 R08: 0000000000000101 R09: ffff880161177c08
Oct 15 14:10:40 compute2 kernel: [12845656.275524] R10: 00007f8bdd973000 R11: 0000000000000b98 R12: 0000000239b73140
Oct 15 14:10:40 compute2 kernel: [12845656.275524] R13: 0000000000000000 R14: 0000000000000000 R15: 000000000a3acadc
Oct 15 14:10:40 compute2 kernel: [12845656.275540] FS: 00007f8bfbfff700(0000) GS:ffff8827deec0000(0000) knlGS:000007fffff60000
Oct 15 14:10:40 compute2 kernel: [12845656.275541] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Oct 15 14:10:40 compute2 kernel: [12845656.275546] CR2: 0000000000051520 CR3: 00000004323fa000 CR4: 00000000003426e0
Oct 15 14:10:40 compute2 kernel: [12845656.275582] Stack:
Oct 15 14:10:40 compute2 kernel: [12845656.275598] ffff880161177bd8 ffffffff811832e7 ffff880161177be8 ffffffff818029a0
Oct 15 14:10:40 compute2 kernel: [12845656.275599] ffff880161177c48 ffffffffc054c12a ffff880161177c07 0100ffffc055735b
Oct 15 14:10:40 compute2 kernel: [12845656.275600] 0000000100000000 0000000001d9a0a7 0000000000239b73 ffff884f14110000
Oct 15 14:10:40 compute2 kernel: [12845656.275600] Call Trace:
Oct 15 14:10:40 compute2 kernel: [12845656.275623] [<ffffffff811832e7>] queued_spin_lock_slowpath+0xb/0xf
Oct 15 14:10:40 compute2 kernel: [12845656.275687] [<ffffffff818029a0>] _raw_spin_lock+0x20/0x30
Oct 15 14:10:40 compute2 kernel: [12845656.276025] [<ffffffffc054c12a>] tdp_page_fault+0x19a/0x240 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.276075] [<ffffffffc0543f14>] kvm_mmu_page_fault+0x24/0x110 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.276262] [<ffffffffc13f7026>] handle_ept_violation+0x96/0x180 [kvm_intel]
Oct 15 14:10:40 compute2 kernel: [12845656.276266] [<ffffffffc13fdda8>] vmx_handle_exit+0x288/0xbf0 [kvm_intel]
Oct 15 14:10:40 compute2 kernel: [12845656.276341] [<ffffffffc0539644>] vcpu_enter_guest+0x8b4/0x10a0 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.276445] [<ffffffff8108b3c2>] ? __set_task_blocked+0x32/0x70
Oct 15 14:10:40 compute2 kernel: [12845656.276661] [<ffffffffc0540a44>] kvm_arch_vcpu_ioctl_run+0xc4/0x3d0 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.276835] [<ffffffffc0526f7b>] kvm_vcpu_ioctl+0x2ab/0x640 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.276895] [<ffffffff810b2f35>] ? pick_next_entity+0xa5/0x160
Oct 15 14:10:40 compute2 kernel: [12845656.277004] [<ffffffffc0522070>] ? kvm_vcpu_mmap+0x20/0x20 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.277026] [<ffffffff81213abd>] do_vfs_ioctl+0x2dd/0x4c0
Oct 15 14:10:40 compute2 kernel: [12845656.277151] [<ffffffffc053522e>] ? kvm_on_user_return+0x6e/0xa0 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845656.277160] [<ffffffff81213d19>] SyS_ioctl+0x79/0x90
Oct 15 14:10:40 compute2 kernel: [12845656.277183] [<ffffffff81802d36>] entry_SYSCALL_64_fastpath+0x16/0x75
Oct 15 14:10:40 compute2 kernel: [12845656.277214] Code: 01 48 8b 01 48 85 c0 75 0a f3 90 48 8b 01 48 85 c0 74 f6 c7 40 08 01 00 00 00 e9 61 ff ff ff 83 fa 01 75 07 e9 c2 fe ff ff f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 5d c3 66 90 0f 1f 44
Oct 15 14:10:40 compute2 kernel: [12845657.024846] Modules linked in: nf_conntrack_netlink xt_multiport xt_set ip6table_raw ip6table_mangle nf_conntrack_ipv6 xt_CT xt_connmark xt_mac xt_comment xt_physdev br_netfilter ip_set_hash_net ip_set nfnetlink iptable_raw vhost_net vhost macvtap macvlan veth xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi vport_vxlan openvswitch nf_defrag_ipv6 nf_conntrack intel_rapl x86_pkg_temp_thermal intel_powerclamp ipmi_ssif coretemp kvm_intel ipmi_devintf kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel mxm_wmi aes_x86_64 dcdbas dm_multipath lrw gf128mul glue_helper ablk_helper cryptd sb_edac shpchp edac_core mei_me ipmi_si lpc_ich mei acpi_power_meter 8250_fintek ipmi_msghandler wmi mac_hid 8021q garp mrp stp llc bonding lp parport bnx2x vxlan ip6_udp_tunnel tg3 udp_tunnel ahci ptp mdio megaraid_sas libahci libcrc32c pps_core fjes
Oct 15 14:10:40 compute2 kernel: [12845657.107957] CPU: 60 PID: 27480 Comm: qemu-system-x86 Tainted: G D L 4.4.0-62-generic #83~14.04.1-Ubuntu
Oct 15 14:10:40 compute2 kernel: [12845657.119057] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.3.4 11/08/2016
Oct 15 14:10:40 compute2 kernel: [12845657.130368] task: ffff8801092d3800 ti: ffff882355800000 task.ti: ffff882355800000
Oct 15 14:10:40 compute2 kernel: [12845657.142042] RIP: 0010:[<ffffffff810c66da>] [<ffffffff810c66da>] native_queued_spin_lock_slowpath+0x10a/0x170
Oct 15 14:10:40 compute2 kernel: [12845657.154178] RSP: 0018:ffff882355803bc8 EFLAGS: 00000246
Oct 15 14:10:40 compute2 kernel: [12845657.160343] RAX: 0000000000000000 RBX: ffff8834e6b30000 RCX: ffff8827ded97940
Oct 15 14:10:40 compute2 kernel: [12845657.172671] RDX: ffff8827dedd7940 RSI: 0000000000f40000 RDI: ffff88154ad1c000
Oct 15 14:10:40 compute2 kernel: [12845657.185072] RBP: ffff882355803bc8 R08: 0000000000000101 R09: ffff882355803c08
Oct 15 14:10:40 compute2 kernel: [12845657.197535] R10: 00007f8bddba5000 R11: 0000000000000d28 R12: 0000000239da5cf8
Oct 15 14:10:40 compute2 kernel: [12845657.209974] R13: 0000000000000002 R14: 0000000000000000 R15: 000000000a3acadc
Oct 15 14:10:40 compute2 kernel: [12845657.222407] FS: 00007f8c10ff9700(0000) GS:ffff8827ded80000(0000) knlGS:00000000ffeda000
Oct 15 14:10:40 compute2 kernel: [12845657.234849] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Oct 15 14:10:40 compute2 kernel: [12845657.241097] CR2: 0000000002d5ebf8 CR3: 00000004323fa000 CR4: 00000000003426e0
Oct 15 14:10:40 compute2 kernel: [12845657.253359] Stack:
Oct 15 14:10:40 compute2 kernel: [12845657.259292] ffff882355803bd8 ffffffff811832e7 ffff882355803be8 ffffffff818029a0
Oct 15 14:10:40 compute2 kernel: [12845657.271217] ffff882355803c48 ffffffffc054c12a ffff882355803c07 0100ffffc055735b
Oct 15 14:10:40 compute2 kernel: [12845657.283134] 0000000100000000 0000000001703f99 0000000000239da5 ffff8834e6b30000
Oct 15 14:10:40 compute2 kernel: [12845657.295160] Call Trace:
Oct 15 14:10:40 compute2 kernel: [12845657.301002] [<ffffffff811832e7>] queued_spin_lock_slowpath+0xb/0xf
Oct 15 14:10:40 compute2 kernel: [12845657.306930] [<ffffffff818029a0>] _raw_spin_lock+0x20/0x30
Oct 15 14:10:40 compute2 kernel: [12845657.312770] [<ffffffffc054c12a>] tdp_page_fault+0x19a/0x240 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845657.318514] [<ffffffffc0543f14>] kvm_mmu_page_fault+0x24/0x110 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845657.324177] [<ffffffffc13f7026>] handle_ept_violation+0x96/0x180 [kvm_intel]
Oct 15 14:10:40 compute2 kernel: [12845657.335222] [<ffffffffc13fdda8>] vmx_handle_exit+0x288/0xbf0 [kvm_intel]
Oct 15 14:10:40 compute2 kernel: [12845657.340936] [<ffffffffc0539644>] vcpu_enter_guest+0x8b4/0x10a0 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845657.346547] [<ffffffff8108b3c2>] ? __set_task_blocked+0x32/0x70
Oct 15 14:10:40 compute2 kernel: [12845657.352082] [<ffffffffc0540a44>] kvm_arch_vcpu_ioctl_run+0xc4/0x3d0 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845657.357556] [<ffffffffc0526f7b>] kvm_vcpu_ioctl+0x2ab/0x640 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845657.362923] [<ffffffff810fd114>] ? do_futex+0xf4/0x520
Oct 15 14:10:40 compute2 kernel: [12845657.368182] [<ffffffff81213abd>] do_vfs_ioctl+0x2dd/0x4c0
Oct 15 14:10:40 compute2 kernel: [12845657.373331] [<ffffffff817fee89>] ? __schedule+0x359/0x980
Oct 15 14:10:40 compute2 kernel: [12845657.378364] [<ffffffffc053522e>] ? kvm_on_user_return+0x6e/0xa0 [kvm]
Oct 15 14:10:40 compute2 kernel: [12845657.383324] [<ffffffff81213d19>] SyS_ioctl+0x79/0x90
Oct 15 14:10:40 compute2 kernel: [12845657.388171] [<ffffffff81802d36>] entry_SYSCALL_64_fastpath+0x16/0x75
Oct 15 14:10:40 compute2 kernel: [12845657.392964] Code: c2 c1 e8 12 48 c1 ea 0c 83 e8 01 83 e2 30 48 98 48 81 c2 40 79 01 00 48 03 14 c5 40 8f f3 81 48 89 0a 8b 41 08 85 c0 75 0d f3 90 <8b> 41 08 85 c0 74 f7 eb 02 f3 90 8b 17 66 85 d2 75 f7 39 f2 66
Oct 15 14:10:43 compute2 kernel: [12845660.026777] NMI watchdog: BUG: soft lockup - CPU#8 stuck for 23s! [tp_librbd:27611]
Oct 15 14:10:43 compute2 kernel: [12845660.036361] Modules linked in: nf_conntrack_netlink xt_multiport xt_set ip6table_raw ip6table_mangle nf_conntrack_ipv6 xt_CT xt_connmark xt_mac xt_comment xt_physdev br_netfilter ip_set_hash_net ip_set nfnetlink iptable_raw vhost_net vhost macvtap macvlan veth xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi vport_vxlan openvswitch nf_defrag_ipv6 nf_conntrack intel_rapl x86_pkg_temp_thermal intel_powerclamp ipmi_ssif coretemp kvm_intel ipmi_devintf kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel mxm_wmi aes_x86_64 dcdbas dm_multipath lrw gf128mul glue_helper ablk_helper cryptd sb_edac shpchp edac_core mei_me ipmi_si lpc_ich mei acpi_power_meter 8250_fintek ipmi_msghandler wmi mac_hid 8021q garp mrp stp llc bonding lp parport bnx2x vxlan ip6_udp_tunnel tg3 udp_tunnel ahci ptp mdio megaraid_sas libahci libcrc32c pps_core fjes
Oct 15 14:10:43 compute2 kernel: [12845660.121020] CPU: 8 PID: 27611 Comm: tp_librbd Tainted: G D L 4.4.0-62-generic #83~14.04.1-Ubuntu
Oct 15 14:10:43 compute2 kernel: [12845660.132322] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.3.4 11/08/2016
Oct 15 14:10:43 compute2 kernel: [12845660.143880] task: ffff8827c059c600 ti: ffff884f60478000 task.ti: ffff884f60478000
Oct 15 14:10:43 compute2 kernel: [12845660.155893] RIP: 0010:[<ffffffff810c66da>] [<ffffffff810c66da>] native_queued_spin_lock_slowpath+0x10a/0x170
Oct 15 14:10:43 compute2 kernel: [12845660.168301] RSP: 0000:ffff884f6047b888 EFLAGS: 00000246
Oct 15 14:10:43 compute2 kernel: [12845660.174541] RAX: 0000000000000000 RBX: ffff88154ad1c000 RCX: ffff8827de717940
Oct 15 14:10:43 compute2 kernel: [12845660.186833] RDX: ffff8827ded97940 RSI: 0000000000240000 RDI: ffff88154ad1c000
Oct 15 14:10:43 compute2 kernel: [12845660.199209] RBP: ffff884f6047b888 R08: 0000000000000101 R09: 0000000000000000
Oct 15 14:10:43 compute2 kernel: [12845660.211684] R10: 0000000000000008 R11: 0000000000000000 R12: ffff88154ad1ee18
Oct 15 14:10:43 compute2 kernel: [12845660.224078] R13: ffff88154ad1c048 R14: 00007f89a00e7000 R15: 0000000000000001
Oct 15 14:10:43 compute2 kernel: [12845660.236489] FS: 00007f12daffd700(0000) GS:ffff8827de700000(0000) knlGS:0000000000000000
Oct 15 14:10:43 compute2 kernel: [12845660.248901] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Oct 15 14:10:43 compute2 kernel: [12845660.255114] CR2: 00007f0c78000010 CR3: 0000004fab6d0000 CR4: 00000000003426e0
Oct 15 14:10:43 compute2 kernel: [12845660.267268] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Oct 15 14:10:43 compute2 kernel: [12845660.279521] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Oct 15 14:10:43 compute2 kernel: [12845660.291725] Stack:
Oct 15 14:10:43 compute2 kernel: [12845660.297607] ffff884f6047b898 ffffffff811832e7 ffff884f6047b8a8 ffffffff818029a0
Oct 15 14:10:43 compute2 kernel: [12845660.309582] ffff884f6047b8e0 ffffffffc0528556 ffff88154ad1ee18 ffff8827bdacfc00
Oct 15 14:10:43 compute2 kernel: [12845660.321614] 00007f89a00e7000 0000000000000000 ffff88394a88b6a8 ffff884f6047b910
Oct 15 14:10:43 compute2 kernel: [12845660.333626] Call Trace:
Oct 15 14:10:43 compute2 kernel: [12845660.339463] [<ffffffff811832e7>] queued_spin_lock_slowpath+0xb/0xf
Oct 15 14:10:43 compute2 kernel: [12845660.345361] [<ffffffff818029a0>] _raw_spin_lock+0x20/0x30
Oct 15 14:10:43 compute2 kernel: [12845660.351221] [<ffffffffc0528556>] kvm_mmu_notifier_invalidate_page+0x36/0x80 [kvm]
Oct 15 14:10:43 compute2 kernel: [12845660.362800] [<ffffffff811d79fd>] __mmu_notifier_invalidate_page+0x4d/0x70
Oct 15 14:10:43 compute2 kernel: [12845660.368667] [<ffffffff811bfa3c>] try_to_unmap_one+0x3dc/0x480
Oct 15 14:10:43 compute2 kernel: [12845660.374436] [<ffffffff811c057f>] rmap_walk+0x1ef/0x2d0
Oct 15 14:10:43 compute2 kernel: [12845660.380090] [<ffffffff811c084c>] try_to_unmap+0x5c/0x80
Oct 15 14:10:43 compute2 kernel: [12845660.385619] [<ffffffff811bf660>] ? page_remove_rmap+0x110/0x110
Oct 15 14:10:43 compute2 kernel: [12845660.391058] [<ffffffff811be8f0>] ? invalid_migration_vma+0x30/0x30
Oct 15 14:10:43 compute2 kernel: [12845660.396410] [<ffffffff811bfda0>] ? page_get_anon_vma+0x70/0x70
Oct 15 14:10:43 compute2 kernel: [12845660.401653] [<ffffffff811be8c0>] ? invalid_mkclean_vma+0x20/0x20
Oct 15 14:10:43 compute2 kernel: [12845660.406799] [<ffffffff811e589f>] migrate_pages+0x59f/0x6d0
Oct 15 14:10:43 compute2 kernel: [12845660.411825] [<ffffffff811a9d70>] ? memcg_slab_show+0x70/0x70
Oct 15 14:10:43 compute2 kernel: [12845660.416783] [<ffffffff811abac0>] ? isolate_freepages_block+0x3f0/0x3f0
Oct 15 14:10:43 compute2 kernel: [12845660.421730] [<ffffffff811ac9fb>] compact_zone+0x2cb/0x7b0
Oct 15 14:10:43 compute2 kernel: [12845660.426562] [<ffffffff811acf4d>] compact_zone_order+0x6d/0x90
Oct 15 14:10:43 compute2 kernel: [12845660.431259] [<ffffffff811ad1dd>] try_to_compact_pages+0xed/0x230
Oct 15 14:10:43 compute2 kernel: [12845660.435872] [<ffffffff811fb335>] __alloc_pages_direct_compact+0x3b/0xe3
Oct 15 14:10:43 compute2 kernel: [12845660.440426] [<ffffffff811fb6c8>] __alloc_pages_slowpath.constprop.87+0x2eb/0x7ad
Oct 15 14:10:43 compute2 kernel: [12845660.449099] [<ffffffff8118e1a7>] __alloc_pages_nodemask+0x237/0x240
Oct 15 14:10:43 compute2 kernel: [12845660.453656] [<ffffffff811d5ba3>] alloc_pages_vma+0x1f3/0x210
Oct 15 14:10:43 compute2 kernel: [12845660.458140] [<ffffffff811ea64e>] do_huge_pmd_anonymous_page+0x12e/0x540
Oct 15 14:10:43 compute2 kernel: [12845660.462576] [<ffffffff811b49ac>] ? __pmd_alloc+0x11c/0x130
Oct 15 14:10:43 compute2 kernel: [12845660.466904] [<ffffffff811b5813>] handle_mm_fault+0x443/0x540
Oct 15 14:10:43 compute2 kernel: [12845660.471125] [<ffffffff81068c1a>] __do_page_fault+0x19a/0x430
Oct 15 14:10:43 compute2 kernel: [12845660.475213] [<ffffffff81068ed2>] do_page_fault+0x22/0x30
Oct 15 14:10:43 compute2 kernel: [12845660.479170] [<ffffffff81804eb8>] page_fault+0x28/0x30
Oct 15 14:10:43 compute2 kernel: [12845660.483124] Code: c2 c1 e8 12 48 c1 ea 0c 83 e8 01 83 e2 30 48 98 48 81 c2 40 79 01 00 48 03 14 c5 40 8f f3 81 48 89 0a 8b 41 08 85 c0 75 0d f3 90 <8b> 41 08 85 c0 74 f7 eb 02 f3 90 8b 17 66 85 d2 75 f7 39 f2 66
Oct 15 14:10:47 compute2 kernel: [12845664.022674] NMI watchdog: BUG: soft lockup - CPU#7 stuck for 22s! [ms_pipe_write:121721]
Oct 15 14:10:47 compute2 kernel: [12845664.030716] Modules linked in: nf_conntrack_netlink xt_multiport xt_set ip6table_raw ip6table_mangle nf_conntrack_ipv6 xt_CT xt_connmark xt_mac xt_comment xt_physdev br_netfilter ip_set_hash_net ip_set nfnetlink iptable_raw vhost_net vhost macvtap macvlan veth xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi vport_vxlan openvswitch nf_defrag_ipv6 nf_conntrack intel_rapl x86_pkg_temp_thermal intel_powerclamp ipmi_ssif coretemp kvm_intel ipmi_devintf kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel mxm_wmi aes_x86_64 dcdbas dm_multipath lrw gf128mul glue_helper ablk_helper cryptd sb_edac shpchp edac_core mei_me ipmi_si lpc_ich mei acpi_power_meter 8250_fintek ipmi_msghandler wmi mac_hid 8021q garp mrp stp llc bonding lp parport bnx2x vxlan ip6_udp_tunnel tg3 udp_tunnel ahci ptp mdio megaraid_sas libahci libcrc32c pps_core fjes
Oct 15 14:10:47 compute2 kernel: [12845664.110820] CPU: 7 PID: 121721 Comm: ms_pipe_write Tainted: G D L 4.4.0-62-generic #83~14.04.1-Ubuntu
Oct 15 14:10:47 compute2 kernel: [12845664.122008] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.3.4 11/08/2016
Oct 15 14:10:47 compute2 kernel: [12845664.133414] task: ffff8827bfa41c00 ti: ffff8844d89a4000 task.ti: ffff8844d89a4000
Oct 15 14:10:47 compute2 kernel: [12845664.145245] RIP: 0010:[<ffffffff810c66dd>] [<ffffffff810c66dd>] native_queued_spin_lock_slowpath+0x10d/0x170
Oct 15 14:10:47 compute2 kernel: [12845664.157644] RSP: 0000:ffff8844d89a7b70 EFLAGS: 00000246
Oct 15 14:10:47 compute2 kernel: [12845664.163908] RAX: 0000000000000000 RBX: ffff88154ad1c000 RCX: ffff884fdded7940
Oct 15 14:10:47 compute2 kernel: [12845664.176261] RDX: ffff8827de717940 RSI: 0000000000200000 RDI: ffff88154ad1c000
Oct 15 14:10:47 compute2 kernel: [12845664.188674] RBP: ffff8844d89a7b70 R08: 0000000000000101 R09: 0000000000000000
Oct 15 14:10:47 compute2 kernel: [12845664.201097] R10: 0000000000000008 R11: ffffffff81ccf3e8 R12: ffff88154ad1ee18
Oct 15 14:10:47 compute2 kernel: [12845664.213509] R13: ffff88154ad1c048 R14: 00007f8c408e7000 R15: 0000000000000001
Oct 15 14:10:47 compute2 kernel: [12845664.225912] FS: 00007feada7e7700(0000) GS:ffff884fddec0000(0000) knlGS:0000000000000000
Oct 15 14:10:47 compute2 kernel: [12845664.238321] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Oct 15 14:10:47 compute2 kernel: [12845664.244552] CR2: 00007fefb63ab020 CR3: 00000000359b4000 CR4: 00000000003426e0
Oct 15 14:10:47 compute2 kernel: [12845664.256759] Stack:
Oct 15 14:10:47 compute2 kernel: [12845664.262668] ffff8844d89a7b80 ffffffff811832e7 ffff8844d89a7b90 ffffffff818029a0
Oct 15 14:10:47 compute2 kernel: [12845664.274548] ffff8844d89a7bc8 ffffffffc0528556 ffff88154ad1ee18 ffff8827bdacfc00
Oct 15 14:10:47 compute2 kernel: [12845664.286431] 00007f8c408e7000 0000000000000000 ffff8827281b1130 ffff8844d89a7bf8
Oct 15 14:10:47 compute2 kernel: [12845664.298425] Call Trace:
Oct 15 14:10:47 compute2 kernel: [12845664.304266] [<ffffffff811832e7>] queued_spin_lock_slowpath+0xb/0xf
Oct 15 14:10:47 compute2 kernel: [12845664.310187] [<ffffffff818029a0>] _raw_spin_lock+0x20/0x30
Oct 15 14:10:47 compute2 kernel: [12845664.316030] [<ffffffffc0528556>] kvm_mmu_notifier_invalidate_page+0x36/0x80 [kvm]
Oct 15 14:10:47 compute2 kernel: [12845664.327413] [<ffffffff811d79fd>] __mmu_notifier_invalidate_page+0x4d/0x70
Oct 15 14:10:47 compute2 kernel: [12845664.333212] [<ffffffff811bfa3c>] try_to_unmap_one+0x3dc/0x480
Oct 15 14:10:47 compute2 kernel: [12845664.338950] [<ffffffff811c0473>] rmap_walk+0xe3/0x2d0
Oct 15 14:10:47 compute2 kernel: [12845664.344614] [<ffffffff811c084c>] try_to_unmap+0x5c/0x80
Oct 15 14:10:47 compute2 kernel: [12845664.350155] [<ffffffff811bf660>] ? page_remove_rmap+0x110/0x110
Oct 15 14:10:47 compute2 kernel: [12845664.355623] [<ffffffff811be8f0>] ? invalid_migration_vma+0x30/0x30
Oct 15 14:10:47 compute2 kernel: [12845664.360989] [<ffffffff811bfda0>] ? page_get_anon_vma+0x70/0x70
Oct 15 14:10:47 compute2 kernel: [12845664.366247] [<ffffffff811e589f>] migrate_pages+0x59f/0x6d0
Oct 15 14:10:47 compute2 kernel: [12845664.371386] [<ffffffff811e3880>] ? remove_migration_ptes+0x50/0x50
Oct 15 14:10:47 compute2 kernel: [12845664.376459] [<ffffffff811e6056>] migrate_misplaced_page+0xb6/0x130
Oct 15 14:10:47 compute2 kernel: [12845664.381432] [<ffffffff811b38a7>] handle_pte_fault+0x577/0x1480
Oct 15 14:10:47 compute2 kernel: [12845664.386302] [<ffffffff810fab11>] ? futex_wake+0x81/0x150
Oct 15 14:10:47 compute2 kernel: [12845664.391045] [<ffffffff810fd0f5>] ? do_futex+0xd5/0x520
Oct 15 14:10:47 compute2 kernel: [12845664.395668] [<ffffffff811b5620>] handle_mm_fault+0x250/0x540
Oct 15 14:10:47 compute2 kernel: [12845664.400188] [<ffffffff81068c1a>] __do_page_fault+0x19a/0x430
Oct 15 14:10:47 compute2 kernel: [12845664.404614] [<ffffffff810fd5b1>] ? SyS_futex+0x71/0x150
Oct 15 14:10:47 compute2 kernel: [12845664.408964] [<ffffffff81068ed2>] do_page_fault+0x22/0x30
Oct 15 14:10:47 compute2 kernel: [12845664.413197] [<ffffffff81804eb8>] page_fault+0x28/0x30
Oct 15 14:10:47 compute2 kernel: [12845664.417448] Code: 12 48 c1 ea 0c 83 e8 01 83 e2 30 48 98 48 81 c2 40 79 01 00 48 03 14 c5 40 8f f3 81 48 89 0a 8b 41 08 85 c0 75 0d f3 90 8b 41 08 <85> c0 74 f7 eb 02 f3 90 8b 17 66 85 d2 75 f7 39 f2 66 90 75 0f
Oct 15 14:10:51 compute2 kernel: [12845668.082552] NMI watchdog: BUG: soft lockup - CPU#22 stuck for 22s! [qemu-system-x86:27449]
Oct 15 14:10:51 compute2 kernel: [12845668.090830] Modules linked in: nf_conntrack_netlink xt_multiport xt_set ip6table_raw ip6table_mangle nf_conntrack_ipv6 xt_CT xt_connmark xt_mac xt_comment xt_physdev br_netfilter ip_set_hash_net ip_set nfnetlink iptable_raw vhost_net vhost macvtap macvlan veth xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi vport_vxlan openvswitch nf_defrag_ipv6 nf_conntrack intel_rapl x86_pkg_temp_thermal intel_powerclamp ipmi_ssif coretemp kvm_intel ipmi_devintf kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel mxm_wmi aes_x86_64 dcdbas dm_multipath lrw gf128mul glue_helper ablk_helper cryptd sb_edac shpchp edac_core mei_me ipmi_si lpc_ich mei acpi_power_meter 8250_fintek ipmi_msghandler wmi mac_hid 8021q garp mrp stp llc bonding lp parport bnx2x vxlan ip6_udp_tunnel tg3 udp_tunnel ahci ptp mdio megaraid_sas libahci libcrc32c pps_core fjes
Oct 15 14:10:51 compute2 kernel: [12845668.167986] CPU: 22 PID: 27449 Comm: qemu-system-x86 Tainted: G D L 4.4.0-62-generic #83~14.04.1-Ubuntu
Oct 15 14:10:51 compute2 kernel: [12845668.179009] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.3.4 11/08/2016
Oct 15 14:10:51 compute2 kernel: [12845668.190364] task: ffff88006fd3f000 ti: ffff8803a5e2c000 task.ti: ffff8803a5e2c000
Oct 15 14:10:51 compute2 kernel: [12845668.202194] RIP: 0010:[<ffffffff810c66da>] [<ffffffff810c66da>] native_queued_spin_lock_slowpath+0x10a/0x170
Oct 15 14:10:51 compute2 kernel: [12845668.214567] RSP: 0000:ffff8803a5e2fcb0 EFLAGS: 00000246
Oct 15 14:10:51 compute2 kernel: [12845668.220813] RAX: 0000000000000000 RBX: ffff88154ad1c000 RCX: ffff8827de8d7940
Oct 15 14:10:51 compute2 kernel: [12845668.233146] RDX: ffff884fdded7940 RSI: 00000000005c0000 RDI: ffff88154ad1c000
Oct 15 14:10:51 compute2 kernel: [12845668.245629] RBP: ffff8803a5e2fcb0 R08: 0000000000000101 R09: 0000000000000001
Oct 15 14:10:51 compute2 kernel: [12845668.258074] R10: 0000000000000000 R11: afb504000afb5041 R12: ffff88154ad1ee18
Oct 15 14:10:51 compute2 kernel: [12845668.270502] R13: ffff88154ad1c048 R14: 0000000000000001 R15: 00007f8bdc400000
Oct 15 14:10:51 compute2 kernel: [12845668.282912] FS: 00007f8c6268eac0(0000) GS:ffff8827de8c0000(0000) knlGS:0000000000000000

[Ubuntu Foundations Team Bug Bot (crichton)]

Thank you for taking the time to report this bug and helping to make Ubuntu better. It seems that your bug report is not filed about a specific source package though, rather it is just filed against Ubuntu in general. It is important that bug reports be filed about source packages so that people interested in the package can find the bugs about it. You can find some hints about determining what package your bug might be about at https://wiki.ubuntu.com/Bugs/FindRightPackage. You might also ask for help in the #ubuntu-bugs irc channel on Freenode.

To change the source package that this bug is filed about visit https://bugs.launchpad.net/ubuntu/+bug/1797997/+editstatus and add the package name in the text box next to the word Package.

[This is an automated message. I apologize if it reached you inappropriately; please just reply to this message indicating so.]

[Christian Ehrhardt  (paelzer)]

This bug is missing log files that will aid in diagnosing the problem. While running an Ubuntu kernel (not a mainline or third-party kernel) please enter the following command in a terminal window:

apport-collect 1797997

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.
(Well in fact I have copied it from another bug as this is what the bot would usually say on kernel bugs without logs)

[Ubuntu Kernel Bot (ubuntu-kernel-bot)]

This bug is missing log files that will aid in diagnosing the problem. While running an Ubuntu kernel (not a mainline or third-party kernel) please enter the following command in a terminal window:

apport-collect 1797997

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

[Christian Ehrhardt  (paelzer)]

The bug on is
  BUG_ON(!(*sptep & PT_PRESENT_MASK));
In kvm_zap_rmapp

While moved around a bit [1] the check is still present today.

It seems it bails out when trying to zapp a shadow page table entry that is still present.
I can't see from the trace how this might have happened.

Further evaluation up to the kernel experts, but maybe the pointers help them to identify a known fix.

[1]: https://github.com/torvalds/linux/commit/77fbbbd2f09fae486190bb2bd7142647dc2a6e8b

[LE QUANG LONG (longlq)]

I found a similar bug in RedHat: https://access.redhat.com/solutions/2924271

Could it be related to Page Modification Logging (PML) feature of Intel?