Activity log for bug #1691245

Date Who What changed Old value New value Message
2017-05-16 19:14:53 Vinod Nair bug added bug
2017-05-16 19:15:01 Vinod Nair nominated for series juniperopenstack/trunk
2017-05-16 19:15:01 Vinod Nair bug task added juniperopenstack/trunk
2017-05-16 19:15:01 Vinod Nair nominated for series juniperopenstack/r4.0
2017-05-16 19:15:01 Vinod Nair bug task added juniperopenstack/r4.0
2017-05-16 19:15:35 Vinod Nair juniperopenstack/r4.0: importance Undecided High
2017-05-16 19:15:57 Vinod Nair juniperopenstack/r4.0: assignee Raja Sivaramakrishnan (raja-u)
2017-05-16 19:16:02 Vinod Nair juniperopenstack/r4.0: milestone r4.0.0.0-fcs
2017-05-16 19:26:33 Vinod Nair summary DPDK: with Lbbas sometimes kernel crash is also seen DPDK: with Lbaas sometimes kernel crash is also seen
2017-05-16 19:27:39 Vinod Nair description With Lbaas on dpdk , vrouter crashes or the kernel crashes. This is to track the kernel crash 6459.111459] ------------[ cut here ]------------ [16459.126781] kernel BUG at /build/linux-lts-xenial-gUF4JR/linux-lts-xenial-4.4.0/net/core/dev.c:6943! [16459.161261] invalid opcode: 0000 [#1] SMP [16459.179984] Modules linked in: rte_kni(OE) igb_uio(OE) veth xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables uio nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi 8021q garp mrp stp llc bonding input_leds joydev ipmi_ssif intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm dm_multipath irqbypass crct10dif_pclmul crc32_pclmul aesni_intel aes_x86_64 lrw ioatdma gf128mul glue_helper ablk_helper cryptd sb_edac edac_core shpchp lpc_ich wmi ipmi_si ipmi_msghandler 8250_fintek mac_hid vhost_net [16459.451793] vhost macvtap macvlan lp parport ses enclosure hid_generic i40e ixgbe igb vxlan mpt3sas ip6_udp_tunnel usbhid i2c_algo_bit mdio udp_tunnel dca ahci hid raid_class ptp libahci scsi_transport_sas pps_core fjes [last unloaded: igb_uio] [16459.595452] CPU: 25 PID: 23353 Comm: ip Tainted: G OE 4.4.0-31-generic #50~14.04.1-Ubuntu [16459.673869] Hardware name: Supermicro SSG-6027R-E1R12L/X9DRD-7LN4F, BIOS 3.0 07/09/2013 [16459.757228] task: ffff8818528b1b80 ti: ffff88183f0bc000 task.ti: ffff88183f0bc000 [16459.845449] RIP: 0010:[<ffffffff816f6e88>] [<ffffffff816f6e88>] netdev_run_todo+0x2f8/0x300 [16459.938533] RSP: 0018:ffff88183f0bfbe8 EFLAGS: 00010206 [16459.986174] RAX: ffff8820351ce090 RBX: ffff8820351ce000 RCX: 0000000000000020 [16460.034563] RDX: 0000000000000100 RSI: 0000000000000100 RDI: ffffffff81d385a0 [16460.082646] RBP: ffff88183f0bfc30 R08: 0000000000000003 R09: 0000000000000000 [16460.130450] R10: 00000000353f9d01 R11: ffffea0080d4fe40 R12: ffff8820351ce450 [16460.178029] R13: 00000001003da50a R14: 00000001003da50a R15: 00000000000000fa [16460.224782] FS: 00007f5d5ebea740(0000) GS:ffff88203f440000(0000) knlGS:0000000000000000 [16460.317730] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [16460.364254] CR2: 0000000000610a68 CR3: 000000184daca000 CR4: 00000000000406e0 [16460.410719] Stack: [16460.455625] ffff88203458b100 ffff8820351ce000 ffff88183f0bfbf8 ffff88183f0bfbf8 [16460.545971] ffff88203458b100 ffff88203458b100 ffff882035ad7000 0000000000000020 [16460.634642] 0000000000000000 ffff88183f0bfc48 ffffffff8170259d ffff88203358e000 [16460.725128] Call Trace: [16460.768897] [<ffffffff8170259d>] rtnetlink_rcv+0x2d/0x30 [16460.812784] [<ffffffff81724d95>] netlink_unicast+0xf5/0x1e0 [16460.855893] [<ffffffff81725259>] netlink_sendmsg+0x3d9/0x630 [16460.898045] [<ffffffff8137cb7d>] ? aa_sock_msg_perm+0x5d/0x140 [16460.939790] [<ffffffff816d6d58>] sock_sendmsg+0x38/0x50 [16460.980983] [<ffffffff816d7680>] ___sys_sendmsg+0x270/0x290 [16461.021279] [<ffffffff811915f7>] ? lru_cache_add_active_or_unevictable+0x27/0x90 [16461.100271] [<ffffffff811b18b5>] ? handle_pte_fault+0xaf5/0x1470 [16461.140124] [<ffffffff812140a2>] ? __dentry_kill+0x162/0x1e0 [16461.179255] [<ffffffff816d7fd2>] __sys_sendmsg+0x42/0x80 [16461.217240] [<ffffffff816d8022>] SyS_sendmsg+0x12/0x20 [16461.254629] [<ffffffff817f6f36>] entry_SYSCALL_64_fastpath+0x16/0x75 [16461.292016] Code: 00 00 48 c7 c7 b8 97 b6 81 e8 e5 69 98 ff e9 14 ff ff ff be root@cmbu-starwars-01:/var/crash/201705152254# cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=14.04 DISTRIB_CODENAME=trusty DISTRIB_DESCRIPTION="Ubuntu 14.04.5 LTS" root@cmbu-starwars-01:/var/crash/201705152254# uname -a Linux cmbu-starwars-01 4.4.0-31-generic #50~14.04.1-Ubuntu SMP Wed Jul 13 01:07:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux With Lbaas on dpdk , vrouter crashes or the kernel crashes. This is to track the kernel crash 6459.111459] ------------[ cut here ]------------ [16459.126781] kernel BUG at /build/linux-lts-xenial-gUF4JR/linux-lts-xenial-4.4.0/net/core/dev.c:6943! [16459.161261] invalid opcode: 0000 [#1] SMP [16459.179984] Modules linked in: rte_kni(OE) igb_uio(OE) veth xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables uio nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi 8021q garp mrp stp llc bonding input_leds joydev ipmi_ssif intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm dm_multipath irqbypass crct10dif_pclmul crc32_pclmul aesni_intel aes_x86_64 lrw ioatdma gf128mul glue_helper ablk_helper cryptd sb_edac edac_core shpchp lpc_ich wmi ipmi_si ipmi_msghandler 8250_fintek mac_hid vhost_net [16459.451793] vhost macvtap macvlan lp parport ses enclosure hid_generic i40e ixgbe igb vxlan mpt3sas ip6_udp_tunnel usbhid i2c_algo_bit mdio udp_tunnel dca ahci hid raid_class ptp libahci scsi_transport_sas pps_core fjes [last unloaded: igb_uio] [16459.595452] CPU: 25 PID: 23353 Comm: ip Tainted: G OE 4.4.0-31-generic #50~14.04.1-Ubuntu [16459.673869] Hardware name: Supermicro SSG-6027R-E1R12L/X9DRD-7LN4F, BIOS 3.0 07/09/2013 [16459.757228] task: ffff8818528b1b80 ti: ffff88183f0bc000 task.ti: ffff88183f0bc000 [16459.845449] RIP: 0010:[<ffffffff816f6e88>] [<ffffffff816f6e88>] netdev_run_todo+0x2f8/0x300 [16459.938533] RSP: 0018:ffff88183f0bfbe8 EFLAGS: 00010206 [16459.986174] RAX: ffff8820351ce090 RBX: ffff8820351ce000 RCX: 0000000000000020 [16460.034563] RDX: 0000000000000100 RSI: 0000000000000100 RDI: ffffffff81d385a0 [16460.082646] RBP: ffff88183f0bfc30 R08: 0000000000000003 R09: 0000000000000000 [16460.130450] R10: 00000000353f9d01 R11: ffffea0080d4fe40 R12: ffff8820351ce450 [16460.178029] R13: 00000001003da50a R14: 00000001003da50a R15: 00000000000000fa [16460.224782] FS: 00007f5d5ebea740(0000) GS:ffff88203f440000(0000) knlGS:0000000000000000 [16460.317730] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [16460.364254] CR2: 0000000000610a68 CR3: 000000184daca000 CR4: 00000000000406e0 [16460.410719] Stack: [16460.455625] ffff88203458b100 ffff8820351ce000 ffff88183f0bfbf8 ffff88183f0bfbf8 [16460.545971] ffff88203458b100 ffff88203458b100 ffff882035ad7000 0000000000000020 [16460.634642] 0000000000000000 ffff88183f0bfc48 ffffffff8170259d ffff88203358e000 [16460.725128] Call Trace: [16460.768897] [<ffffffff8170259d>] rtnetlink_rcv+0x2d/0x30 [16460.812784] [<ffffffff81724d95>] netlink_unicast+0xf5/0x1e0 [16460.855893] [<ffffffff81725259>] netlink_sendmsg+0x3d9/0x630 [16460.898045] [<ffffffff8137cb7d>] ? aa_sock_msg_perm+0x5d/0x140 [16460.939790] [<ffffffff816d6d58>] sock_sendmsg+0x38/0x50 [16460.980983] [<ffffffff816d7680>] ___sys_sendmsg+0x270/0x290 [16461.021279] [<ffffffff811915f7>] ? lru_cache_add_active_or_unevictable+0x27/0x90 [16461.100271] [<ffffffff811b18b5>] ? handle_pte_fault+0xaf5/0x1470 [16461.140124] [<ffffffff812140a2>] ? __dentry_kill+0x162/0x1e0 [16461.179255] [<ffffffff816d7fd2>] __sys_sendmsg+0x42/0x80 [16461.217240] [<ffffffff816d8022>] SyS_sendmsg+0x12/0x20 [16461.254629] [<ffffffff817f6f36>] entry_SYSCALL_64_fastpath+0x16/0x75 [16461.292016] Code: 00 00 48 c7 c7 b8 97 b6 81 e8 e5 69 98 ff e9 14 ff ff ff be root@cmbu-starwars-01:/var/crash/201705152254# cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=14.04 DISTRIB_CODENAME=trusty DISTRIB_DESCRIPTION="Ubuntu 14.04.5 LTS" root@cmbu-starwars-01:/var/crash/201705152254# uname -a Linux cmbu-starwars-01 4.4.0-31-generic #50~14.04.1-Ubuntu SMP Wed Jul 13 01:07:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Kernel Coredump in : /cs-shared/bugs/1691245 Version: 4.0.0.0-5 Mitaka
2017-05-16 19:28:14 Kiran juniperopenstack/r4.0: assignee Raja Sivaramakrishnan (raja-u) Vinod Nair (vinodnair)
2017-05-16 19:28:23 Kiran juniperopenstack/trunk: assignee Raja Sivaramakrishnan (raja-u) Vinod Nair (vinodnair)
2017-05-16 19:38:34 Jeba Paulaiyan juniperopenstack/trunk: milestone r4.1.0.0-fcs
2017-05-16 19:38:47 Jeba Paulaiyan tags dpdk blocker crashes dpdk
2017-05-17 23:28:31 Jeba Paulaiyan juniperopenstack/r4.0: assignee Vinod Nair (vinodnair) Kiran (kiran-kn80)
2017-05-17 23:28:37 Jeba Paulaiyan juniperopenstack/trunk: assignee Vinod Nair (vinodnair) Kiran (kiran-kn80)
2017-05-23 23:42:45 Jeba Paulaiyan tags blocker crashes dpdk crashes dpdk releasenote
2017-05-23 23:43:00 Jeba Paulaiyan juniperopenstack/r4.0: milestone r4.0.0.0-fcs r4.0.1.0
2017-05-23 23:43:15 Jeba Paulaiyan juniperopenstack/r4.0: milestone r4.0.1.0 r4.0.0.0-fcs
2017-05-31 23:46:55 Jeba Paulaiyan juniperopenstack/r4.0: milestone r4.0.0.0-fcs r4.0.1.0
2017-06-05 18:51:31 Soumil Kulkarni information type Proprietary Public
2017-06-14 17:00:02 Vinod Nair summary DPDK: with Lbaas sometimes kernel crash is also seen DPDK: with Netns sometimes kernel crash is seen
2017-07-17 22:01:05 Kiran juniperopenstack/r4.0: assignee Kiran (kiran-kn80) Vinod Nair (vinodnair)
2017-07-17 22:01:14 Kiran juniperopenstack/trunk: assignee Kiran (kiran-kn80) Vinod Nair (vinodnair)
2017-08-21 23:54:29 Vinod Nair juniperopenstack/r4.0: assignee Vinod Nair (vinodnair) Raja Sivaramakrishnan (raja-u)
2017-08-21 23:54:38 Vinod Nair juniperopenstack/trunk: assignee Vinod Nair (vinodnair) Raja Sivaramakrishnan (raja-u)
2017-09-07 22:35:05 Raja Sivaramakrishnan juniperopenstack/r4.0: assignee Raja Sivaramakrishnan (raja-u) Vinod Nair (vinodnair)
2017-09-07 22:35:24 Raja Sivaramakrishnan juniperopenstack/trunk: assignee Raja Sivaramakrishnan (raja-u) Vinod Nair (vinodnair)
2017-09-07 23:29:02 Rudra Rugge juniperopenstack/r4.0: milestone r4.0.1.0 r4.0.2.0
2017-09-08 18:54:52 ram yadav juniperopenstack/r4.0: status New In Progress
2017-09-08 18:54:59 ram yadav juniperopenstack/trunk: status New In Progress
2017-09-12 00:10:13 OpenContrail Admin juniperopenstack/r4.0: status In Progress Fix Committed
2017-09-12 00:10:14 OpenContrail Admin juniperopenstack/r4.0: milestone r4.0.2.0 r4.0.1.0
2017-09-12 00:10:21 OpenContrail Admin juniperopenstack/trunk: status In Progress Fix Committed