Activity log for bug #905219

Date Who What changed Old value New value Message
2011-12-16 09:59:49 Shyam bug added bug
2011-12-16 09:59:49 Shyam attachment added Natty Netfilter crash-1.png https://bugs.launchpad.net/bugs/905219/+attachment/2635685/+files/Natty%20Netfilter%20crash-1.png
2011-12-16 10:00:12 Brad Figg linux (Ubuntu): status New Confirmed
2011-12-16 10:00:14 Brad Figg tags amd64 apport-bug oneiric amd64 apport-bug natty oneiric
2011-12-16 10:00:33 Shyam attachment added Natty Netfilter crash-2.png https://bugs.launchpad.net/ubuntu/+source/linux/+bug/905219/+attachment/2635699/+files/Natty%20Netfilter%20crash-2.png
2011-12-16 10:00:54 Shyam attachment added Oneiric Netfilter crash.png https://bugs.launchpad.net/ubuntu/+source/linux/+bug/905219/+attachment/2635700/+files/Oneiric%20Netfilter%20crash.png
2011-12-16 14:37:32 Joseph Salisbury linux (Ubuntu): importance Undecided High
2011-12-16 14:37:53 Joseph Salisbury tags amd64 apport-bug natty oneiric amd64 apport-bug kernel-da-key natty needs-upstream-testing oneiric
2012-01-06 09:44:00 Jasper den Hertog bug added subscriber Jasper den Hertog
2012-01-06 11:05:31 Kiall Mac Innes bug task added nova
2012-01-06 11:10:59 Kiall Mac Innes attachment added panic-20120106.log https://bugs.launchpad.net/nova/+bug/905219/+attachment/2659818/+files/panic-20120106.log
2012-01-06 11:11:56 Kiall Mac Innes summary Linux Kernel crash in Netfilter both in Natty (2.6.38-8-server) and oneiric(3.0.0-13-server) kernels Linux Kernel crash in Netfilter both in Natty (2.6.38-8-server) and oneiric(3.0.0-13-server/3.0.0-14-server) kernels
2012-01-06 11:34:52 Kiall Mac Innes attachment added uptime-day.png https://bugs.launchpad.net/ubuntu/+source/linux/+bug/905219/+attachment/2659854/+files/uptime-day.png
2012-01-09 16:41:07 Kiall Mac Innes tags amd64 apport-bug kernel-da-key natty needs-upstream-testing oneiric amd64 apport-bug kernel-da-key kernel-fixed-upstream-v3.2-precise natty oneiric
2012-01-26 22:52:58 Brian Waldon bug task deleted nova
2012-02-29 18:43:27 Robbie Williamson nominated for series Ubuntu Natty
2012-02-29 18:43:27 Robbie Williamson bug task added linux (Ubuntu Natty)
2012-02-29 18:43:27 Robbie Williamson nominated for series Ubuntu Oneiric
2012-02-29 18:43:27 Robbie Williamson bug task added linux (Ubuntu Oneiric)
2012-02-29 20:16:18 Launchpad Janitor linux (Ubuntu Natty): status New Confirmed
2012-02-29 20:16:18 Launchpad Janitor linux (Ubuntu Oneiric): status New Confirmed
2012-03-01 14:10:56 Chris J Arges linux (Ubuntu Natty): assignee Chris J Arges (christopherarges)
2012-03-01 14:11:00 Chris J Arges linux (Ubuntu Oneiric): assignee Chris J Arges (christopherarges)
2012-03-01 14:48:02 Joseph Salisbury linux (Ubuntu Natty): importance Undecided Medium
2012-03-01 14:48:05 Joseph Salisbury linux (Ubuntu Oneiric): importance Undecided Medium
2012-03-01 15:30:11 Chris J Arges bug added subscriber Tim Gardner
2012-03-02 21:37:57 Chris J Arges bug watch added https://bugzilla.netfilter.org/bugzilla3/show_bug.cgi?id=765
2012-03-05 13:19:04 Jose Plans bug added subscriber Jose Plans
2012-03-05 23:57:51 Peter Matulis bug task added linux
2012-03-07 17:27:05 Matt Rae bug added subscriber Matt Rae
2012-03-26 15:51:48 Chris J Arges linux (Ubuntu Natty): status Confirmed Invalid
2012-03-26 15:51:53 Chris J Arges linux (Ubuntu Oneiric): status Confirmed Invalid
2012-03-26 15:51:56 Chris J Arges linux (Ubuntu): status Triaged Invalid
2012-05-23 19:24:13 Joseph Salisbury tags amd64 apport-bug kernel-da-key kernel-fixed-upstream-v3.2-precise natty oneiric amd64 apport-bug kernel-da-key kernel-fixed-upstream-precise natty oneiric
2012-05-23 19:24:22 Joseph Salisbury tags amd64 apport-bug kernel-da-key kernel-fixed-upstream-precise natty oneiric amd64 apport-bug kernel-da-key kernel-fixed-upstream natty oneiric precise
2012-06-15 21:19:06 Chris J Arges linux (Ubuntu Natty): status Invalid Confirmed
2012-06-15 21:19:08 Chris J Arges linux (Ubuntu Oneiric): status Invalid Confirmed
2012-06-15 21:19:11 Chris J Arges linux (Ubuntu): status Invalid Won't Fix
2012-06-15 21:19:13 Chris J Arges linux (Ubuntu): status Won't Fix New
2012-06-19 15:11:06 Chris J Arges nominated for series Ubuntu Precise
2012-06-19 15:11:06 Chris J Arges bug task added linux (Ubuntu Precise)
2012-06-19 15:11:14 Chris J Arges linux (Ubuntu Precise): status New Fix Released
2012-06-19 15:11:27 Chris J Arges linux (Ubuntu): status New Fix Released
2012-06-25 15:26:10 Chris J Arges linux (Ubuntu Natty): status Confirmed In Progress
2012-06-27 16:19:52 Chris J Arges description On multiple servers on which we have Ubuntu versions installed we periodically hit this kernel panic. in netfilter flowpath The console freezes & the only way is to physically reboot the servers. We run KVM and few VM's on the physical servers. On the physical eth's bridges are created and TAP interfaces are setup into the bridges. These TAP interfaces are connected into KVM through libvirt (we primarily use openstack for the VM management). This problem happened in Natty 2.6.38-8-server version. After looking at the below links, we thought this could be a problem on 2.6.38-8-server kernel that is bundled along with Natty & decided to move to oneiric running 3.0 kernel. http://lkml.indiana.edu/hypermail/linux/kernel/1106.0/00755.html https://lkml.org/lkml/2011/6/1/754 http://www.spinics.net/lists/netfilter-devel/msg17239.html https://lkml.org/lkml/2011/2/3/147 However, this exact problem is repeating in oneiric kernels. We request you to pls look at this issue asap. I will be happy to provide you any additional information that you will need. Thanks [ 5445.359446] [<ffffffffa0395200>] ? br_nf_pre_routing_finish_bridge+0x60/0xd0 [bridge] [ 5445.372671] [<ffffffffa0396808>] br_nf_pre_routing_finish+0x328/0x360 [bridge] [ 5445.385984] [<ffffffffa0396b96>] br_nf_pre_routing+0x356/0x370 [bridge] [ 5445.393255] [<ffffffff815165d5>] nf_iterate+0x85/0xc0 [ 5445.400827] [<ffffffffa038ffd0>] ? br_handle_local_finish+0x50/0x50 [bridge] [ 5445.408643] [<ffffffff81516686>] nf_hook_slow+0x76/0x130 [ 5445.416438] [<ffffffffa038ffd0>] ? br_hanlde_local_finish+0x50/0x50 [bridge] [ 5445.424202] [<ffffffffa0390424>] br_handle_frame+0x1b4/0x260 [bridge] [ 5445.431824] [<ffffffffa0390270>] ? br_hanlde_frame_finish+0x2a0/0x2a0 [bridge] [ 5445.446876] [<ffffffff814e9b8d>] __netif_receive_skb+0x17d/0x540 [ 5445.454815] [<ffffffff814ea191>] process_backlog+0xb1/0x190 [ 5445.462790] [<ffffffff814eb2f4>] net_rx_action+0x134/0x290 [ 5445.470445] [<ffffffff81065ea8>] __do_softirq+0xa8/0x210 [ 5445.478364] [<ffffffff8160831c>] call_softirq+0x1c/0x30 [ 5445.486145] <EOI> [<ffffffff8100c295>] ? do_softirq+0x65/0xa0 [ 5445.494076] [<ffffffff814eb7d8>] netif_rx_ni+0x28/0x30 [ 5445.501902] [<ffffffff8144c702>] tun_chr_aio_write+0x342/0x4f0 [ 5445.509771] [<ffffffff8144c3c0>] ? tun_chr_aio_read+0xd0/0xd0 [ 5445.517864] [<ffffffff81167db3>] do_sync_readv_writev+0xd3/0x110 [ 5445.526011] [<ffffffff81281ecc>] ? security_file_permission+0x2c/0xb0 [ 5445.534177] [<ffffffff811674b1>] ? rw_verify_area+0x61/0xf0 [ 5445.542339] [<ffffffff8116807d>] do_readv_write_v+0xcd/0x1d0 [ 5445.550227] [<ffffffff811681bc>] vfs_writev+0x3c/0x50 [ 5445.558337] [<ffffffff8116831a>] sys_writev+0x4a/0xb0 [ 5445.566288] [<ffffffff81607102>] system_call_fastpath+0x16/0x1b [ 5445.574267] ---[ end trace f585024e7045bff8 ]--- ProblemType: Bug DistroRelease: Ubuntu 11.10 Package: linux-image-3.0.0-13-server 3.0.0-13.22 ProcVersionSignature: Ubuntu 3.0.0-13.22-server 3.0.6 Uname: Linux 3.0.0-13-server x86_64 AlsaDevices: Error: command ['ls', '-l', '/dev/snd/'] failed with exit code 2: ls: cannot access /dev/snd/: No such file or directory AplayDevices: Error: [Errno 2] No such file or directory ApportVersion: 1.23-0ubuntu4 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory CRDA: Error: [Errno 2] No such file or directory Date: Fri Dec 16 09:51:41 2011 HibernationDevice: RESUME=UUID=5d83c5ae-1432-4ed0-be62-0b5bb54d8989 IwConfig: Error: [Errno 2] No such file or directory MachineType: Dell Inc. PowerEdge R710 PciMultimedia: ProcEnviron: LANGUAGE=en_US: PATH=(custom, no user) LANG=en_US.UTF-8 SHELL=/bin/bash ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.0.0-13-server root=UUID=6adff529-7713-48d3-9174-d7e8f7fe5053 ro splash quiet vt.handoff=7 RelatedPackageVersions: linux-restricted-modules-3.0.0-13-server N/A linux-backports-modules-3.0.0-13-server N/A linux-firmware 1.60 RfKill: Error: [Errno 2] No such file or directory SourcePackage: linux UpgradeStatus: Upgraded to oneiric on 2011-12-09 (6 days ago) dmi.bios.date: 01/31/2011 dmi.bios.vendor: Dell Inc. dmi.bios.version: 3.0.0 dmi.board.name: 00NH4P dmi.board.vendor: Dell Inc. dmi.board.version: A12 dmi.chassis.type: 23 dmi.chassis.vendor: Dell Inc. dmi.modalias: dmi:bvnDellInc.:bvr3.0.0:bd01/31/2011:svnDellInc.:pnPowerEdgeR710:pvr:rvnDellInc.:rn00NH4P:rvrA12:cvnDellInc.:ct23:cvr: dmi.product.name: PowerEdge R710 dmi.sys.vendor: Dell Inc. SRU Justification: Impact: When running KVM with a few VM's occasionally kernel panics will occur. Fix: Cherry-pick from a504b86e718a425ea4a34e2f95b5cf0545ddfd8d. This is present in Precise onwards. Testcase: 0) Download attached netperf.tgz testcase. 1) Launch 3 instances (for example Ubuntu Natty/Oneiric). 2) Assign a public IP to each instance. 3) Copy all files from netperf.tgz to /root on the 3 instances. 4) Run the following command on each instance: $ /root/netserver -p 12865 5) Create a file named 'remote_hosts' with the following content and copy it to /root on the 1st of the 3 instances: REMOTE_HOSTS[0]=<public IP of 2nd instance> REMOTE_HOSTS[1]=<public IP of 3rd instance> NUM_REMOTE_HOSTS=2 6) Run the following command on the 1st instance to start the test: $ cd /root $ PATH=$PATH:. ./runemomniaggdemo.sh | tee overall.log 7) The machine will eventually panic. -- On multiple servers on which we have Ubuntu versions installed we periodically hit this kernel panic. in netfilter flowpath The console freezes & the only way is to physically reboot the servers. We run KVM and few VM's on the physical servers. On the physical eth's bridges are created and TAP interfaces are setup into the bridges. These TAP interfaces are connected into KVM through libvirt (we primarily use openstack for the VM management). This problem happened in Natty 2.6.38-8-server version. After looking at the below links, we thought this could be a problem on 2.6.38-8-server kernel that is bundled along with Natty & decided to move to oneiric running 3.0 kernel. http://lkml.indiana.edu/hypermail/linux/kernel/1106.0/00755.html https://lkml.org/lkml/2011/6/1/754 http://www.spinics.net/lists/netfilter-devel/msg17239.html https://lkml.org/lkml/2011/2/3/147 However, this exact problem is repeating in oneiric kernels. We request you to pls look at this issue asap. I will be happy to provide you any additional information that you will need. Thanks [ 5445.359446] [<ffffffffa0395200>] ? br_nf_pre_routing_finish_bridge+0x60/0xd0 [bridge] [ 5445.372671] [<ffffffffa0396808>] br_nf_pre_routing_finish+0x328/0x360 [bridge] [ 5445.385984] [<ffffffffa0396b96>] br_nf_pre_routing+0x356/0x370 [bridge] [ 5445.393255] [<ffffffff815165d5>] nf_iterate+0x85/0xc0 [ 5445.400827] [<ffffffffa038ffd0>] ? br_handle_local_finish+0x50/0x50 [bridge] [ 5445.408643] [<ffffffff81516686>] nf_hook_slow+0x76/0x130 [ 5445.416438] [<ffffffffa038ffd0>] ? br_hanlde_local_finish+0x50/0x50 [bridge] [ 5445.424202] [<ffffffffa0390424>] br_handle_frame+0x1b4/0x260 [bridge] [ 5445.431824] [<ffffffffa0390270>] ? br_hanlde_frame_finish+0x2a0/0x2a0 [bridge] [ 5445.446876] [<ffffffff814e9b8d>] __netif_receive_skb+0x17d/0x540 [ 5445.454815] [<ffffffff814ea191>] process_backlog+0xb1/0x190 [ 5445.462790] [<ffffffff814eb2f4>] net_rx_action+0x134/0x290 [ 5445.470445] [<ffffffff81065ea8>] __do_softirq+0xa8/0x210 [ 5445.478364] [<ffffffff8160831c>] call_softirq+0x1c/0x30 [ 5445.486145] <EOI> [<ffffffff8100c295>] ? do_softirq+0x65/0xa0 [ 5445.494076] [<ffffffff814eb7d8>] netif_rx_ni+0x28/0x30 [ 5445.501902] [<ffffffff8144c702>] tun_chr_aio_write+0x342/0x4f0 [ 5445.509771] [<ffffffff8144c3c0>] ? tun_chr_aio_read+0xd0/0xd0 [ 5445.517864] [<ffffffff81167db3>] do_sync_readv_writev+0xd3/0x110 [ 5445.526011] [<ffffffff81281ecc>] ? security_file_permission+0x2c/0xb0 [ 5445.534177] [<ffffffff811674b1>] ? rw_verify_area+0x61/0xf0 [ 5445.542339] [<ffffffff8116807d>] do_readv_write_v+0xcd/0x1d0 [ 5445.550227] [<ffffffff811681bc>] vfs_writev+0x3c/0x50 [ 5445.558337] [<ffffffff8116831a>] sys_writev+0x4a/0xb0 [ 5445.566288] [<ffffffff81607102>] system_call_fastpath+0x16/0x1b [ 5445.574267] ---[ end trace f585024e7045bff8 ]--- ProblemType: Bug DistroRelease: Ubuntu 11.10 Package: linux-image-3.0.0-13-server 3.0.0-13.22 ProcVersionSignature: Ubuntu 3.0.0-13.22-server 3.0.6 Uname: Linux 3.0.0-13-server x86_64 AlsaDevices: Error: command ['ls', '-l', '/dev/snd/'] failed with exit code 2: ls: cannot access /dev/snd/: No such file or directory AplayDevices: Error: [Errno 2] No such file or directory ApportVersion: 1.23-0ubuntu4 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory CRDA: Error: [Errno 2] No such file or directory Date: Fri Dec 16 09:51:41 2011 HibernationDevice: RESUME=UUID=5d83c5ae-1432-4ed0-be62-0b5bb54d8989 IwConfig: Error: [Errno 2] No such file or directory MachineType: Dell Inc. PowerEdge R710 PciMultimedia: ProcEnviron:  LANGUAGE=en_US:  PATH=(custom, no user)  LANG=en_US.UTF-8  SHELL=/bin/bash ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.0.0-13-server root=UUID=6adff529-7713-48d3-9174-d7e8f7fe5053 ro splash quiet vt.handoff=7 RelatedPackageVersions:  linux-restricted-modules-3.0.0-13-server N/A  linux-backports-modules-3.0.0-13-server N/A  linux-firmware 1.60 RfKill: Error: [Errno 2] No such file or directory SourcePackage: linux UpgradeStatus: Upgraded to oneiric on 2011-12-09 (6 days ago) dmi.bios.date: 01/31/2011 dmi.bios.vendor: Dell Inc. dmi.bios.version: 3.0.0 dmi.board.name: 00NH4P dmi.board.vendor: Dell Inc. dmi.board.version: A12 dmi.chassis.type: 23 dmi.chassis.vendor: Dell Inc. dmi.modalias: dmi:bvnDellInc.:bvr3.0.0:bd01/31/2011:svnDellInc.:pnPowerEdgeR710:pvr:rvnDellInc.:rn00NH4P:rvrA12:cvnDellInc.:ct23:cvr: dmi.product.name: PowerEdge R710 dmi.sys.vendor: Dell Inc.
2012-06-27 16:20:16 Chris J Arges attachment added netperf.tgz https://bugs.launchpad.net/ubuntu/+source/linux/+bug/905219/+attachment/3205727/+files/netperf.tgz
2012-06-27 16:49:37 Chris J Arges description SRU Justification: Impact: When running KVM with a few VM's occasionally kernel panics will occur. Fix: Cherry-pick from a504b86e718a425ea4a34e2f95b5cf0545ddfd8d. This is present in Precise onwards. Testcase: 0) Download attached netperf.tgz testcase. 1) Launch 3 instances (for example Ubuntu Natty/Oneiric). 2) Assign a public IP to each instance. 3) Copy all files from netperf.tgz to /root on the 3 instances. 4) Run the following command on each instance: $ /root/netserver -p 12865 5) Create a file named 'remote_hosts' with the following content and copy it to /root on the 1st of the 3 instances: REMOTE_HOSTS[0]=<public IP of 2nd instance> REMOTE_HOSTS[1]=<public IP of 3rd instance> NUM_REMOTE_HOSTS=2 6) Run the following command on the 1st instance to start the test: $ cd /root $ PATH=$PATH:. ./runemomniaggdemo.sh | tee overall.log 7) The machine will eventually panic. -- On multiple servers on which we have Ubuntu versions installed we periodically hit this kernel panic. in netfilter flowpath The console freezes & the only way is to physically reboot the servers. We run KVM and few VM's on the physical servers. On the physical eth's bridges are created and TAP interfaces are setup into the bridges. These TAP interfaces are connected into KVM through libvirt (we primarily use openstack for the VM management). This problem happened in Natty 2.6.38-8-server version. After looking at the below links, we thought this could be a problem on 2.6.38-8-server kernel that is bundled along with Natty & decided to move to oneiric running 3.0 kernel. http://lkml.indiana.edu/hypermail/linux/kernel/1106.0/00755.html https://lkml.org/lkml/2011/6/1/754 http://www.spinics.net/lists/netfilter-devel/msg17239.html https://lkml.org/lkml/2011/2/3/147 However, this exact problem is repeating in oneiric kernels. We request you to pls look at this issue asap. I will be happy to provide you any additional information that you will need. Thanks [ 5445.359446] [<ffffffffa0395200>] ? br_nf_pre_routing_finish_bridge+0x60/0xd0 [bridge] [ 5445.372671] [<ffffffffa0396808>] br_nf_pre_routing_finish+0x328/0x360 [bridge] [ 5445.385984] [<ffffffffa0396b96>] br_nf_pre_routing+0x356/0x370 [bridge] [ 5445.393255] [<ffffffff815165d5>] nf_iterate+0x85/0xc0 [ 5445.400827] [<ffffffffa038ffd0>] ? br_handle_local_finish+0x50/0x50 [bridge] [ 5445.408643] [<ffffffff81516686>] nf_hook_slow+0x76/0x130 [ 5445.416438] [<ffffffffa038ffd0>] ? br_hanlde_local_finish+0x50/0x50 [bridge] [ 5445.424202] [<ffffffffa0390424>] br_handle_frame+0x1b4/0x260 [bridge] [ 5445.431824] [<ffffffffa0390270>] ? br_hanlde_frame_finish+0x2a0/0x2a0 [bridge] [ 5445.446876] [<ffffffff814e9b8d>] __netif_receive_skb+0x17d/0x540 [ 5445.454815] [<ffffffff814ea191>] process_backlog+0xb1/0x190 [ 5445.462790] [<ffffffff814eb2f4>] net_rx_action+0x134/0x290 [ 5445.470445] [<ffffffff81065ea8>] __do_softirq+0xa8/0x210 [ 5445.478364] [<ffffffff8160831c>] call_softirq+0x1c/0x30 [ 5445.486145] <EOI> [<ffffffff8100c295>] ? do_softirq+0x65/0xa0 [ 5445.494076] [<ffffffff814eb7d8>] netif_rx_ni+0x28/0x30 [ 5445.501902] [<ffffffff8144c702>] tun_chr_aio_write+0x342/0x4f0 [ 5445.509771] [<ffffffff8144c3c0>] ? tun_chr_aio_read+0xd0/0xd0 [ 5445.517864] [<ffffffff81167db3>] do_sync_readv_writev+0xd3/0x110 [ 5445.526011] [<ffffffff81281ecc>] ? security_file_permission+0x2c/0xb0 [ 5445.534177] [<ffffffff811674b1>] ? rw_verify_area+0x61/0xf0 [ 5445.542339] [<ffffffff8116807d>] do_readv_write_v+0xcd/0x1d0 [ 5445.550227] [<ffffffff811681bc>] vfs_writev+0x3c/0x50 [ 5445.558337] [<ffffffff8116831a>] sys_writev+0x4a/0xb0 [ 5445.566288] [<ffffffff81607102>] system_call_fastpath+0x16/0x1b [ 5445.574267] ---[ end trace f585024e7045bff8 ]--- ProblemType: Bug DistroRelease: Ubuntu 11.10 Package: linux-image-3.0.0-13-server 3.0.0-13.22 ProcVersionSignature: Ubuntu 3.0.0-13.22-server 3.0.6 Uname: Linux 3.0.0-13-server x86_64 AlsaDevices: Error: command ['ls', '-l', '/dev/snd/'] failed with exit code 2: ls: cannot access /dev/snd/: No such file or directory AplayDevices: Error: [Errno 2] No such file or directory ApportVersion: 1.23-0ubuntu4 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory CRDA: Error: [Errno 2] No such file or directory Date: Fri Dec 16 09:51:41 2011 HibernationDevice: RESUME=UUID=5d83c5ae-1432-4ed0-be62-0b5bb54d8989 IwConfig: Error: [Errno 2] No such file or directory MachineType: Dell Inc. PowerEdge R710 PciMultimedia: ProcEnviron:  LANGUAGE=en_US:  PATH=(custom, no user)  LANG=en_US.UTF-8  SHELL=/bin/bash ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.0.0-13-server root=UUID=6adff529-7713-48d3-9174-d7e8f7fe5053 ro splash quiet vt.handoff=7 RelatedPackageVersions:  linux-restricted-modules-3.0.0-13-server N/A  linux-backports-modules-3.0.0-13-server N/A  linux-firmware 1.60 RfKill: Error: [Errno 2] No such file or directory SourcePackage: linux UpgradeStatus: Upgraded to oneiric on 2011-12-09 (6 days ago) dmi.bios.date: 01/31/2011 dmi.bios.vendor: Dell Inc. dmi.bios.version: 3.0.0 dmi.board.name: 00NH4P dmi.board.vendor: Dell Inc. dmi.board.version: A12 dmi.chassis.type: 23 dmi.chassis.vendor: Dell Inc. dmi.modalias: dmi:bvnDellInc.:bvr3.0.0:bd01/31/2011:svnDellInc.:pnPowerEdgeR710:pvr:rvnDellInc.:rn00NH4P:rvrA12:cvnDellInc.:ct23:cvr: dmi.product.name: PowerEdge R710 dmi.sys.vendor: Dell Inc. SRU Justification: Impact: When running KVM with a few VM's with physical eth bridges and TAP interfaces connected between KVM (via libvirt) and the bridge, occasionally kernel panics will occur. Fix: Cherry-pick from a504b86e718a425ea4a34e2f95b5cf0545ddfd8d. This is present in Precise onwards. Testcase: 0) Download attached netperf.tgz testcase. 1) Launch 3 instances (for example Ubuntu Natty/Oneiric). 2) Assign a public IP to each instance. 3) Copy all files from netperf.tgz to /root on the 3 instances. 4) Run the following command on each instance: $ /root/netserver -p 12865 5) Create a file named 'remote_hosts' with the following content and copy it to /root on the 1st of the 3 instances: REMOTE_HOSTS[0]=<public IP of 2nd instance> REMOTE_HOSTS[1]=<public IP of 3rd instance> NUM_REMOTE_HOSTS=2 6) Run the following command on the 1st instance to start the test: $ cd /root $ PATH=$PATH:. ./runemomniaggdemo.sh | tee overall.log 7) The machine will eventually panic. -- On multiple servers on which we have Ubuntu versions installed we periodically hit this kernel panic. in netfilter flowpath The console freezes & the only way is to physically reboot the servers. We run KVM and few VM's on the physical servers. On the physical eth's bridges are created and TAP interfaces are setup into the bridges. These TAP interfaces are connected into KVM through libvirt (we primarily use openstack for the VM management). This problem happened in Natty 2.6.38-8-server version. After looking at the below links, we thought this could be a problem on 2.6.38-8-server kernel that is bundled along with Natty & decided to move to oneiric running 3.0 kernel. http://lkml.indiana.edu/hypermail/linux/kernel/1106.0/00755.html https://lkml.org/lkml/2011/6/1/754 http://www.spinics.net/lists/netfilter-devel/msg17239.html https://lkml.org/lkml/2011/2/3/147 However, this exact problem is repeating in oneiric kernels. We request you to pls look at this issue asap. I will be happy to provide you any additional information that you will need. Thanks [ 5445.359446] [<ffffffffa0395200>] ? br_nf_pre_routing_finish_bridge+0x60/0xd0 [bridge] [ 5445.372671] [<ffffffffa0396808>] br_nf_pre_routing_finish+0x328/0x360 [bridge] [ 5445.385984] [<ffffffffa0396b96>] br_nf_pre_routing+0x356/0x370 [bridge] [ 5445.393255] [<ffffffff815165d5>] nf_iterate+0x85/0xc0 [ 5445.400827] [<ffffffffa038ffd0>] ? br_handle_local_finish+0x50/0x50 [bridge] [ 5445.408643] [<ffffffff81516686>] nf_hook_slow+0x76/0x130 [ 5445.416438] [<ffffffffa038ffd0>] ? br_hanlde_local_finish+0x50/0x50 [bridge] [ 5445.424202] [<ffffffffa0390424>] br_handle_frame+0x1b4/0x260 [bridge] [ 5445.431824] [<ffffffffa0390270>] ? br_hanlde_frame_finish+0x2a0/0x2a0 [bridge] [ 5445.446876] [<ffffffff814e9b8d>] __netif_receive_skb+0x17d/0x540 [ 5445.454815] [<ffffffff814ea191>] process_backlog+0xb1/0x190 [ 5445.462790] [<ffffffff814eb2f4>] net_rx_action+0x134/0x290 [ 5445.470445] [<ffffffff81065ea8>] __do_softirq+0xa8/0x210 [ 5445.478364] [<ffffffff8160831c>] call_softirq+0x1c/0x30 [ 5445.486145] <EOI> [<ffffffff8100c295>] ? do_softirq+0x65/0xa0 [ 5445.494076] [<ffffffff814eb7d8>] netif_rx_ni+0x28/0x30 [ 5445.501902] [<ffffffff8144c702>] tun_chr_aio_write+0x342/0x4f0 [ 5445.509771] [<ffffffff8144c3c0>] ? tun_chr_aio_read+0xd0/0xd0 [ 5445.517864] [<ffffffff81167db3>] do_sync_readv_writev+0xd3/0x110 [ 5445.526011] [<ffffffff81281ecc>] ? security_file_permission+0x2c/0xb0 [ 5445.534177] [<ffffffff811674b1>] ? rw_verify_area+0x61/0xf0 [ 5445.542339] [<ffffffff8116807d>] do_readv_write_v+0xcd/0x1d0 [ 5445.550227] [<ffffffff811681bc>] vfs_writev+0x3c/0x50 [ 5445.558337] [<ffffffff8116831a>] sys_writev+0x4a/0xb0 [ 5445.566288] [<ffffffff81607102>] system_call_fastpath+0x16/0x1b [ 5445.574267] ---[ end trace f585024e7045bff8 ]--- ProblemType: Bug DistroRelease: Ubuntu 11.10 Package: linux-image-3.0.0-13-server 3.0.0-13.22 ProcVersionSignature: Ubuntu 3.0.0-13.22-server 3.0.6 Uname: Linux 3.0.0-13-server x86_64 AlsaDevices: Error: command ['ls', '-l', '/dev/snd/'] failed with exit code 2: ls: cannot access /dev/snd/: No such file or directory AplayDevices: Error: [Errno 2] No such file or directory ApportVersion: 1.23-0ubuntu4 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory CRDA: Error: [Errno 2] No such file or directory Date: Fri Dec 16 09:51:41 2011 HibernationDevice: RESUME=UUID=5d83c5ae-1432-4ed0-be62-0b5bb54d8989 IwConfig: Error: [Errno 2] No such file or directory MachineType: Dell Inc. PowerEdge R710 PciMultimedia: ProcEnviron:  LANGUAGE=en_US:  PATH=(custom, no user)  LANG=en_US.UTF-8  SHELL=/bin/bash ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.0.0-13-server root=UUID=6adff529-7713-48d3-9174-d7e8f7fe5053 ro splash quiet vt.handoff=7 RelatedPackageVersions:  linux-restricted-modules-3.0.0-13-server N/A  linux-backports-modules-3.0.0-13-server N/A  linux-firmware 1.60 RfKill: Error: [Errno 2] No such file or directory SourcePackage: linux UpgradeStatus: Upgraded to oneiric on 2011-12-09 (6 days ago) dmi.bios.date: 01/31/2011 dmi.bios.vendor: Dell Inc. dmi.bios.version: 3.0.0 dmi.board.name: 00NH4P dmi.board.vendor: Dell Inc. dmi.board.version: A12 dmi.chassis.type: 23 dmi.chassis.vendor: Dell Inc. dmi.modalias: dmi:bvnDellInc.:bvr3.0.0:bd01/31/2011:svnDellInc.:pnPowerEdgeR710:pvr:rvnDellInc.:rn00NH4P:rvrA12:cvnDellInc.:ct23:cvr: dmi.product.name: PowerEdge R710 dmi.sys.vendor: Dell Inc.
2012-06-27 18:45:19 Tim Gardner linux (Ubuntu Natty): status In Progress Fix Committed
2012-06-27 18:45:25 Tim Gardner linux (Ubuntu Oneiric): status Confirmed Fix Committed
2012-07-09 10:10:13 Luis Henriques tags amd64 apport-bug kernel-da-key kernel-fixed-upstream natty oneiric precise amd64 apport-bug kernel-da-key kernel-fixed-upstream natty oneiric precise verification-needed-natty
2012-07-09 10:17:33 Luis Henriques tags amd64 apport-bug kernel-da-key kernel-fixed-upstream natty oneiric precise verification-needed-natty amd64 apport-bug kernel-da-key kernel-fixed-upstream natty oneiric precise verification-needed-natty verification-needed-oneiric
2012-07-13 15:02:16 Chris J Arges tags amd64 apport-bug kernel-da-key kernel-fixed-upstream natty oneiric precise verification-needed-natty verification-needed-oneiric amd64 apport-bug kernel-da-key kernel-fixed-upstream natty oneiric precise verification-done-natty verification-needed-oneiric
2012-07-13 16:30:55 Luis Henriques tags amd64 apport-bug kernel-da-key kernel-fixed-upstream natty oneiric precise verification-done-natty verification-needed-oneiric amd64 apport-bug kernel-da-key kernel-fixed-upstream natty oneiric precise verification-done-natty verification-done-oneiric
2012-07-16 23:12:09 Launchpad Janitor linux (Ubuntu Natty): status Fix Committed Fix Released
2012-07-17 00:24:44 Launchpad Janitor branch linked lp:ubuntu/oneiric-proposed/linux-ti-omap4
2012-07-17 21:10:24 Launchpad Janitor linux (Ubuntu Oneiric): status Fix Committed Fix Released
2012-10-15 20:32:11 Chris J Arges bug added subscriber Sustaining Engineering
2012-11-22 00:27:47 Bug Watch Updater linux: status Unknown Fix Released
2012-11-22 00:27:47 Bug Watch Updater linux: importance Unknown High
2014-02-07 15:45:14 Curtis Hovey removed subscriber Registry Administrators