Linux Kernel crash in Netfilter both in Natty (2.6.38-8-server) and oneiric(3.0.0-13-server/3.0.0-14-server) kernels
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Linux |
Fix Released
|
High
|
|||
linux (Ubuntu) |
Fix Released
|
High
|
Unassigned | ||
Natty |
Fix Released
|
Medium
|
Chris J Arges | ||
Oneiric |
Fix Released
|
Medium
|
Chris J Arges | ||
Precise |
Fix Released
|
Undecided
|
Unassigned |
Bug Description
SRU Justification:
Impact:
When running KVM with a few VM's with physical eth bridges and TAP interfaces connected between KVM (via libvirt) and the bridge, occasionally kernel panics will occur.
Fix: Cherry-pick from a504b86e718a425
Testcase:
0) Download attached netperf.tgz testcase.
1) Launch 3 instances (for example Ubuntu Natty/Oneiric).
2) Assign a public IP to each instance.
3) Copy all files from netperf.tgz to /root on the 3 instances.
4) Run the following command on each instance:
$ /root/netserver -p 12865
5) Create a file named 'remote_hosts' with the following content and copy it to /root on the 1st of the 3 instances:
REMOTE_
REMOTE_
NUM_REMOTE_HOSTS=2
6) Run the following command on the 1st instance to start the test:
$ cd /root
$ PATH=$PATH:. ./runemomniaggd
7) The machine will eventually panic.
--
On multiple servers on which we have Ubuntu versions installed we periodically hit this kernel panic. in netfilter flowpath The console freezes & the only way is to physically reboot the servers.
We run KVM and few VM's on the physical servers. On the physical eth's bridges are created and TAP interfaces are setup into the bridges. These TAP interfaces are connected into KVM through libvirt (we primarily use openstack for the VM management).
This problem happened in Natty 2.6.38-8-server version. After looking at the below links, we thought this could be a problem on 2.6.38-8-server kernel that is bundled along with Natty & decided to move to oneiric running 3.0 kernel.
http://
https:/
http://
https:/
However, this exact problem is repeating in oneiric kernels. We request you to pls look at this issue asap. I will be happy to provide you any additional information that you will need.
Thanks
[ 5445.359446] [<ffffffffa0395
[ 5445.372671] [<ffffffffa0396
[ 5445.385984] [<ffffffffa0396
[ 5445.393255] [<ffffffff81516
[ 5445.400827] [<ffffffffa038f
[ 5445.408643] [<ffffffff81516
[ 5445.416438] [<ffffffffa038f
[ 5445.424202] [<ffffffffa0390
[ 5445.431824] [<ffffffffa0390
[ 5445.446876] [<ffffffff814e9
[ 5445.454815] [<ffffffff814ea
[ 5445.462790] [<ffffffff814eb
[ 5445.470445] [<ffffffff81065
[ 5445.478364] [<ffffffff81608
[ 5445.486145] <EOI> [<ffffffff8100c
[ 5445.494076] [<ffffffff814eb
[ 5445.501902] [<ffffffff8144c
[ 5445.509771] [<ffffffff8144c
[ 5445.517864] [<ffffffff81167
[ 5445.526011] [<ffffffff81281
[ 5445.534177] [<ffffffff81167
[ 5445.542339] [<ffffffff81168
[ 5445.550227] [<ffffffff81168
[ 5445.558337] [<ffffffff81168
[ 5445.566288] [<ffffffff81607
[ 5445.574267] ---[ end trace f585024e7045bff8 ]---
ProblemType: Bug
DistroRelease: Ubuntu 11.10
Package: linux-image-
ProcVersionSign
Uname: Linux 3.0.0-13-server x86_64
AlsaDevices: Error: command ['ls', '-l', '/dev/snd/'] failed with exit code 2: ls: cannot access /dev/snd/: No such file or directory
AplayDevices: Error: [Errno 2] No such file or directory
ApportVersion: 1.23-0ubuntu4
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory
CRDA: Error: [Errno 2] No such file or directory
Date: Fri Dec 16 09:51:41 2011
HibernationDevice: RESUME=
IwConfig: Error: [Errno 2] No such file or directory
MachineType: Dell Inc. PowerEdge R710
PciMultimedia:
ProcEnviron:
LANGUAGE=en_US:
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcKernelCmdLine: BOOT_IMAGE=
RelatedPackageV
linux-
linux-
linux-firmware 1.60
RfKill: Error: [Errno 2] No such file or directory
SourcePackage: linux
UpgradeStatus: Upgraded to oneiric on 2011-12-09 (6 days ago)
dmi.bios.date: 01/31/2011
dmi.bios.vendor: Dell Inc.
dmi.bios.version: 3.0.0
dmi.board.name: 00NH4P
dmi.board.vendor: Dell Inc.
dmi.board.version: A12
dmi.chassis.type: 23
dmi.chassis.vendor: Dell Inc.
dmi.modalias: dmi:bvnDellInc.
dmi.product.name: PowerEdge R710
dmi.sys.vendor: Dell Inc.
Related branches
Changed in linux (Ubuntu): | |
status: | New → Confirmed |
tags: | added: natty |
no longer affects: | nova |
Changed in linux (Ubuntu Natty): | |
assignee: | nobody → Chris J Arges (christopherarges) |
Changed in linux (Ubuntu Oneiric): | |
assignee: | nobody → Chris J Arges (christopherarges) |
Changed in linux (Ubuntu Natty): | |
importance: | Undecided → Medium |
Changed in linux (Ubuntu Oneiric): | |
importance: | Undecided → Medium |
Changed in linux (Ubuntu Natty): | |
status: | Confirmed → Invalid |
Changed in linux (Ubuntu Oneiric): | |
status: | Confirmed → Invalid |
Changed in linux (Ubuntu): | |
status: | Triaged → Invalid |
tags: |
added: kernel-fixed-upstream-precise removed: kernel-fixed-upstream-v3.2-precise |
tags: |
added: kernel-fixed-upstream precise removed: kernel-fixed-upstream-precise |
Changed in linux (Ubuntu Natty): | |
status: | Invalid → Confirmed |
Changed in linux (Ubuntu Oneiric): | |
status: | Invalid → Confirmed |
Changed in linux (Ubuntu): | |
status: | Invalid → Won't Fix |
status: | Won't Fix → New |
Changed in linux (Ubuntu Precise): | |
status: | New → Fix Released |
Changed in linux (Ubuntu): | |
status: | New → Fix Released |
description: | updated |
Changed in linux (Ubuntu Natty): | |
status: | In Progress → Fix Committed |
Changed in linux (Ubuntu Oneiric): | |
status: | Confirmed → Fix Committed |
tags: |
added: verification-done-natty removed: verification-needed-natty |
Changed in linux: | |
importance: | Unknown → High |
status: | Unknown → Fix Released |
Pls note that the stack trace is slightly different between the reference links of 2.6.38-8 netfilter corruption & the ones we are hitting.
We are constantly hitting the ones as shown in the attachments (png files).