Panic in rt2x00lib

[TJ]

This panic has been occurring intermittently and unpredictably on a gateway/router/WAP server since enabling 802.11n in hostapd which uses a Linksys WMP600N. The server has 6 gigabit and 4 fast ethernet ports, the Wifi, and a xDSL port.

The kernel panic was captured over a serial console since the server fails to sync when the panic occurs and no indication is captured in the logs.

$ uname -a
Linux jeeves 3.2.0-34-generic #53-Ubuntu SMP Thu Nov 15 10:49:02 UTC 2012 i686 i686 i386 GNU/Linux

$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 12.04.1 LTS
Release: 12.04
Codename: precise

$ lspci -nn
00:00.0 Host bridge [0600]: Intel Corporation 82875P/E7210 Memory Controller Hub [8086:2578] (rev 02)
00:03.0 PCI bridge [0604]: Intel Corporation 82875P/E7210 Processor to PCI to CSA Bridge [8086:257b] (rev 02)
00:06.0 System peripheral [0880]: Intel Corporation 82875P/E7210 Processor to I/O Memory Interface [8086:257e] (rev 02)
00:1c.0 PCI bridge [0604]: Intel Corporation 6300ESB 64-bit PCI-X Bridge [8086:25ae] (rev 02)
00:1d.0 USB controller [0c03]: Intel Corporation 6300ESB USB Universal Host Controller [8086:25a9] (rev 02)
00:1d.1 USB controller [0c03]: Intel Corporation 6300ESB USB Universal Host Controller [8086:25aa] (rev 02)
00:1d.4 System peripheral [0880]: Intel Corporation 6300ESB Watchdog Timer [8086:25ab] (rev 02)
00:1d.5 PIC [0800]: Intel Corporation 6300ESB I/O Advanced Programmable Interrupt Controller [8086:25ac] (rev 02)
00:1d.7 USB controller [0c03]: Intel Corporation 6300ESB USB2 Enhanced Host Controller [8086:25ad] (rev 02)
00:1e.0 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] (rev 0a)
00:1f.0 ISA bridge [0601]: Intel Corporation 6300ESB LPC Interface Controller [8086:25a1] (rev 02)
00:1f.1 IDE interface [0101]: Intel Corporation 6300ESB PATA Storage Controller [8086:25a2] (rev 02)
00:1f.2 RAID bus controller [0104]: Intel Corporation 6300ESB SATA RAID Controller [8086:25b0] (rev 02)
00:1f.3 SMBus [0c05]: Intel Corporation 6300ESB SMBus Controller [8086:25a4] (rev 02)
02:01.0 Ethernet controller [0200]: Intel Corporation 82547GI Gigabit Ethernet Controller [8086:1075]
03:01.0 Multimedia video controller [0400]: Conexant Systems, Inc. CX23880/1/2/3 PCI Video and Audio Decoder [14f1:8800] (rev 05)
03:01.1 Multimedia controller [0480]: Conexant Systems, Inc. CX23880/1/2/3 PCI Video and Audio Decoder [Audio Port] [14f1:8811] (rev 05)
03:01.2 Multimedia controller [0480]: Conexant Systems, Inc. CX23880/1/2/3 PCI Video and Audio Decoder [MPEG Port] [14f1:8802] (rev 05)
03:01.4 Multimedia controller [0480]: Conexant Systems, Inc. CX23880/1/2/3 PCI Video and Audio Decoder [IR Port] [14f1:8804] (rev 05)
03:02.0 PCI bridge [0604]: IBM PCI-X to PCI-X Bridge [1014:01a7] (rev 02)
04:04.0 Ethernet controller [0200]: Intel Corporation 82546EB Gigabit Ethernet Controller [8086:101d] (rev 01)
04:04.1 Ethernet controller [0200]: Intel Corporation 82546EB Gigabit Ethernet Controller [8086:101d] (rev 01)
04:06.0 Ethernet controller [0200]: Intel Corporation 82546EB Gigabit Ethernet Controller [8086:101d] (rev 01)
04:06.1 Ethernet controller [0200]: Intel Corporation 82546EB Gigabit Ethernet Controller [8086:101d] (rev 01)
05:00.0 PCI bridge [0604]: Digital Equipment Corporation DECchip 21152 [1011:0024] (rev 03)
05:01.0 Network controller [0280]: Ralink corp. RT2800 802.11n PCI [1814:0601]
05:02.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL-8139/8139C/8139C+ [10ec:8139] (rev 10)
05:05.0 VGA compatible controller [0300]: Advanced Micro Devices [AMD] nee ATI Rage XL [1002:4752] (rev 27)
05:0a.0 Ethernet controller [0200]: Intel Corporation 82541GI Gigabit Ethernet Controller [8086:1076]
06:04.0 Ethernet controller [0200]: Digital Equipment Corporation DECchip 21142/43 [1011:0019] (rev 41)
06:05.0 Ethernet controller [0200]: Digital Equipment Corporation DECchip 21142/43 [1011:0019] (rev 41)
06:06.0 Ethernet controller [0200]: Digital Equipment Corporation DECchip 21142/43 [1011:0019] (rev 41)
06:07.0 Ethernet controller [0200]: Digital Equipment Corporation DECchip 21142/43 [1011:0019] (rev 41)

$ ifconfig -s
Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
br0 1500 0 4085 0 0 0 4955 0 0 0 BMRU
dsl0 1500 0 14947 0 0 0 12317 0 0 0 BMRU
eth1 1500 0 0 0 0 0 0 0 0 0 BMU
eth2 1500 0 0 0 0 0 0 0 0 0 BMU
eth3 1500 0 0 0 0 0 0 0 0 0 BMU
eth4 1500 0 0 0 0 0 0 0 0 0 BMU
eth5 1500 0 4137 0 0 0 4943 0 0 0 BMRU
eth6 1500 0 0 0 0 0 322 0 0 0 BMRU
eth7 1500 0 0 0 0 0 0 7 0 0 BMU
eth8 1500 0 0 0 0 0 0 8 0 0 BMU
eth9 1500 0 0 0 0 0 0 9 0 0 BMU
eth10 1500 0 0 0 0 0 0 8 0 0 BMU
lo 16436 0 5445 0 0 0 5445 0 0 0 LRU
mon.wlan0 1500 0 65 0 0 0 0 0 0 0 BMRU
ppp0 1492 0 11312 0 0 0 8570 0 0 0 MOPRU
tun0 1500 0 11148 0 0 0 8415 0 0 0 MOPRU
wlan0 1500 0 1107 0 0 0 863 0 0 0 BMRU

$ egrep -v '(^$|^#)' /etc/hostapd/hostapd.conf
ctrl_interface=/var/run/hostapd
logger_stdout=-1
logger_stdout_level=0
logger_syslog=-1
logger_syslog_level=0
interface=wlan0
driver=nl80211
ssid=tron
channel=11
country_code=GB
ieee80211d=1
hw_mode=g
auth_algs=1
wds_sta=1
wmm_enabled=1
ieee80211n=1
ht_capab=[HT40-][SHORT-GI-40][SHORT-GI-20][TX-STBC][RX-STBC12]
wpa=2
wpa_passphrase=********
wpa_key_mgmt=WPA-PSK
wpa_pairwise=CCMP
rsn_pairwise=CCMP

[168711.023701] skb_under_panic: text:f8494495 len:42 put:16 head:ee082c00 data:ee082bfc tail:0xee082c26 end:0xee082d40 dev:<NULL>
[168711.027660] ------------[ cut here ]------------
[168711.027660] kernel BUG at /build/buildd/linux-3.2.0/net/core/skbuff.c:147!
[168711.027660] invalid opcode: 0000 [#1] SMP
[168711.027660] Modules linked in: autofs4 act_police cls_basic cls_flow cls_fw cls_u32 sch_tbf sch_prio sch_htb sch_hfsc sch_ingress sch_sfq xt_time xt_connlimit xt_realm xt_addrtype iptable_raw xt_comment xt_recent xt_policy xt_TCPMSS ipt_ULOG ipt_REJECT ipt_REDIRECT ipt_NETMAP ipt_MASQUERADE ipt_ECN ipt_ecn ipt_CLUSTERIP ipt_ah xt_set ip_set nf_nat_tftp nf_nat_snmp_basic nf_conntrack_snmp nf_nat_sip nf_nat_pptp nf_nat_proto_gre nf_nat_irc nf_nat_h323 nf_nat_ftp nf_nat_amanda ts_kmp nf_conntrack_amanda nf_conntrack_sane nf_conntrack_tftp nf_conntrack_sip nf_conntrack_proto_sctp nf_conntrack_pptp nf_conntrack_proto_gre nf_conntrack_netlink nf_conntrack_netbios_ns nf_conntrack_broadcast nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp xt_TPROXY nf_tproxy_core ip6_tables nf_defrag_ipv6 xt_tcpmss xt_pkttype xt_physdev xt_owner xt_NFQUEUE xt_NFLOG nfnetlink_log xt_multiport xt_mark xt_mac xt_limit xt_length xt_iprange xt_helper xt_hashlimit xt_DSCP xt_dscp xt_dccp xt_conntrack xt_connmark xt_CLASSIFY xt_AUDIT ipt_LOG xt_tcpudp xt_state iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack iptable_mangle nfnetlink iptable_filter ip_tables x_tables pppoe pppox dm_crypt nfsd nfs lockd fscache auth_rpcgss nfs_acl sunrpc ext2 ppdev bridge stp cx22702 isl6421 cx24116 cx88_dvb cx88_vp3054_i2c videobuf_dvb arc4 dvb_core cx88_alsa rt2800pci rt2800lib crc_ccitt rt2x00pci rt2x00lib snd_pcm wm8775 mac80211 rc_hauppauge tuner_simple tuner_types snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq tda9887 psmouse cfg80211 tda8290 dm_multipath serio_raw tuner snd_timer snd_seq_device eeprom_93cx6 snd ir_lirc_codec lirc_dev cx8802 ir_mce_kbd_decoder cx8800 ir_sony_decoder ir_jvc_decoder ir_rc6_decoder parport_pc ir_rc5_decoder ir_nec_decoder soundcore snd_page_alloc cx88xx rc_core i2c_algo_bit tveeprom v4l2_common videobuf_dma_sg videodev btcx_risc videobuf_core mac_hid shpchp w83791d i2c_i801 it87 hwmon_vid lp parport raid10 raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid0 multipath linear dm_mirror dm_region_hash dm_log raid1 usbhid hid tulip 8139too 8139cp floppy e1000
[168711.027660]
[168711.027660] Pid: 0, comm: swapper/0 Not tainted 3.2.0-34-generic #53-Ubuntu Gigabyte SR147/SR147
[168711.027660] EIP: 0060:[<c1472807>] EFLAGS: 00010296 CPU: 0
[168711.027660] EIP is at skb_push+0x87/0x90
[168711.027660] EAX: 00000089 EBX: ee082c26 ECX: 000000f5 EDX: 00000000
[168711.027660] ESI: 00000000 EDI: f700be94 EBP: f700be40 ESP: f700be14
[168711.027660] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
[168711.027660] Process swapper/0 (pid: 0, ti=f700a000 task=c17ca020 task.ti=c17c4000)
[168711.027660] Stack:
[168711.027660] c1781ae8 f8494495 0000002a 00000010 ee082c00 ee082bfc ee082c26 ee082d40
[168711.027660] c1738380 efe709e0 f70a3120 f700be6c f8494495 f849418e f8494899 00000000
[168711.027660] 00000000 0000001a 0000001a efe709e0 f6af5a48 f06d8400 f700becc f8494cfa
[168711.027660] Call Trace:
[168711.027660] [<f8494495>] ? rt2x00queue_write_tx_data+0x35/0xe0 [rt2x00lib]
[168711.027660] [<f8494495>] rt2x00queue_write_tx_data+0x35/0xe0 [rt2x00lib]
[168711.027660] [<f849418e>] ? rt2x00queue_get_entry+0x3e/0x90 [rt2x00lib]
[168711.027660] [<f8494899>] ? rt2x00queue_insert_l2pad+0x79/0xe0 [rt2x00lib]
[168711.027660] [<f8494cfa>] rt2x00queue_write_tx_frame+0x11a/0x2a0 [rt2x00lib]
[168711.027660] [<f8481540>] ? rt2800_efuse_detect+0x30/0x30 [rt2800lib]
[168711.027660] [<f849323b>] rt2x00mac_tx+0x7b/0x190 [rt2x00lib]
[168711.027660] [<c1027598>] ? default_spin_lock_flags+0x8/0x10
[168711.027660] [<c1575fdd>] ? _raw_spin_lock_irqsave+0x2d/0x40
[168711.027660] [<f85d3e54>] __ieee80211_tx+0x64/0x1d0 [mac80211]
[168711.027660] [<f85d540e>] ieee80211_tx+0x7e/0xb0 [mac80211]
[168711.027660] [<f85d60d4>] ieee80211_tx_pending+0x74/0x1f0 [mac80211]
[168711.027660] [<c1498861>] ? __qdisc_run+0x41/0x100
[168711.027660] [<c1051c80>] ? local_bh_enable_ip+0x90/0x90
[168711.027660] [<c10517a3>] tasklet_action+0x63/0x110
[168711.027660] [<c1051c80>] ? local_bh_enable_ip+0x90/0x90
[168711.027660] [<c1051d01>] __do_softirq+0x81/0x1a0
[168711.027660] [<c1051c80>] ? local_bh_enable_ip+0x90/0x90
[168711.027660] <IRQ>
[168711.027660] [<c1052046>] ? irq_exit+0x76/0xa0
[168711.027660] [<c157d6bb>] ? do_IRQ+0x4b/0xc0
[168711.027660] [<c106d9d1>] ? enqueue_hrtimer+0x21/0x80
[168711.027660] [<c106d9a5>] ? __remove_hrtimer+0x95/0xa0
[168711.027660] [<c157d5f0>] ? common_interrupt+0x30/0x38
[168711.027660] [<c107007b>] ? kexec_crash_size_show+0x2b/0x30
[168711.027660] [<c102692a>] ? native_safe_halt+0xa/0x10
[168711.027660] [<c1316fa7>] ? acpi_safe_halt+0x26/0x39
[168711.027660] [<c1316fdb>] ? acpi_idle_do_entry+0x21/0x30
[168711.027660] [<c1317200>] ? acpi_idle_enter_c1+0x5b/0xa3
[168711.027660] [<c144b51d>] ? cpuidle_idle_call+0xad/0x250
[168711.027660] [<c100180c>] ? cpu_idle+0x9c/0xe0
[168711.027660] [<c1545465>] ? rest_init+0x5d/0x68
[168711.027660] [<c1832771>] ? start_kernel+0x34d/0x353
[168711.027660] [<c18323b5>] ? pass_bootoption.constprop.2+0xe2/0xe2
[168711.027660] [<c18320a9>] ? i386_start_kernel+0xa9/0xaf
[168711.027660] Code: 5c 24 18 8b 81 ac 00 00 00 89 54 24 0c 89 44 24 10 8b 41 50 c7 04 24 e8 1a 78 c1 89 44 24 08 8b 45 04 89 44 24 04 e8 84 e5 0e 00 <0f> 0b 8d b4 26 00 00 00 00 55 89 e5 83 ec 2c 89 5d f8 89 75 fc
[168711.027660] EIP: [<c1472807>] skb_push+0x87/0x90 SS:ESP 0068:f700be14
[168711.535238] ---[ end trace 928422a39a35adb0 ]---
[168711.540051] Kernel panic - not syncing: Fatal exception in interrupt
[168711.546582] Pid: 0, comm: swapper/0 Tainted: G D 3.2.0-34-generic #53-Ubuntu
[168711.554664] Call Trace:
[168711.557265] [<c1560db8>] ? printk+0x2d/0x2f
[168711.561707] [<c1560c86>] panic+0x5c/0x161
[168711.565952] [<c15770bd>] oops_end+0xcd/0xd0
[168711.570385] [<c10056d4>] die+0x54/0x80
[168711.574370] [<c1576aa6>] do_trap+0x96/0xd0
[168711.578720] [<c10031c0>] ? do_bounds+0x80/0x80
[168711.583403] [<c100324b>] do_invalid_op+0x8b/0xa0
[168711.588271] [<c1472807>] ? skb_push+0x87/0x90
[168711.592877] [<c104007b>] ? print_cfs_rq+0x62b/0xaf0
[168711.597998] [<c104b97d>] ? vprintk+0x15d/0x440
[168711.602692] [<c1576837>] error_code+0x67/0x6c
[168711.607290] [<c1472807>] ? skb_push+0x87/0x90
[168711.611945] [<f8494495>] ? rt2x00queue_write_tx_data+0x35/0xe0 [rt2x00lib]
[168711.619108] [<f8494495>] rt2x00queue_write_tx_data+0x35/0xe0 [rt2x00lib]
[168711.626105] [<f849418e>] ? rt2x00queue_get_entry+0x3e/0x90 [rt2x00lib]
[168711.632921] [<f8494899>] ? rt2x00queue_insert_l2pad+0x79/0xe0 [rt2x00lib]
[168711.639980] [<f8494cfa>] rt2x00queue_write_tx_frame+0x11a/0x2a0 [rt2x00lib]
[168711.647261] [<f8481540>] ? rt2800_efuse_detect+0x30/0x30 [rt2800lib]
[168711.653899] [<f849323b>] rt2x00mac_tx+0x7b/0x190 [rt2x00lib]
[168711.659814] [<c1027598>] ? default_spin_lock_flags+0x8/0x10
[168711.665633] [<c1575fdd>] ? _raw_spin_lock_irqsave+0x2d/0x40
[168711.671500] [<f85d3e54>] __ieee80211_tx+0x64/0x1d0 [mac80211]
[168711.677562] [<f85d540e>] ieee80211_tx+0x7e/0xb0 [mac80211]
[168711.683355] [<f85d60d4>] ieee80211_tx_pending+0x74/0x1f0 [mac80211]
[168711.689878] [<c1498861>] ? __qdisc_run+0x41/0x100
[168711.694829] [<c1051c80>] ? local_bh_enable_ip+0x90/0x90
[168711.700296] [<c10517a3>] tasklet_action+0x63/0x110
[168711.705336] [<c1051c80>] ? local_bh_enable_ip+0x90/0x90
[168711.710789] [<c1051d01>] __do_softirq+0x81/0x1a0
[168711.715658] [<c1051c80>] ? local_bh_enable_ip+0x90/0x90
[168711.721126] <IRQ> [<c1052046>] ? irq_exit+0x76/0xa0
[168711.726396] [<c157d6bb>] ? do_IRQ+0x4b/0xc0
[168711.730836] [<c106d9d1>] ? enqueue_hrtimer+0x21/0x80
[168711.736042] [<c106d9a5>] ? __remove_hrtimer+0x95/0xa0
[168711.741348] [<c157d5f0>] ? common_interrupt+0x30/0x38
[168711.746639] [<c107007b>] ? kexec_crash_size_show+0x2b/0x30
[168711.752365] [<c102692a>] ? native_safe_halt+0xa/0x10
[168711.757576] [<c1316fa7>] ? acpi_safe_halt+0x26/0x39
[168711.762713] [<c1316fdb>] ? acpi_idle_do_entry+0x21/0x30
[168711.768176] [<c1317200>] ? acpi_idle_enter_c1+0x5b/0xa3
[168711.773648] [<c144b51d>] ? cpuidle_idle_call+0xad/0x250
[168711.779144] [<c100180c>] ? cpu_idle+0x9c/0xe0
[168711.783738] [<c1545465>] ? rest_init+0x5d/0x68
[168711.788435] [<c1832771>] ? start_kernel+0x34d/0x353
[168711.793572] [<c18323b5>] ? pass_bootoption.constprop.2+0xe2/0xe2
[168711.799811] [<c18320a9>] ? i386_start_kernel+0xa9/0xaf

[Brad Figg (brad-figg)]

This bug is missing log files that will aid in diagnosing the problem. From a terminal window please run:

apport-collect 1087591

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

[TJ (tj)]

This linux-wireless patch discussion appears to describe the cause of the issue but its not entirely clear if the patch was subsequently reverted nor whether the offending behaviour is present in this version of the kernel.

"And this introduces the same panic again :(

The problem is the following:

We don't pass the skb in the same state back to mac80211 as we got it.

When inserting the l2pad we're moving the header and thus reduce headroom.
This patch modifies the bahavior during l2pad removal to not move the header
back into its old position but instead moves the payload. Thus the skb keeps
the reduced headroom. If this skb gets requeued into rt2x00 (which can happen
when the frame wasn't acked and the according STA is known to e in powersave
mode) the header and payload get aligned again further reducing headroom which
results in a too small headroom for the TXWI and thus a skb_under_panic."

http://rt2x00.serialmonkey.com/pipermail/users_rt2x00.serialmonkey.com/2010-November/002457.html

From looking at the hostapd log just prior to the panic there was a timeout which might imply the kernel would need to requeue the packet several times:

Dec 7 07:28:12 jeeves hostapd: wlan0: WPA rekeying GTK
Dec 7 07:28:12 jeeves hostapd: wlan0: STA 90:21:55:7b:71:d6 WPA: sending 1/2 msg of Group Key Handshake
Dec 7 07:28:12 jeeves hostapd: wlan0: STA 00:23:76:d4:e0:44 WPA: sending 1/2 msg of Group Key Handshake
Dec 7 07:28:12 jeeves hostapd: wlan0: STA 00:1f:3b:bd:74:85 WPA: sending 1/2 msg of Group Key Handshake
Dec 7 07:28:12 jeeves hostapd: wlan0: STA 00:1f:3b:bd:74:85 WPA: received EAPOL-Key frame (2/2 Group)
Dec 7 07:28:12 jeeves hostapd: wlan0: STA 00:1f:3b:bd:74:85 WPA: group key handshake completed (RSN)
Dec 7 07:28:12 jeeves hostapd: wlan0: STA 90:21:55:7b:71:d6 WPA: EAPOL-Key timeout
Dec 7 07:28:12 jeeves hostapd: wlan0: STA 90:21:55:7b:71:d6 WPA: sending 1/2 msg of Group Key Handshake
Dec 7 07:28:12 jeeves hostapd: wlan0: STA 00:23:76:d4:e0:44 WPA: EAPOL-Key timeout
Dec 7 07:28:12 jeeves hostapd: wlDec 7 07:44:36 jeeves hostapd: wlan0: STA 00:1f:3b:bd:74:85 IEEE 802.11: authentication OK (open system)

[Joseph Salisbury (jsalisbury)]

Would it be possible for you to test the latest upstream kernel? Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Please test the latest v3.7 kernel[0] (Not a kernel in the daily directory) and install both the linux-image and linux-image-extra .deb packages.

If this bug is fixed in the mainline kernel, please add the following tag 'kernel-fixed-upstream'.

If the mainline kernel does not fix this bug, please add the tag: 'kernel-bug-exists-upstream'.

If you are unable to test the mainline kernel, for example it will not boot, please add the tag: 'kernel-unable-to-test-upstream'.
Once testing of the upstream kernel is complete, please mark this bug as "Confirmed".

Thanks in advance.

[0] http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.7-rc8-raring/

[TJ (tj)]

Still affects main-line.

$ uname -a
Linux jeeves 3.7.0-030700rc8-generic #201212031649 SMP Mon Dec 3 22:00:46 UTC 2012 i686 i686 i386 GNU/Linux

[29554.693545] skbuff: skb_under_panic: text:f8714595 len:42 put:16 head:eecc4200 data:eecc41fc tail:0xeecc4226 end:0xeecc4280 dev:<NULL>
[29554.697505] ------------[ cut here ]------------
[29554.697505] kernel BUG at /home/apw/COD/linux/net/core/skbuff.c:145!
[29554.697505] invalid opcode: 0000 [#1] SMP
[29554.697505] Modules linked in: autofs4 xt_REDIRECT act_police cls_basic cls_flow cls_fw cls_u32 sch_tbf sch_prio sch_htb sch_hfsc sch_ingress sch_sfq xt_LOG xt_time xt_connlimit xt_realm xt_addrtype iptable_raw xt_comment xt_recent xt_policy xt_nat xt_TCPMSS ipt_ULOG ipt_REJECT ipt_MASQUERADE ipt_ECN ipt_CLUSTERIP ipt_ah xt_set ip_set nf_nat_tftp nf_nat_snmp_basic nf_conntrack_snmp nf_nat_sip nf_nat_pptp nf_nat_proto_gre nf_nat_irc nf_nat_h323 nf_nat_ftp nf_nat_amanda ts_kmp nf_conntrack_amanda nf_conntrack_sane nf_conntrack_tftp nf_conntrack_sip nf_conntrack_proto_sctp nf_conntrack_pptp nf_conntrack_proto_gre nf_conntrack_netlink nf_conntrack_netbios_ns nf_conntrack_broadcast nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp xt_TPROXY nf_tproxy_core ip6_tables nf_defrag_ipv6 xt_tcpmss xt_pkttype xt_physdev xt_owner xt_NFQUEUE xt_NFLOG nfnetlink_log xt_multiport xt_mark xt_mac xt_limit xt_length xt_iprange xt_helper xt_hashlimit xt_DSCP xt_dscp xt_dccp xt_conntrack xt_connmark xt_CLASSIFY xt_AUDIT xt_tcpudp xt_state iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack iptable_mangle nfnetlink iptable_filter ip_tables x_tables pppoe pppox dm_crypt nfsd cx22702 nfs_acl isl6421 auth_rpcgss nfs cx24116 fscache snd_soc_wm8776 ir_lirc_codec lockd lirc_dev ir_mce_kbd_decoder snd_soc_core ir_sanyo_decoder sunrpc ir_sony_decoder cx88_dvb ir_jvc_decoder cx88_vp3054_i2c videobuf_dvb ir_rc6_decoder snd_compress dvb_core ir_rc5_decoder cx88_alsa snd_pcm ir_nec_decoder wm8775 rc_hauppauge snd_seq_midi snd_rawmidi tuner_simple snd_seq_midi_event snd_seq tuner_types snd_timer ext2 snd_seq_device tda9887 arc4 tda8290 snd soundcore snd_page_alloc rt2800pci rt2800lib tuner crc_ccitt cx8800 cx8802 cx88xx rt2x00pci rt2x00lib rc_core i2c_algo_bit mac80211 bridge tveeprom v4l2_common videodev videobuf_dma_sg btcx_risc stp cfg80211 videobuf_core llc w83791d eeprom_93cx6 i2c_i801 lpc_ich it87 shpchp hwmon_vid dm_multipath ppdev scsi_dh lp hid_generic parport_pc psmouse microcode serio_raw mac_hid parport raid10 raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid0 multipath linear dm_mirror dm_region_hash dm_log raid1 usbhid hid 8139too 8139cp tulip floppy e1000
[29554.697505] Pid: 0, comm: swapper/1 Not tainted 3.7.0-030700rc8-generic #201212031649 Gigabyte SR147/SR147
[29554.697505] EIP: 0060:[<c14ff17f>] EFLAGS: 00010292 CPU: 1
[29554.697505] EIP is at skb_push+0x8f/0xa0
[29554.697505] EAX: 0000007a EBX: eecc4226 ECX: 00000591 EDX: 00000096
[29554.697505] ESI: 00000000 EDI: f70d5e38 EBP: f70d5de4 ESP: f70d5db4
[29554.697505] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
[29554.697505] CR0: 8005003b CR2: b770b000 CR3: 3073e000 CR4: 000007f0
[29554...

[Joseph Salisbury (jsalisbury)]

This issue appears to be an upstream bug, since you tested the latest upstream kernel. Would it be possible for you to open an upstream bug report[0]? That will allow the upstream Developers to examine the issue, and may provide a quicker resolution to the bug.

Please follow the instructions on the wiki page[0]. The first step is to email the appropriate mailing list. If no response is received, then a bug may be opened on bugzilla.kernel.org.

[0] https://wiki.ubuntu.com/Bugs/Upstream/kernel

[TJ (tj)]

I'm already working with upstream via the mailing-list on a patch. I'll report back once we've solved the issue.

[penalvch (penalvch)]

TJ, could you please confirm this issue exists with the latest development release of Ubuntu? ISO images are available from http://cdimage.ubuntu.com/daily-live/current/ . If the issue remains, could you please run the following command in the development release from a Terminal (Applications->Accessories->Terminal), as it will automatically gather and attach updated debug information to this report:

apport-collect -p linux <replace-with-bug-number>

Also, could you please test the latest upstream kernel available following https://wiki.ubuntu.com/KernelMainlineBuilds ? It will allow additional upstream developers to examine the issue. Please do not test the daily folder, but the one all the way at the bottom. Once you've tested the upstream kernel, please comment on which kernel version specifically you tested. If this bug is fixed in the mainline kernel, please add the following tags:
kernel-fixed-upstream
kernel-fixed-upstream-VERSION-NUMBER

where VERSION-NUMBER is the version number of the kernel you tested. For example:
kernel-fixed-upstream-v3.11-rc4

This can be done by clicking on the yellow circle with a black pencil icon next to the word Tags located at the bottom of the bug description. As well, please remove the tag:
needs-upstream-testing

If the mainline kernel does not fix this bug, please add the following tags:
kernel-bug-exists-upstream
kernel-bug-exists-upstream-VERSION-NUMBER

As well, please remove the tag:
needs-upstream-testing

If you are unable to test the mainline kernel, please comment as to why specifically you were unable to test it and add the following tags:
kernel-unable-to-test-upstream
kernel-unable-to-test-upstream-VERSION-NUMBER

Once testing of the upstream kernel is complete, please mark this bug's Status as Confirmed. Please let us know your results. Thank you for your understanding.

[Launchpad Janitor (janitor)]

[Expired for linux (Ubuntu) because there has been no activity for 60 days.]