iwlagn/iwlcore modules stop responding

[Arthur]

Using network-manager under ubuntu. Connected to a WPA/WPA2 secured network, wireless networking stopped working without warning.

Card is reported as
arthurb@aetna:~$ lspci | grep -i wire
04:00.0 Network controller: Intel Corporation PRO/Wireless 5100 AGN [Shiloh] Network Connection
arthurb@aetna:~$ sudo lshw -c network
  *-network
       description: Wireless interface
       product: PRO/Wireless 5100 AGN [Shiloh] Network Connection
       vendor: Intel Corporation
       physical id: 0
       bus info: pci@0000:04:00.0
       logical name: wmaster0
       version: 00
       serial: 00:16:ea:4a:17:aa
       width: 64 bits
       clock: 33MHz
       capabilities: pm msi pciexpress bus_master cap_list logical ethernet physical wireless
       configuration: broadcast=yes driver=iwlagn ip=10.32.32.43 latency=0 module=iwlagn multicast=yes wireless=IEEE 802.11abgn

/var/log/messages contains the follow:
May 19 14:17:11 aetna kernel: [21631.637607] ------------[ cut here ]------------
May 19 14:17:11 aetna kernel: [21631.637609] WARNING: at /build/buildd/linux-2.6.28/drivers/net/wireless/iwlwifi/iwl-tx.c:1204 iwl_tx_cmd_complete+0x13c/0x140 [iwlcore]()
May 19 14:17:11 aetna kernel: [21631.637611] wrong command queue 2, command id 0xF4
May 19 14:17:11 aetna kernel: [21631.637612] Modules linked in: nls_iso8859_1 vfat fat nls_cp437 cifs usb_storage binfmt_misc ppdev bridge stp bnep vboxnetflt vboxdrv input_polldev lp parport snd_hda_intel arc4 snd_pcm_oss snd_mixer_oss ecb snd_pcm snd_timer iwlagn iwlcore leds_hp_disk uvcvideo snd psmouse led_class compat_ioctl32 mac80211 iTCO_wdt serio_raw pcspkr soundcore joydev video videodev v4l1_compat btusb nvidia(P) sdhci_pci sdhci lis3lv02d iTCO_vendor_support intel_agp snd_page_alloc cfg80211 output hid_microsoft usbhid r8169 mii fbcon tileblit font bitblit softcursor
May 19 14:17:11 aetna kernel: [21631.637645] Pid: 31790, comm: cc1 Tainted: P 2.6.28-12-generic #43-Ubuntu
May 19 14:17:11 aetna kernel: [21631.637647] Call Trace:
May 19 14:17:11 aetna kernel: [21631.637648] <IRQ> [<ffffffff80250927>] warn_slowpath+0xb7/0xf0
May 19 14:17:11 aetna kernel: [21631.637658] [<ffffffff80697836>] ? printk+0x67/0x69
May 19 14:17:11 aetna kernel: [21631.637665] [<ffffffffa0954deb>] ? iwl_pass_packet_to_mac80211+0x13b/0x300 [iwlcore]
May 19 14:17:11 aetna kernel: [21631.637671] [<ffffffffa0955193>] ? iwl_rx_reply_rx+0x1e3/0x390 [iwlcore]
May 19 14:17:11 aetna kernel: [21631.637679] [<ffffffffa097b616>] ? iwl5000_rx_reply_tx+0x256/0x660 [iwlagn]
May 19 14:17:11 aetna kernel: [21631.637685] [<ffffffffa095753c>] iwl_tx_cmd_complete+0x13c/0x140 [iwlcore]
May 19 14:17:11 aetna kernel: [21631.637691] [<ffffffffa096f382>] iwl_rx_handle+0xf2/0x2d0 [iwlagn]
May 19 14:17:11 aetna kernel: [21631.637695] [<ffffffffa097158e>] iwl4965_irq_tasklet+0x22e/0x360 [iwlagn]
May 19 14:17:11 aetna kernel: [21631.637698] [<ffffffff802563b6>] tasklet_action+0x86/0x110
May 19 14:17:11 aetna kernel: [21631.637700] [<ffffffff80256acc>] __do_softirq+0x9c/0x170
May 19 14:17:11 aetna kernel: [21631.637703] [<ffffffff80213d8c>] call_softirq+0x1c/0x30
May 19 14:17:11 aetna kernel: [21631.637706] [<ffffffff80214ffd>] do_softirq+0x5d/0xa0
May 19 14:17:11 aetna kernel: [21631.637707] [<ffffffff8025684d>] irq_exit+0x8d/0xa0
May 19 14:17:11 aetna kernel: [21631.637709] [<ffffffff802152c5>] do_IRQ+0xc5/0x110
May 19 14:17:11 aetna kernel: [21631.637712] [<ffffffff80212bf3>] ret_from_intr+0x0/0x29
May 19 14:17:11 aetna kernel: [21631.637713] <EOI> <4>---[ end trace 8ef6f84a02364753 ]---

trying to reconnect caused network manager to prompt continuously for the WPA key.

doing a
sudo modprobe -r iwlagn
sudo modprobe iwlagn

brought networking back

ProblemType: Bug
Architecture: amd64
DistroRelease: Ubuntu 9.04
HibernationDevice: RESUME=UUID=aceb849c-2b8e-4665-a109-0965adc5daaf
MachineType: Hewlett-Packard HP Pavilion dv4 Notebook PC
NonfreeKernelModules: nvidia
Package: linux-image-2.6.28-12-generic 2.6.28-12.43
ProcCmdLine: root=/dev/mapper/hostname-Slash ro quiet splash crashkernel=384M-2G:64M@16M,2G-:128M@16M
ProcEnviron:
 LANGUAGE=en_US.UTF-8
 PATH=(custom, user)
 LANG=en_US.UTF-8
 LC_MESSAGES=en_US.UTF-8
 SHELL=/bin/bash
ProcVersionSignature: Ubuntu 2.6.28-12.43-generic
SourcePackage: linux

[Arthur (arthurb)]

This has just re-occured. All the same hardware etc as in the original report. The symptom and fix are the same, but this time i got the following in syslog:

May 28 13:55:44 aetna kernel: [ 9824.860758] iwlagn: Error sending REPLY_SCAN_CMD: time out after 500ms.
May 28 13:55:44 aetna kernel: [ 9825.360263] iwlagn: Error sending REPLY_RXON: time out after 500ms.
May 28 13:55:44 aetna kernel: [ 9825.360272] iwlagn: Error setting new RXON (-110)
May 28 13:55:45 aetna kernel: [ 9825.860219] iwlagn: Error sending REPLY_SCAN_CMD: time out after 500ms.
May 28 13:55:45 aetna kernel: [ 9826.360532] iwlagn: Error sending REPLY_RXON: time out after 500ms.
May 28 13:55:45 aetna kernel: [ 9826.360541] iwlagn: Error setting new RXON (-110)
May 28 13:55:49 aetna kernel: [ 9830.360256] iwlagn: Error sending REPLY_SCAN_CMD: time out after 500ms.
May 28 13:55:50 aetna kernel: [ 9830.860109] iwlagn: Error sending REPLY_RXON: time out after 500ms.
May 28 13:55:50 aetna kernel: [ 9830.860118] iwlagn: Error setting new RXON (-110)
May 28 13:55:55 aetna kernel: [ 9835.860598] iwlagn: Error sending REPLY_SCAN_CMD: time out after 500ms.
May 28 13:55:55 aetna kernel: [ 9836.360259] iwlagn: Error sending REPLY_RXON: time out after 500ms.
May 28 13:55:55 aetna kernel: [ 9836.360268] iwlagn: Error setting new RXON (-110)
May 28 13:56:00 aetna kernel: [ 9841.360613] iwlagn: Error sending REPLY_SCAN_CMD: time out after 500ms.
May 28 13:56:01 aetna kernel: [ 9841.860083] iwlagn: Error sending REPLY_RXON: time out after 500ms.
May 28 13:56:01 aetna kernel: [ 9841.860093] iwlagn: Error setting new RXON (-110)
May 28 13:56:01 aetna kernel: [ 9841.860107] iwlagn: No space for Tx
May 28 13:56:01 aetna kernel: [ 9841.860111] iwlagn: Error sending REPLY_TX_POWER_DBM_CMD: enqueue_hcmd failed: -28
May 28 13:56:05 aetna kernel: [ 9846.361737] iwlagn: No space for Tx
May 28 13:56:05 aetna kernel: [ 9846.361749] iwlagn: Error sending REPLY_SCAN_CMD: enqueue_hcmd failed: -28
May 28 13:56:05 aetna kernel: [ 9846.361772] iwlagn: No space for Tx
May 28 13:56:05 aetna kernel: [ 9846.361776] iwlagn: Error sending REPLY_RXON: enqueue_hcmd failed: -28
May 28 13:56:05 aetna kernel: [ 9846.361780] iwlagn: Error setting new RXON (-28)
May 28 13:56:05 aetna kernel: [ 9846.361787] iwlagn: No space for Tx
May 28 13:56:05 aetna kernel: [ 9846.361791] iwlagn: Error sending REPLY_TX_POWER_DBM_CMD: enqueue_hcmd failed: -28
May 28 13:56:10 aetna kernel: [ 9851.363326] iwlagn: No space for Tx
May 28 13:56:10 aetna kernel: [ 9851.363339] iwlagn: Error sending REPLY_SCAN_CMD: enqueue_hcmd failed: -28
May 28 13:56:10 aetna kernel: [ 9851.363363] iwlagn: No space for Tx
May 28 13:56:10 aetna kernel: [ 9851.363367] iwlagn: Error sending REPLY_RXON: enqueue_hcmd failed: -28
May 28 13:56:10 aetna kernel: [ 9851.363371] iwlagn: Error setting new RXON (-28)
May 28 13:56:10 aetna kernel: [ 9851.363378] iwlagn: No space for Tx
May 28 13:56:10 aetna kernel: [ 9851.363382] iwlagn: Error sending REPLY_TX_POWER_DBM_CMD: enqueue_hcmd failed: -28
(etc etc etc).
Possibly related to bug #352228 (https://bugs.launchpad.net/ubuntu/+source/linux/+bug/352228)

[Leann Ogasawara (leannogasawara)]

Hi Arthur,

Care to try installing linux-backports-modules-jaunty? It has an updated compat-wrieless stack. If the issue remains could you then try the latest upstream compat-wireless stack - http://wireless.kernel.org/en/users/Download. If this exists upstream we'll want to have you open an upstream bug report so the upstream developers are also notified. Thanks.

[Arthur (arthurb)]

Ok, its installed now

arthurb@aetna:~$ aptitude show linux-backports-modules-jaunty
Package: linux-backports-modules-jaunty
New: yes
State: installed
Automatically installed: no
Version: 2.6.28.11.15

 I've rebooted now. I'll update this bug if it happens again

[Arthur (arthurb)]

Just re-occured now.

Linux aetna 2.6.28-14-generic #46-Ubuntu SMP Wed Jul 8 07:41:18 UTC 2009 x86_64 GNU/Linux
 15:11:57 up 5:26, 6 users, load average: 0.69, 0.90, 0.83

dmesg contains
[19194.433359] ------------[ cut here ]------------
[19194.433366] WARNING: at /build/buildd/linux-2.6.28/drivers/net/wireless/iwlwifi/iwl-tx.c:1204 iwl_tx_cmd_complete+0x13c/0x140 [iwlcore]()
[19194.433373] wrong command queue 2, command id 0x5
[19194.433376] Modules linked in: nls_cp437 cifs binfmt_misc ppdev bnep vboxnetflt vboxdrv ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack ipt_REJECT xt_tcpudp iptable_filter ip_tables x_tables bridge stp kvm_intel kvm input_polldev microcode lp parport arc4 ecb snd_hda_intel snd_pcm_oss snd_mixer_oss iwlagn iwlcore snd_pcm mac80211 leds_hp_disk led_class uvcvideo psmouse snd_timer compat_ioctl32 sdhci_pci iTCO_wdt video serio_raw snd soundcore nvidia(P) cfg80211 sdhci joydev lis3lv02d iTCO_vendor_support pcspkr intel_agp btusb output snd_page_alloc videodev v4l1_compat hid_microsoft usbhid r8169 mii fbcon tileblit font bitblit softcursor
[19194.433487] Pid: 5308, comm: firefox Tainted: P 2.6.28-14-generic #46-Ubuntu
[19194.433492] Call Trace:
[19194.433496] <IRQ> [<ffffffff80250a47>] warn_slowpath+0xb7/0xf0
[19194.433520] [<ffffffff805f9b7b>] ? tcp_v4_do_rcv+0xfb/0x150
[19194.433526] [<ffffffff805fb4f8>] ? tcp_v4_rcv+0x5b8/0x7d0
[19194.433535] [<ffffffff8022f669>] ? default_spin_lock_flags+0x9/0x10
[19194.433555] [<ffffffffa0b8fdeb>] ? iwl_pass_packet_to_mac80211+0x13b/0x300 [iwlcore]
[19194.433574] [<ffffffffa0b90193>] ? iwl_rx_reply_rx+0x1e3/0x390 [iwlcore]
[19194.433593] [<ffffffffa0b9253c>] iwl_tx_cmd_complete+0x13c/0x140 [iwlcore]
[19194.433612] [<ffffffffa0baa382>] iwl_rx_handle+0xf2/0x2d0 [iwlagn]
[19194.433627] [<ffffffffa0bac58e>] iwl4965_irq_tasklet+0x22e/0x360 [iwlagn]
[19194.433635] [<ffffffff802564a6>] tasklet_action+0x86/0x110
[19194.433640] [<ffffffff80256bbc>] __do_softirq+0x9c/0x170
[19194.433648] [<ffffffff80213d8c>] call_softirq+0x1c/0x30
[19194.433655] [<ffffffff80214ffd>] do_softirq+0x5d/0xa0
[19194.433661] [<ffffffff8025693d>] irq_exit+0x8d/0xa0
[19194.433667] [<ffffffff802152c5>] do_IRQ+0xc5/0x110
[19194.433673] [<ffffffff80212bf3>] ret_from_intr+0x0/0x29
[19194.433676] <EOI> <4>---[ end trace c5e64a492032b021 ]---

once again
sudo modprobe -r iwlagn
sudo modprobe iwlagn
resolved it

from syslog i can see
Jul 24 15:02:44 aetna dhclient: DHCPREQUEST of 10.32.32.43 on wlan0 to 10.32.32.9 port 67
Jul 24 15:02:44 aetna dhclient: DHCPACK of 10.32.32.43 from 10.32.32.9
Jul 24 15:02:44 aetna dhclient: bound to 10.32.32.43 -- renewal in 1590 seconds.
Jul 24 15:03:57 aetna dnsmasq[3546]: reading /etc/resolv.conf
Jul 24 15:03:57 aetna dnsmasq[3546]: using nameserver xxx#53
Jul 24 15:03:57 aetna dnsmasq[3546]: using nameserver 10.32.32.11#53
Jul 24 15:03:57 aetna dnsmasq[3546]: using nameserver 10.32.32.9#53

just before the problem
Jul 24 15:05:41 aetna kernel: [19194.433359] ------------[ cut here ]------------

[Leann Ogasawara (leannogasawara)]

Hi Arthur,

Thanks for the update. Could you estimate how often this happens? Can you recall doing anything in particular that could help reproduce the issue? If you'd be willing to try the latest upstream compat-wireless stack that would be really great - http://wireless.kernel.org/en/users/Download . Also, you may want to try the latest Karmic Alpha kernel as well - 2.6.31-4.21. Thanks.

[Leann Ogasawara (leannogasawara)]

Searching around I found the following thread which seems to be related:

http://thread.gmane.org/gmane.linux.kernel.wireless.general/29172

That thread noted the following which seemed to have positive feedback.

"This sounds like http://www.intellinuxwireless.org/bugzilla/show_bug.cgi?id=1703 for which new uCode was released to address the problem. Could you please try with the most recent 4965 uCode available from http://www.intellinuxwireless.org/?n=Downloads ?"

It would be good to know if this resolves what you are seeing. I'd note that Karmic already has this newer firmware available if you were to test. Thanks.

[Barış (penguen)]

Hello,

I am experiencing this problem mostly under heavy network load on a Lenovo Thinkpad X200 on a clean install Karmic.

Wireless Card:
03:00.0 Network controller: Intel Corporation Wireless WiFi Link 5300

  *-network
       description: Wireless interface
       product: Wireless WiFi Link 5300
       vendor: Intel Corporation
       physical id: 0
       bus info: pci@0000:03:00.0
       logical name: wmaster0
       version: 00
       width: 64 bits
       clock: 33MHz
       capabilities: pm msi pciexpress bus_master cap_list logical ethernet physical wireless
       configuration: broadcast=yes driver=iwlagn ip=192.168.2.145 latency=0 multicast=yes wireless=IEEE 802.11abgn
       resources: irq:30 memory:f2500000-f2501fff

\\Regards

[tbnorris (tbnorris)]

this sounds like the same issue i was having as well. i don't know a fix exactly, but what i found was a work around. replace network-manager with wicd talked about in this bug.
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/459933

just 'sudo apt-get install wicd' i takes care of removing network-manager and installs wicd and since i have been running i have not had a single issue with the wireless. in 9.04 and 9.10 i was having an issue that when i was xfering large data files from my windows server to my ubuntu install over this 5100 agn wireless it would just drop out in such a way that it would lock up the ubuntu smb and the windows box nfs so that i would have to reboot both of them. now with wicd i can actually suspend my laptop and more importantly rewake my laptop, it would just leave me with a flashing cursor using network-manager. I am not sure what is wrong with this iwlagn driver but network-manager makes it mad at least.
-t

[Barış (penguen)]

Changed my router's encryption algorithm to AES from TKIP. Problem I
was experiencing --sporadic disconnections from the router-- seems
resolved for now.

http://www.intel.com/support/wireless/wlan/4965agn/sb/CS-025643.htm

On Thu, Jan 28, 2010 at 10:52 PM, tbnorris <email address hidden> wrote:
> this sounds like the same issue i was having as well.  i don't know a fix exactly, but what i found was a work around. replace network-manager with wicd talked about in this bug.
> https://bugs.launchpad.net/ubuntu/+source/linux/+bug/459933
>
> just 'sudo apt-get install wicd' i takes care of removing network-manager and installs wicd and since i have been running i have not had a single issue with the wireless.  in 9.04 and 9.10 i was having an issue that when i was xfering large data files from my windows server to my ubuntu install over this 5100 agn wireless it would just drop out in such a way that it would lock up the ubuntu smb and the windows box nfs so that i would have to reboot both of them.  now with wicd i can actually suspend my laptop and more importantly rewake my laptop, it would just leave me with a flashing cursor using network-manager.  I am not sure what is wrong with this iwlagn driver but network-manager makes it mad at least.
> -t
>
> --
> iwlagn/iwlcore modules stop responding
> https://bugs.launchpad.net/bugs/378189
> You received this bug notification because you are a direct subscriber
> of the bug.
>
>

[3ntix (francesco-3ntini)]

I've the same card of Barış (#8) and I'm experiencing exactly the same problem. Any news from this bug?

  *-network
                description: Wireless interface
                product: Ultimate N WiFi Link 5300
                vendor: Intel Corporation
                physical id: 0
                bus info: pci@0000:02:00.0
                logical name: wlan0
                version: 00
                serial: 00:21:6a:6d:12:30
                width: 64 bits
                clock: 33MHz
                capabilities: bus_master cap_list ethernet physical wireless
                configuration: broadcast=yes driver=iwlagn driverversion=2.6.35-23-generic firmware=8.24.2.12 ip=xx.xx.xx.xx latency=0 multicast=yes wireless=IEEE 802.11abg
                resources: irq:50 memory:f4200000-f4201fff

[Brad Figg (brad-figg)]

This bug was filed against a series that is no longer supported and so is being marked as Won't Fix. If this issue still exists in a supported series, please file a new bug.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.