>[513272.653578] [] :jfs:txAllocPMap+0xdd/0x120 [513272.653585] [] :jfs:txUpdateMap+0x1ae/0x270 [513272.653589] [] __wake_up+0x43/0x70 [513272.653596] [] :jfs:jfs_lazycommit+0x120/0x270 [513272.653599] [] default_wake_function+0x0/0x10 [513272.653606] [] :jfs:jfs_lazycommit+0x0/0x270 [513272.653610] [] kthread+0x4b/0x80 [513272.653613] [] child_rip+0xa/0x12 [513272.653617] [] kthread+0x0/0x80 [513272.653620] [] child_rip+0x0/0x12 [513272.653622] [513272.653623] Mem-info: [513272.653625] Node 0 DMA per-cpu: [513272.653628] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.653630] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.653632] Node 0 DMA32 per-cpu: [513272.653635] CPU 0: Hot: hi: 186, btch: 31 usd: 68 Cold: hi: 62, btch: 15 usd: 64 [513272.653637] CPU 1: Hot: hi: 186, btch: 31 usd: 128 Cold: hi: 62, btch: 15 usd: 57 [513272.653641] Active:28164 inactive:215208 dirty:14169 writeback:1 unstable:0 [513272.653642] free:1980 slab:5207 mapped:2105 pagetables:611 bounce:0 [513272.653643] Node 0 DMA free:3980kB min:40kB low:48kB high:60kB active:160kB inactive:6636kB present:10484kB pages_scanned:0 all_unreclaimable? no [513272.653647] lowmem_reserve[]: 0 992 992 992 [513272.653650] Node 0 DMA32 free:3940kB min:4008kB low:5008kB high:6012kB active:112496kB inactive:854196kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513272.653654] lowmem_reserve[]: 0 0 0 0 [513272.653658] Node 0 DMA: 3*4kB 0*8kB 0*16kB 0*32kB 2*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3980kB [513272.653669] Node 0 DMA32: 810*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3944kB [513272.653681] Swap cache: add 21570684, delete 21570030, find 726969/4231667, race 0+265 [513272.653682] Free swap = 3890264kB [513272.653684] Total swap = 3903752kB [513272.653685] Free swap: 3890264kB [513272.658792] 261736 pages of RAM [513272.658795] 5031 reserved pages [513272.658796] 14294 pages shared [513272.658797] 657 pages swap cached [513272.693342] jfsCommit: page allocation failure. order:1, mode:0x4020 [513272.693349] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513272.693352] [513272.693352] Call Trace: [513272.693355] [] __alloc_pages+0x2fd/0x3d0 [513272.693378] [] new_slab+0x220/0x260 [513272.693381] [] __slab_alloc+0x2f5/0x410 [513272.693386] [] __netdev_alloc_skb+0x2b/0x50 [513272.693389] [] __netdev_alloc_skb+0x2b/0x50 [513272.693392] [] __kmalloc_node_track_caller+0x121/0x130 [513272.693396] [] __alloc_skb+0x7b/0x160 [513272.693399] [] __netdev_alloc_skb+0x2b/0x50 [513272.693406] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513272.693411] [] :tg3:tg3_poll+0x8a9/0xa60 [513272.693417] [] net_rx_action+0x128/0x230 [513272.693422] [] __do_softirq+0x75/0xe0 [513272.693426] [] call_softirq+0x1c/0x30 [513272.693429] [] do_softirq+0x35/0x90 [513272.693431] [] irq_exit+0x88/0x90 [513272.693434] [] do_IRQ+0x80/0x100 [513272.693437] [] ret_from_intr+0x0/0xa [513272.693439] [] _spin_unlock_irqrestore+0x8/0x10 [513272.693453] [] :jfs:release_metapage+0x45/0x160 [513272.693460] [] :jfs:dbUpdatePMap+0x361/0x480 [513272.693469] [] :jfs:txAllocPMap+0xdd/0x120 [513272.693476] [] :jfs:txUpdateMap+0x1ae/0x270 [513272.693480] [] __wake_up+0x43/0x70 [513272.693487] [] :jfs:jfs_lazycommit+0x120/0x270 [513272.693490] [] default_wake_function+0x0/0x10 [513272.693497] [] :jfs:jfs_lazycommit+0x0/0x270 [513272.693500] [] kthread+0x4b/0x80 [513272.693503] [] child_rip+0xa/0x12 [513272.693507] [] kthread+0x0/0x80 [513272.693509] [] child_rip+0x0/0x12 [513272.693511] [513272.693513] Mem-info: [513272.693514] Node 0 DMA per-cpu: [513272.693518] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.693520] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.693522] Node 0 DMA32 per-cpu: [513272.693525] CPU 0: Hot: hi: 186, btch: 31 usd: 68 Cold: hi: 62, btch: 15 usd: 64 [513272.693527] CPU 1: Hot: hi: 186, btch: 31 usd: 122 Cold: hi: 62, btch: 15 usd: 61 [513272.693530] Active:28168 inactive:215149 dirty:14185 writeback:1 unstable:0 [513272.693531] free:2041 slab:5207 mapped:2105 pagetables:611 bounce:0 [513272.693533] Node 0 DMA free:3980kB min:40kB low:48kB high:60kB active:160kB inactive:6636kB present:10484kB pages_scanned:0 all_unreclaimable? no [513272.693537] lowmem_reserve[]: 0 992 992 992 [513272.693542] Node 0 DMA32 free:4184kB min:4008kB low:5008kB high:6012kB active:112512kB inactive:853960kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513272.693546] lowmem_reserve[]: 0 0 0 0 [513272.693550] Node 0 DMA: 3*4kB 0*8kB 0*16kB 0*32kB 2*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3980kB [513272.693561] Node 0 DMA32: 864*4kB 3*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4184kB [513272.693572] Swap cache: add 21570684, delete 21570030, find 726969/4231667, race 0+265 [513272.693574] Free swap = 3890264kB [513272.693575] Total swap = 3903752kB [513272.693577] Free swap: 3890264kB [513272.698661] 261736 pages of RAM [513272.698664] 5031 reserved pages [513272.698665] 14294 pages shared [513272.698666] 657 pages swap cached [513272.698673] jfsCommit: page allocation failure. order:1, mode:0x4020 [513272.698676] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513272.698677] [513272.698678] Call Trace: [513272.698680] [] __alloc_pages+0x2fd/0x3d0 [513272.698694] [] new_slab+0x220/0x260 [513272.698697] [] __slab_alloc+0x2f5/0x410 [513272.698701] [] __netdev_alloc_skb+0x2b/0x50 [513272.698704] [] __netdev_alloc_skb+0x2b/0x50 [513272.698707] [] __kmalloc_node_track_caller+0x121/0x130 [513272.698711] [] __alloc_skb+0x7b/0x160 [513272.698714] [] __netdev_alloc_skb+0x2b/0x50 [513272.698720] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513272.698725] [] :tg3:tg3_poll+0x8a9/0xa60 [513272.698731] [] net_rx_action+0x128/0x230 [513272.698736] [] __do_softirq+0x75/0xe0 [513272.698740] [] call_softirq+0x1c/0x30 [513272.698742] [] do_softirq+0x35/0x90 [513272.698745] [] irq_exit+0x88/0x90 [513272.698747] [] do_IRQ+0x80/0x100 [513272.698750] [] ret_from_intr+0x0/0xa [513272.698752] [] _spin_unlock_irqrestore+0x8/0x10 [513272.698765] [] :jfs:release_metapage+0x45/0x160 [513272.698772] [] :jfs:dbUpdatePMap+0x361/0x480 [513272.698781] [] :jfs:txAllocPMap+0xdd/0x120 [513272.698788] [] :jfs:txUpdateMap+0x1ae/0x270 [513272.698792] [] __wake_up+0x43/0x70 [513272.698799] [] :jfs:jfs_lazycommit+0x120/0x270 [513272.698802] [] default_wake_function+0x0/0x10 [513272.698809] [] :jfs:jfs_lazycommit+0x0/0x270 [513272.698812] [] kthread+0x4b/0x80 [513272.698815] [] child_rip+0xa/0x12 [513272.698819] [] kthread+0x0/0x80 [513272.698821] [] child_rip+0x0/0x12 [513272.698823] [513272.698825] Mem-info: [513272.698826] Node 0 DMA per-cpu: [513272.698829] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.698832] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.698834] Node 0 DMA32 per-cpu: [513272.698836] CPU 0: Hot: hi: 186, btch: 31 usd: 68 Cold: hi: 62, btch: 15 usd: 64 [513272.698839] CPU 1: Hot: hi: 186, btch: 31 usd: 119 Cold: hi: 62, btch: 15 usd: 61 [513272.698841] Active:28168 inactive:215149 dirty:14185 writeback:1 unstable:0 [513272.698842] free:2041 slab:5207 mapped:2105 pagetables:611 bounce:0 [513272.698844] Node 0 DMA free:3980kB min:40kB low:48kB high:60kB active:160kB inactive:6636kB present:10484kB pages_scanned:0 all_unreclaimable? no [513272.698849] lowmem_reserve[]: 0 992 992 992 [513272.698853] Node 0 DMA32 free:4184kB min:4008kB low:5008kB high:6012kB active:112512kB inactive:853960kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513272.698857] lowmem_reserve[]: 0 0 0 0 [513272.698862] Node 0 DMA: 3*4kB 0*8kB 0*16kB 0*32kB 2*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3980kB [513272.698873] Node 0 DMA32: 864*4kB 3*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4184kB [513272.698884] Swap cache: add 21570684, delete 21570030, find 726969/4231667, race 0+265 [513272.698886] Free swap = 3890264kB [513272.698887] Total swap = 3903752kB [513272.698889] Free swap: 3890264kB [513272.703744] 261736 pages of RAM [513272.703747] 5031 reserved pages [513272.703748] 14300 pages shared [513272.703749] 657 pages swap cached [513272.703760] jfsCommit: page allocation failure. order:1, mode:0x4020 [513272.703762] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513272.703764] [513272.703764] Call Trace: [513272.703765] [] __alloc_pages+0x2fd/0x3d0 [513272.703777] [] hrtimer_interrupt+0x17b/0x1d0 [513272.703783] [] new_slab+0x220/0x260 [513272.703785] [] __slab_alloc+0x2f5/0x410 [513272.703789] [] __netdev_alloc_skb+0x2b/0x50 [513272.703792] [] __netdev_alloc_skb+0x2b/0x50 [513272.703794] [] __kmalloc_node_track_caller+0x121/0x130 [513272.703798] [] __alloc_skb+0x7b/0x160 [513272.703801] [] __netdev_alloc_skb+0x2b/0x50 [513272.703806] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513272.703811] [] :tg3:tg3_poll+0x8a9/0xa60 [513272.703817] [] net_rx_action+0x128/0x230 [513272.703821] [] __do_softirq+0x75/0xe0 [513272.703824] [] call_softirq+0x1c/0x30 [513272.703827] [] do_softirq+0x35/0x90 [513272.703829] [] irq_exit+0x88/0x90 [513272.703831] [] do_IRQ+0x80/0x100 [513272.703834] [] ret_from_intr+0x0/0xa [513272.703835] [] _spin_unlock_irqrestore+0x8/0x10 [513272.703849] [] :jfs:release_metapage+0x45/0x160 [513272.703855] [] :jfs:dbUpdatePMap+0x361/0x480 [513272.703863] [] :jfs:txAllocPMap+0xdd/0x120 [513272.703870] [] :jfs:txUpdateMap+0x1ae/0x270 [513272.703874] [] __wake_up+0x43/0x70 [513272.703880] [] :jfs:jfs_lazycommit+0x120/0x270 [513272.703883] [] default_wake_function+0x0/0x10 [513272.703890] [] :jfs:jfs_lazycommit+0x0/0x270 [513272.703893] [] kthread+0x4b/0x80 [513272.703895] [] child_rip+0xa/0x12 [513272.703900] [] kthread+0x0/0x80 [513272.703902] [] child_rip+0x0/0x12 [513272.703904] [513272.703906] Mem-info: [513272.703907] Node 0 DMA per-cpu: [513272.703910] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.703912] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.703914] Node 0 DMA32 per-cpu: [513272.703917] CPU 0: Hot: hi: 186, btch: 31 usd: 68 Cold: hi: 62, btch: 15 usd: 64 [513272.703920] CPU 1: Hot: hi: 186, btch: 31 usd: 113 Cold: hi: 62, btch: 15 usd: 61 [513272.703923] Active:28168 inactive:215149 dirty:14185 writeback:1 unstable:0 [513272.703924] free:2041 slab:5207 mapped:2105 pagetables:611 bounce:0 [513272.703925] Node 0 DMA free:3980kB min:40kB low:48kB high:60kB active:160kB inactive:6636kB present:10484kB pages_scanned:0 all_unreclaimable? no [513272.703929] lowmem_reserve[]: 0 992 992 992 [513272.703934] Node 0 DMA32 free:4184kB min:4008kB low:5008kB high:6012kB active:112512kB inactive:853960kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513272.703938] lowmem_reserve[]: 0 0 0 0 [513272.703942] Node 0 DMA: 3*4kB 0*8kB 0*16kB 0*32kB 2*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3980kB [513272.703953] Node 0 DMA32: 864*4kB 3*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4184kB [513272.703964] Swap cache: add 21570684, delete 21570030, find 726969/4231667, race 0+265 [513272.703966] Free swap = 3890264kB [513272.703967] Total swap = 3903752kB [513272.703969] Free swap: 3890264kB [513272.708815] 261736 pages of RAM [513272.708818] 5031 reserved pages [513272.708819] 14289 pages shared [513272.708820] 657 pages swap cached [513272.708824] jfsCommit: page allocation failure. order:1, mode:0x4020 [513272.708826] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513272.708828] [513272.708828] Call Trace: [513272.708829] [] __alloc_pages+0x2fd/0x3d0 [513272.708841] [] hrtimer_interrupt+0x17b/0x1d0 [513272.708846] [] new_slab+0x220/0x260 [513272.708848] [] __slab_alloc+0x2f5/0x410 [513272.708851] [] __netdev_alloc_skb+0x2b/0x50 [513272.708854] [] __netdev_alloc_skb+0x2b/0x50 [513272.708856] [] __kmalloc_node_track_caller+0x121/0x130 [513272.708860] [] __alloc_skb+0x7b/0x160 [513272.708863] [] __netdev_alloc_skb+0x2b/0x50 [513272.708869] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513272.708874] [] :tg3:tg3_poll+0x8a9/0xa60 [513272.708879] [] net_rx_action+0x128/0x230 [513272.708883] [] __do_softirq+0x75/0xe0 [513272.708887] [] call_softirq+0x1c/0x30 [513272.708889] [] do_softirq+0x35/0x90 [513272.708891] [] irq_exit+0x88/0x90 [513272.708893] [] do_IRQ+0x80/0x100 [513272.708896] [] ret_from_intr+0x0/0xa [513272.708897] [] _spin_unlock_irqrestore+0x8/0x10 [513272.708910] [] :jfs:release_metapage+0x45/0x160 [513272.708916] [] :jfs:dbUpdatePMap+0x361/0x480 [513272.708925] [] :jfs:txAllocPMap+0xdd/0x120 [513272.708931] [] :jfs:txUpdateMap+0x1ae/0x270 [513272.708935] [] __wake_up+0x43/0x70 [513272.708941] [] :jfs:jfs_lazycommit+0x120/0x270 [513272.708944] [] default_wake_function+0x0/0x10 [513272.708950] [] :jfs:jfs_lazycommit+0x0/0x270 [513272.708953] [] kthread+0x4b/0x80 [513272.708955] [] child_rip+0xa/0x12 [513272.708959] [] kthread+0x0/0x80 [513272.708961] [] child_rip+0x0/0x12 [513272.708962] [513272.708963] Mem-info: [513272.708964] Node 0 DMA per-cpu: [513272.708966] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.708969] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.708970] Node 0 DMA32 per-cpu: [513272.708972] CPU 0: Hot: hi: 186, btch: 31 usd: 68 Cold: hi: 62, btch: 15 usd: 64 [513272.708975] CPU 1: Hot: hi: 186, btch: 31 usd: 110 Cold: hi: 62, btch: 15 usd: 61 [513272.708977] Active:28168 inactive:215149 dirty:14185 writeback:1 unstable:0 [513272.708978] free:2041 slab:5207 mapped:2105 pagetables:611 bounce:0 [513272.708980] Node 0 DMA free:3980kB min:40kB low:48kB high:60kB active:160kB inactive:6636kB present:10484kB pages_scanned:0 all_unreclaimable? no [513272.708983] lowmem_reserve[]: 0 992 992 992 [513272.708986] Node 0 DMA32 free:4184kB min:4008kB low:5008kB high:6012kB active:112512kB inactive:853960kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513272.708989] lowmem_reserve[]: 0 0 0 0 [513272.708991] Node 0 DMA: 3*4kB 0*8kB 0*16kB 0*32kB 2*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3980kB [513272.708998] Node 0 DMA32: 864*4kB 3*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4184kB [513272.709005] Swap cache: add 21570684, delete 21570030, find 726969/4231667, race 0+265 [513272.709007] Free swap = 3890264kB [513272.709008] Total swap = 3903752kB [513272.709009] Free swap: 3890264kB [513272.713860] 261736 pages of RAM [513272.713864] 5031 reserved pages [513272.713865] 14295 pages shared [513272.713866] 657 pages swap cached [513272.952962] jfsCommit: page allocation failure. order:1, mode:0x4020 [513272.952967] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513272.952971] [513272.952971] Call Trace: [513272.952973] [] __alloc_pages+0x2fd/0x3d0 [513272.952998] [] new_slab+0x220/0x260 [513272.953001] [] __slab_alloc+0x2f5/0x410 [513272.953006] [] __netdev_alloc_skb+0x2b/0x50 [513272.953009] [] __netdev_alloc_skb+0x2b/0x50 [513272.953012] [] __kmalloc_node_track_caller+0x121/0x130 [513272.953015] [] __alloc_skb+0x7b/0x160 [513272.953019] [] __netdev_alloc_skb+0x2b/0x50 [513272.953026] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513272.953031] [] :tg3:tg3_poll+0x8a9/0xa60 [513272.953037] [] net_rx_action+0x128/0x230 [513272.953042] [] __do_softirq+0x75/0xe0 [513272.953046] [] call_softirq+0x1c/0x30 [513272.953049] [] do_softirq+0x35/0x90 [513272.953051] [] irq_exit+0x88/0x90 [513272.953054] [] do_IRQ+0x80/0x100 [513272.953056] [] ret_from_intr+0x0/0xa [513272.953058] [] _spin_unlock_irqrestore+0x8/0x10 [513272.953072] [] :jfs:dbUpdatePMap+0x2a3/0x480 [513272.953081] [] :jfs:txAllocPMap+0xdd/0x120 [513272.953089] [] :jfs:txUpdateMap+0x1ae/0x270 [513272.953093] [] __wake_up+0x43/0x70 [513272.953100] [] :jfs:jfs_lazycommit+0x120/0x270 [513272.953103] [] default_wake_function+0x0/0x10 [513272.953110] [] :jfs:jfs_lazycommit+0x0/0x270 [513272.953113] [] kthread+0x4b/0x80 [513272.953116] [] child_rip+0xa/0x12 [513272.953120] [] kthread+0x0/0x80 [513272.953122] [] child_rip+0x0/0x12 [513272.953125] [513272.953126] Mem-info: [513272.953128] Node 0 DMA per-cpu: [513272.953131] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.953133] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.953135] Node 0 DMA32 per-cpu: [513272.953138] CPU 0: Hot: hi: 186, btch: 31 usd: 68 Cold: hi: 62, btch: 15 usd: 64 [513272.953140] CPU 1: Hot: hi: 186, btch: 31 usd: 135 Cold: hi: 62, btch: 15 usd: 61 [513272.953143] Active:28168 inactive:215174 dirty:14160 writeback:0 unstable:0 [513272.953144] free:2006 slab:5225 mapped:2105 pagetables:611 bounce:0 [513272.953146] Node 0 DMA free:3980kB min:40kB low:48kB high:60kB active:160kB inactive:6636kB present:10484kB pages_scanned:0 all_unreclaimable? no [513272.953150] lowmem_reserve[]: 0 992 992 992 [513272.953154] Node 0 DMA32 free:4044kB min:4008kB low:5008kB high:6012kB active:112512kB inactive:854060kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513272.953159] lowmem_reserve[]: 0 0 0 0 [513272.953163] Node 0 DMA: 3*4kB 0*8kB 0*16kB 0*32kB 2*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3980kB [513272.953174] Node 0 DMA32: 839*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3988kB [513272.953185] Swap cache: add 21570684, delete 21570030, find 726969/4231667, race 0+265 [513272.953187] Free swap = 3890264kB [513272.953188] Total swap = 3903752kB [513272.953189] Free swap: 3890264kB [513272.958261] 261736 pages of RAM [513272.958264] 5031 reserved pages [513272.958265] 14290 pages shared [513272.958266] 657 pages swap cached [513272.992865] jfsCommit: page allocation failure. order:1, mode:0x4020 [513272.992872] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513272.992875] [513272.992875] Call Trace: [513272.992877] [] __alloc_pages+0x2fd/0x3d0 [513272.992899] [] new_slab+0x220/0x260 [513272.992902] [] __slab_alloc+0x2f5/0x410 [513272.992906] [] __netdev_alloc_skb+0x2b/0x50 [513272.992909] [] __netdev_alloc_skb+0x2b/0x50 [513272.992912] [] __kmalloc_node_track_caller+0x121/0x130 [513272.992915] [] __alloc_skb+0x7b/0x160 [513272.992919] [] __netdev_alloc_skb+0x2b/0x50 [513272.992926] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513272.992931] [] :tg3:tg3_poll+0x8a9/0xa60 [513272.992937] [] net_rx_action+0x128/0x230 [513272.992942] [] __do_softirq+0x75/0xe0 [513272.992946] [] call_softirq+0x1c/0x30 [513272.992949] [] do_softirq+0x35/0x90 [513272.992951] [] irq_exit+0x88/0x90 [513272.992954] [] do_IRQ+0x80/0x100 [513272.992956] [] ret_from_intr+0x0/0xa [513272.992958] [] :jfs:__get_metapage+0xde/0x460 [513272.992971] [] __wake_up+0x43/0x70 [513272.992974] [] set_page_dirty+0x33/0x90 [513272.992982] [] :jfs:dbUpdatePMap+0x381/0x480 [513272.992990] [] :jfs:txAllocPMap+0xdd/0x120 [513272.992997] [] :jfs:txUpdateMap+0x1ae/0x270 [513272.993000] [] __wake_up+0x43/0x70 [513272.993008] [] :jfs:jfs_lazycommit+0x120/0x270 [513272.993011] [] default_wake_function+0x0/0x10 [513272.993017] [] :jfs:jfs_lazycommit+0x0/0x270 [513272.993021] [] kthread+0x4b/0x80 [513272.993024] [] child_rip+0xa/0x12 [513272.993028] [] kthread+0x0/0x80 [513272.993030] [] child_rip+0x0/0x12 [513272.993032] [513272.993033] Mem-info: [513272.993035] Node 0 DMA per-cpu: [513272.993037] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.993040] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.993042] Node 0 DMA32 per-cpu: [513272.993045] CPU 0: Hot: hi: 186, btch: 31 usd: 68 Cold: hi: 62, btch: 15 usd: 64 [513272.993048] CPU 1: Hot: hi: 186, btch: 31 usd: 132 Cold: hi: 62, btch: 15 usd: 61 [513272.993051] Active:28168 inactive:215174 dirty:14160 writeback:0 unstable:0 [513272.993052] free:2006 slab:5225 mapped:2105 pagetables:611 bounce:0 [513272.993053] Node 0 DMA free:3980kB min:40kB low:48kB high:60kB active:160kB inactive:6636kB present:10484kB pages_scanned:0 all_unreclaimable? no [513272.993057] lowmem_reserve[]: 0 992 992 992 [513272.993062] Node 0 DMA32 free:4044kB min:4008kB low:5008kB high:6012kB active:112512kB inactive:854060kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513272.993067] lowmem_reserve[]: 0 0 0 0 [513272.993071] Node 0 DMA: 3*4kB 0*8kB 0*16kB 0*32kB 2*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3980kB [513272.993082] Node 0 DMA32: 839*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3988kB [513272.993093] Swap cache: add 21570684, delete 21570030, find 726969/4231667, race 0+265 [513272.993095] Free swap = 3890264kB [513272.993096] Total swap = 3903752kB [513272.993098] Free swap: 3890264kB [513272.998341] 261736 pages of RAM [513272.998344] 5031 reserved pages [513272.998345] 14295 pages shared [513272.998346] 657 pages swap cached [513272.998352] jfsCommit: page allocation failure. order:1, mode:0x4020 [513272.998355] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513272.998356] [513272.998357] Call Trace: [513272.998359] [] __alloc_pages+0x2fd/0x3d0 [513272.998376] [] new_slab+0x220/0x260 [513272.998379] [] __slab_alloc+0x2f5/0x410 [513272.998383] [] __netdev_alloc_skb+0x2b/0x50 [513272.998386] [] __netdev_alloc_skb+0x2b/0x50 [513272.998389] [] __kmalloc_node_track_caller+0x121/0x130 [513272.998393] [] __alloc_skb+0x7b/0x160 [513272.998396] [] __netdev_alloc_skb+0x2b/0x50 [513272.998402] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513272.998408] [] :tg3:tg3_poll+0x8a9/0xa60 [513272.998413] [] net_rx_action+0x128/0x230 [513272.998418] [] __do_softirq+0x75/0xe0 [513272.998422] [] call_softirq+0x1c/0x30 [513272.998424] [] do_softirq+0x35/0x90 [513272.998427] [] irq_exit+0x88/0x90 [513272.998429] [] do_IRQ+0x80/0x100 [513272.998432] [] ret_from_intr+0x0/0xa [513272.998434] [] :jfs:__get_metapage+0xde/0x460 [513272.998446] [] __wake_up+0x43/0x70 [513272.998449] [] set_page_dirty+0x33/0x90 [513272.998457] [] :jfs:dbUpdatePMap+0x381/0x480 [513272.998465] [] :jfs:txAllocPMap+0xdd/0x120 [513272.998472] [] :jfs:txUpdateMap+0x1ae/0x270 [513272.998476] [] __wake_up+0x43/0x70 [513272.998483] [] :jfs:jfs_lazycommit+0x120/0x270 [513272.998486] [] default_wake_function+0x0/0x10 [513272.998493] [] :jfs:jfs_lazycommit+0x0/0x270 [513272.998496] [] kthread+0x4b/0x80 [513272.998499] [] child_rip+0xa/0x12 [513272.998503] [] kthread+0x0/0x80 [513272.998505] [] child_rip+0x0/0x12 [513272.998507] [513272.998508] Mem-info: [513272.998510] Node 0 DMA per-cpu: [513272.998513] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.998515] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513272.998517] Node 0 DMA32 per-cpu: [513272.998520] CPU 0: Hot: hi: 186, btch: 31 usd: 68 Cold: hi: 62, btch: 15 usd: 64 [513272.998522] CPU 1: Hot: hi: 186, btch: 31 usd: 126 Cold: hi: 62, btch: 15 usd: 61 [513272.998525] Active:28168 inactive:215174 dirty:14185 writeback:0 unstable:0 [513272.998526] free:2006 slab:5225 mapped:2105 pagetables:611 bounce:0 [513272.998528] Node 0 DMA free:3980kB min:40kB low:48kB high:60kB active:160kB inactive:6636kB present:10484kB pages_scanned:0 all_unreclaimable? no [513272.998532] lowmem_reserve[]: 0 992 992 992 [513272.998536] Node 0 DMA32 free:4044kB min:4008kB low:5008kB high:6012kB active:112512kB inactive:854060kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513272.998540] lowmem_reserve[]: 0 0 0 0 [513272.998544] Node 0 DMA: 3*4kB 0*8kB 0*16kB 0*32kB 2*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3980kB [513272.998554] Node 0 DMA32: 839*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3988kB [513272.998565] Swap cache: add 21570684, delete 21570030, find 726969/4231667, race 0+265 [513272.998567] Free swap = 3890264kB [513272.998568] Total swap = 3903752kB [513272.998570] Free swap: 3890264kB [513273.003400] 261736 pages of RAM [513273.003403] 5031 reserved pages [513273.003404] 14299 pages shared [513273.003405] 657 pages swap cached [513273.003417] jfsCommit: page allocation failure. order:1, mode:0x4020 [513273.003420] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513273.003421] [513273.003422] Call Trace: [513273.003423] [] __alloc_pages+0x2fd/0x3d0 [513273.003434] [] hrtimer_interrupt+0x17b/0x1d0 [513273.003439] [] new_slab+0x220/0x260 [513273.003442] [] __slab_alloc+0x2f5/0x410 [513273.003445] [] __netdev_alloc_skb+0x2b/0x50 [513273.003448] [] __netdev_alloc_skb+0x2b/0x50 [513273.003450] [] __kmalloc_node_track_caller+0x121/0x130 [513273.003454] [] __alloc_skb+0x7b/0x160 [513273.003457] [] __netdev_alloc_skb+0x2b/0x50 [513273.003462] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513273.003467] [] :tg3:tg3_poll+0x8a9/0xa60 [513273.003472] [] net_rx_action+0x128/0x230 [513273.003476] [] __do_softirq+0x75/0xe0 [513273.003480] [] call_softirq+0x1c/0x30 [513273.003482] [] do_softirq+0x35/0x90 [513273.003484] [] irq_exit+0x88/0x90 [513273.003486] [] do_IRQ+0x80/0x100 [513273.003489] [] ret_from_intr+0x0/0xa [513273.003490] [] :jfs:__get_metapage+0xde/0x460 [513273.003502] [] __wake_up+0x43/0x70 [513273.003504] [] set_page_dirty+0x33/0x90 [513273.003511] [] :jfs:dbUpdatePMap+0x381/0x480 [513273.003520] [] :jfs:txAllocPMap+0xdd/0x120 [513273.003526] [] :jfs:txUpdateMap+0x1ae/0x270 [513273.003529] [] __wake_up+0x43/0x70 [513273.003535] [] :jfs:jfs_lazycommit+0x120/0x270 [513273.003538] [] default_wake_function+0x0/0x10 [513273.003544] [] :jfs:jfs_lazycommit+0x0/0x270 [513273.003547] [] kthread+0x4b/0x80 [513273.003549] [] child_rip+0xa/0x12 [513273.003553] [] kthread+0x0/0x80 [513273.003555] [] child_rip+0x0/0x12 [513273.003556] [513273.003557] Mem-info: [513273.003558] Node 0 DMA per-cpu: [513273.003560] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513273.003562] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513273.003564] Node 0 DMA32 per-cpu: [513273.003566] CPU 0: Hot: hi: 186, btch: 31 usd: 68 Cold: hi: 62, btch: 15 usd: 64 [513273.003568] CPU 1: Hot: hi: 186, btch: 31 usd: 123 Cold: hi: 62, btch: 15 usd: 61 [513273.003571] Active:28168 inactive:215174 dirty:14185 writeback:0 unstable:0 [513273.003572] free:2006 slab:5225 mapped:2105 pagetables:611 bounce:0 [513273.003574] Node 0 DMA free:3980kB min:40kB low:48kB high:60kB active:160kB inactive:6636kB present:10484kB pages_scanned:0 all_unreclaimable? no [513273.003577] lowmem_reserve[]: 0 992 992 992 [513273.003580] Node 0 DMA32 free:4044kB min:4008kB low:5008kB high:6012kB active:112512kB inactive:854060kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513273.003583] lowmem_reserve[]: 0 0 0 0 [513273.003587] Node 0 DMA: 3*4kB 0*8kB 0*16kB 0*32kB 2*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3980kB [513273.003594] Node 0 DMA32: 839*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3988kB [513273.003606] Swap cache: add 21570684, delete 21570030, find 726969/4231667, race 0+265 [513273.003607] Free swap = 3890264kB [513273.003609] Total swap = 3903752kB [513273.003610] Free swap: 3890264kB [513273.008434] 261736 pages of RAM [513273.008437] 5031 reserved pages [513273.008437] 14299 pages shared [513273.008438] 657 pages swap cached [513428.086148] printk: 6 messages suppressed. [513428.086154] jfsCommit: page allocation failure. order:1, mode:0x4020 [513428.086158] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513428.086160] [513428.086161] Call Trace: [513428.086162] [] __alloc_pages+0x2fd/0x3d0 [513428.086191] [] new_slab+0x220/0x260 [513428.086194] [] __slab_alloc+0x2f5/0x410 [513428.086199] [] __netdev_alloc_skb+0x2b/0x50 [513428.086203] [] __netdev_alloc_skb+0x2b/0x50 [513428.086206] [] __kmalloc_node_track_caller+0x121/0x130 [513428.086210] [] __alloc_skb+0x7b/0x160 [513428.086214] [] __netdev_alloc_skb+0x2b/0x50 [513428.086222] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513428.086228] [] :tg3:tg3_poll+0x8a9/0xa60 [513428.086234] [] net_rx_action+0x128/0x230 [513428.086240] [] __do_softirq+0x75/0xe0 [513428.086244] [] call_softirq+0x1c/0x30 [513428.086248] [] do_softirq+0x35/0x90 [513428.086250] [] irq_exit+0x88/0x90 [513428.086253] [] do_IRQ+0x80/0x100 [513428.086257] [] ret_from_intr+0x0/0xa [513428.086259] [] memset_c+0x20/0x30 [513428.086274] [] :jfs:dbUpdatePMap+0x2f4/0x480 [513428.086283] [] :jfs:txAllocPMap+0xdd/0x120 [513428.086291] [] :jfs:txUpdateMap+0x1ae/0x270 [513428.086295] [] __wake_up+0x43/0x70 [513428.086302] [] :jfs:jfs_lazycommit+0x120/0x270 [513428.086306] [] default_wake_function+0x0/0x10 [513428.086313] [] :jfs:jfs_lazycommit+0x0/0x270 [513428.086317] [] kthread+0x4b/0x80 [513428.086320] [] child_rip+0xa/0x12 [513428.086324] [] kthread+0x0/0x80 [513428.086327] [] child_rip+0x0/0x12 [513428.086329] [513428.086331] Mem-info: [513428.086333] Node 0 DMA per-cpu: [513428.086337] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513428.086339] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513428.086342] Node 0 DMA32 per-cpu: [513428.086345] CPU 0: Hot: hi: 186, btch: 31 usd: 95 Cold: hi: 62, btch: 15 usd: 51 [513428.086348] CPU 1: Hot: hi: 186, btch: 31 usd: 117 Cold: hi: 62, btch: 15 usd: 48 [513428.086351] Active:28223 inactive:214965 dirty:12020 writeback:10 unstable:0 [513428.086352] free:2022 slab:5371 mapped:2105 pagetables:611 bounce:0 [513428.086354] Node 0 DMA free:3976kB min:40kB low:48kB high:60kB active:160kB inactive:6516kB present:10484kB pages_scanned:0 all_unreclaimable? no [513428.086359] lowmem_reserve[]: 0 992 992 992 [513428.086365] Node 0 DMA32 free:4112kB min:4008kB low:5008kB high:6012kB active:112732kB inactive:853344kB present:1016472kB pages_scanned:32 all_unreclaimable? no [513428.086370] lowmem_reserve[]: 0 0 0 0 [513428.086375] Node 0 DMA: 12*4kB 1*8kB 1*16kB 0*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB [513428.086389] Node 0 DMA32: 852*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4112kB [513428.086403] Swap cache: add 21570684, delete 21570059, find 726969/4231667, race 0+265 [513428.086405] Free swap = 3890264kB [513428.086407] Total swap = 3903752kB [513428.086409] Free swap: 3890264kB [513428.091519] 261736 pages of RAM [513428.091523] 5031 reserved pages [513428.091524] 14774 pages shared [513428.091525] 628 pages swap cached [513428.091543] jfsCommit: page allocation failure. order:1, mode:0x4020 [513428.091547] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513428.091549] [513428.091550] Call Trace: [513428.091552] [] __alloc_pages+0x2fd/0x3d0 [513428.091568] [] new_slab+0x220/0x260 [513428.091571] [] __slab_alloc+0x2f5/0x410 [513428.091576] [] __netdev_alloc_skb+0x2b/0x50 [513428.091579] [] __netdev_alloc_skb+0x2b/0x50 [513428.091583] [] __kmalloc_node_track_caller+0x121/0x130 [513428.091587] [] __alloc_skb+0x7b/0x160 [513428.091590] [] __netdev_alloc_skb+0x2b/0x50 [513428.091597] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513428.091603] [] :tg3:tg3_poll+0x8a9/0xa60 [513428.091609] [] net_rx_action+0x128/0x230 [513428.091614] [] __do_softirq+0x75/0xe0 [513428.091618] [] call_softirq+0x1c/0x30 [513428.091621] [] do_softirq+0x35/0x90 [513428.091624] [] irq_exit+0x88/0x90 [513428.091627] [] do_IRQ+0x80/0x100 [513428.091630] [] ret_from_intr+0x0/0xa [513428.091632] [] memset_c+0x20/0x30 [513428.091645] [] :jfs:dbUpdatePMap+0x2f4/0x480 [513428.091654] [] :jfs:txAllocPMap+0xdd/0x120 [513428.091662] [] :jfs:txUpdateMap+0x1ae/0x270 [513428.091666] [] __wake_up+0x43/0x70 [513428.091673] [] :jfs:jfs_lazycommit+0x120/0x270 [513428.091677] [] default_wake_function+0x0/0x10 [513428.091684] [] :jfs:jfs_lazycommit+0x0/0x270 [513428.091688] [] kthread+0x4b/0x80 [513428.091691] [] child_rip+0xa/0x12 [513428.091695] [] kthread+0x0/0x80 [513428.091698] [] child_rip+0x0/0x12 [513428.091701] [513428.091703] Mem-info: [513428.091705] Node 0 DMA per-cpu: [513428.091708] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513428.091711] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513428.091713] Node 0 DMA32 per-cpu: [513428.091716] CPU 0: Hot: hi: 186, btch: 31 usd: 95 Cold: hi: 62, btch: 15 usd: 51 [513428.091719] CPU 1: Hot: hi: 186, btch: 31 usd: 116 Cold: hi: 62, btch: 15 usd: 48 [513428.091722] Active:28223 inactive:214965 dirty:12020 writeback:10 unstable:0 [513428.091723] free:2022 slab:5371 mapped:2105 pagetables:611 bounce:0 [513428.091725] Node 0 DMA free:3976kB min:40kB low:48kB high:60kB active:160kB inactive:6516kB present:10484kB pages_scanned:0 all_unreclaimable? no [513428.091729] lowmem_reserve[]: 0 992 992 992 [513428.091735] Node 0 DMA32 free:4112kB min:4008kB low:5008kB high:6012kB active:112732kB inactive:853344kB present:1016472kB pages_scanned:32 all_unreclaimable? no [513428.091741] lowmem_reserve[]: 0 0 0 0 [513428.091746] Node 0 DMA: 12*4kB 1*8kB 1*16kB 0*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB [513428.091760] Node 0 DMA32: 852*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4112kB [513428.091774] Swap cache: add 21570684, delete 21570059, find 726969/4231667, race 0+265 [513428.091776] Free swap = 3890264kB [513428.091778] Total swap = 3903752kB [513428.091780] Free swap: 3890264kB [513428.096396] 261736 pages of RAM [513428.096400] 5031 reserved pages [513428.096401] 14774 pages shared [513428.096402] 628 pages swap cached [513428.096439] jfsCommit: page allocation failure. order:1, mode:0x4020 [513428.096442] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513428.096444] [513428.096445] Call Trace: [513428.096447] [] __alloc_pages+0x2fd/0x3d0 [513428.096461] [] hrtimer_interrupt+0x17b/0x1d0 [513428.096467] [] new_slab+0x220/0x260 [513428.096470] [] __slab_alloc+0x2f5/0x410 [513428.096475] [] __netdev_alloc_skb+0x2b/0x50 [513428.096478] [] __netdev_alloc_skb+0x2b/0x50 [513428.096481] [] __kmalloc_node_track_caller+0x121/0x130 [513428.096485] [] __alloc_skb+0x7b/0x160 [513428.096489] [] __netdev_alloc_skb+0x2b/0x50 [513428.096496] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513428.096501] [] :tg3:tg3_poll+0x8a9/0xa60 [513428.096508] [] net_rx_action+0x128/0x230 [513428.096513] [] __do_softirq+0x75/0xe0 [513428.096517] [] call_softirq+0x1c/0x30 [513428.096520] [] do_softirq+0x35/0x90 [513428.096523] [] irq_exit+0x88/0x90 [513428.096526] [] do_IRQ+0x80/0x100 [513428.096529] [] ret_from_intr+0x0/0xa [513428.096531] [] memset_c+0x20/0x30 [513428.096544] [] :jfs:dbUpdatePMap+0x2f4/0x480 [513428.096554] [] :jfs:txAllocPMap+0xdd/0x120 [513428.096561] [] :jfs:txUpdateMap+0x1ae/0x270 [513428.096565] [] __wake_up+0x43/0x70 [513428.096573] [] :jfs:jfs_lazycommit+0x120/0x270 [513428.096576] [] default_wake_function+0x0/0x10 [513428.096583] [] :jfs:jfs_lazycommit+0x0/0x270 [513428.096587] [] kthread+0x4b/0x80 [513428.096590] [] child_rip+0xa/0x12 [513428.096594] [] kthread+0x0/0x80 [513428.096597] [] child_rip+0x0/0x12 [513428.096600] [513428.096601] Mem-info: [513428.096603] Node 0 DMA per-cpu: [513428.096606] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513428.096609] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513428.096611] Node 0 DMA32 per-cpu: [513428.096614] CPU 0: Hot: hi: 186, btch: 31 usd: 95 Cold: hi: 62, btch: 15 usd: 51 [513428.096617] CPU 1: Hot: hi: 186, btch: 31 usd: 116 Cold: hi: 62, btch: 15 usd: 48 [513428.096621] Active:28223 inactive:214965 dirty:12020 writeback:10 unstable:0 [513428.096622] free:2022 slab:5371 mapped:2105 pagetables:611 bounce:0 [513428.096623] Node 0 DMA free:3976kB min:40kB low:48kB high:60kB active:160kB inactive:6516kB present:10484kB pages_scanned:0 all_unreclaimable? no [513428.096628] lowmem_reserve[]: 0 992 992 992 [513428.096634] Node 0 DMA32 free:4112kB min:4008kB low:5008kB high:6012kB active:112732kB inactive:853344kB present:1016472kB pages_scanned:32 all_unreclaimable? no [513428.096639] lowmem_reserve[]: 0 0 0 0 [513428.096644] Node 0 DMA: 12*4kB 1*8kB 1*16kB 0*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB [513428.096659] Node 0 DMA32: 852*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4112kB [513428.096673] Swap cache: add 21570684, delete 21570059, find 726969/4231667, race 0+265 [513428.096676] Free swap = 3890264kB [513428.096677] Total swap = 3903752kB [513428.096679] Free swap: 3890264kB [513428.101317] 261736 pages of RAM [513428.101322] 5031 reserved pages [513428.101323] 14773 pages shared [513428.101324] 628 pages swap cached [513428.101333] jfsCommit: page allocation failure. order:1, mode:0x4020 [513428.101336] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513428.101337] [513428.101337] Call Trace: [513428.101340] [] __alloc_pages+0x2fd/0x3d0 [513428.101354] [] hrtimer_interrupt+0x17b/0x1d0 [513428.101360] [] new_slab+0x220/0x260 [513428.101363] [] __slab_alloc+0x2f5/0x410 [513428.101367] [] __netdev_alloc_skb+0x2b/0x50 [513428.101371] [] __netdev_alloc_skb+0x2b/0x50 [513428.101374] [] __kmalloc_node_track_caller+0x121/0x130 [513428.101379] [] __alloc_skb+0x7b/0x160 [513428.101382] [] __netdev_alloc_skb+0x2b/0x50 [513428.101389] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513428.101394] [] :tg3:tg3_poll+0x8a9/0xa60 [513428.101400] [] net_rx_action+0x128/0x230 [513428.101406] [] __do_softirq+0x75/0xe0 [513428.101410] [] call_softirq+0x1c/0x30 [513428.101413] [] do_softirq+0x35/0x90 [513428.101416] [] irq_exit+0x88/0x90 [513428.101419] [] do_IRQ+0x80/0x100 [513428.101422] [] ret_from_intr+0x0/0xa [513428.101424] [] memset_c+0x20/0x30 [513428.101437] [] :jfs:dbUpdatePMap+0x2f4/0x480 [513428.101446] [] :jfs:txAllocPMap+0xdd/0x120 [513428.101454] [] :jfs:txUpdateMap+0x1ae/0x270 [513428.101458] [] __wake_up+0x43/0x70 [513428.101465] [] :jfs:jfs_lazycommit+0x120/0x270 [513428.101469] [] default_wake_function+0x0/0x10 [513428.101476] [] :jfs:jfs_lazycommit+0x0/0x270 [513428.101479] [] kthread+0x4b/0x80 [513428.101483] [] child_rip+0xa/0x12 [513428.101487] [] kthread+0x0/0x80 [513428.101490] [] child_rip+0x0/0x12 [513428.101493] [513428.101494] Mem-info: [513428.101496] Node 0 DMA per-cpu: [513428.101500] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513428.101502] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513428.101505] Node 0 DMA32 per-cpu: [513428.101508] CPU 0: Hot: hi: 186, btch: 31 usd: 95 Cold: hi: 62, btch: 15 usd: 51 [513428.101511] CPU 1: Hot: hi: 186, btch: 31 usd: 114 Cold: hi: 62, btch: 15 usd: 48 [513428.101515] Active:28223 inactive:214965 dirty:12020 writeback:10 unstable:0 [513428.101516] free:2022 slab:5371 mapped:2105 pagetables:611 bounce:0 [513428.101517] Node 0 DMA free:3976kB min:40kB low:48kB high:60kB active:160kB inactive:6516kB present:10484kB pages_scanned:0 all_unreclaimable? no [513428.101522] lowmem_reserve[]: 0 992 992 992 [513428.101528] Node 0 DMA32 free:4112kB min:4008kB low:5008kB high:6012kB active:112732kB inactive:853344kB present:1016472kB pages_scanned:32 all_unreclaimable? no [513428.101533] lowmem_reserve[]: 0 0 0 0 [513428.101538] Node 0 DMA: 12*4kB 1*8kB 1*16kB 0*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB [513428.101552] Node 0 DMA32: 852*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4112kB [513428.101567] Swap cache: add 21570684, delete 21570059, find 726969/4231667, race 0+265 [513428.101569] Free swap = 3890264kB [513428.101570] Total swap = 3903752kB [513428.101572] Free swap: 3890264kB [513428.106195] 261736 pages of RAM [513428.106199] 5031 reserved pages [513428.106200] 14775 pages shared [513428.106201] 628 pages swap cached [513525.866200] jfsCommit: page allocation failure. order:1, mode:0x4020 [513525.866207] Pid: 2336, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513525.866210] [513525.866211] Call Trace: [513525.866213] [] __alloc_pages+0x2fd/0x3d0 [513525.866250] [] new_slab+0x220/0x260 [513525.866254] [] __slab_alloc+0x2f5/0x410 [513525.866258] [] __netdev_alloc_skb+0x2b/0x50 [513525.866262] [] __netdev_alloc_skb+0x2b/0x50 [513525.866265] [] __kmalloc_node_track_caller+0x121/0x130 [513525.866269] [] __alloc_skb+0x7b/0x160 [513525.866273] [] __netdev_alloc_skb+0x2b/0x50 [513525.866282] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513525.866288] [] :tg3:tg3_poll+0x8a9/0xa60 [513525.866294] [] net_rx_action+0x128/0x230 [513525.866299] [] __do_softirq+0x75/0xe0 [513525.866304] [] call_softirq+0x1c/0x30 [513525.866307] [] do_softirq+0x35/0x90 [513525.866310] [] irq_exit+0x88/0x90 [513525.866313] [] do_IRQ+0x80/0x100 [513525.866316] [] ret_from_intr+0x0/0xa [513525.866318] [] __set_page_dirty_nobuffers+0x15/0x1a0 [513525.866326] [] set_page_dirty+0x33/0x90 [513525.866336] [] :jfs:release_metapage+0x122/0x160 [513525.866343] [] :jfs:dbUpdatePMap+0x361/0x480 [513525.866352] [] :jfs:txAllocPMap+0xdd/0x120 [513525.866360] [] :jfs:txUpdateMap+0x1ae/0x270 [513525.866364] [] __wake_up+0x43/0x70 [513525.866372] [] :jfs:jfs_lazycommit+0x120/0x270 [513525.866376] [] default_wake_function+0x0/0x10 [513525.866383] [] :jfs:jfs_lazycommit+0x0/0x270 [513525.866387] [] kthread+0x4b/0x80 [513525.866390] [] child_rip+0xa/0x12 [513525.866395] [] kthread+0x0/0x80 [513525.866397] [] child_rip+0x0/0x12 [513525.866400] [513525.866402] Mem-info: [513525.866404] Node 0 DMA per-cpu: [513525.866407] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513525.866410] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513525.866413] Node 0 DMA32 per-cpu: [513525.866416] CPU 0: Hot: hi: 186, btch: 31 usd: 77 Cold: hi: 62, btch: 15 usd: 48 [513525.866418] CPU 1: Hot: hi: 186, btch: 31 usd: 123 Cold: hi: 62, btch: 15 usd: 56 [513525.866422] Active:28219 inactive:215011 dirty:12006 writeback:14 unstable:0 [513525.866423] free:1959 slab:5331 mapped:2105 pagetables:611 bounce:0 [513525.866425] Node 0 DMA free:3988kB min:40kB low:48kB high:60kB active:156kB inactive:6604kB present:10484kB pages_scanned:0 all_unreclaimable? no [513525.866429] lowmem_reserve[]: 0 992 992 992 [513525.866435] Node 0 DMA32 free:3848kB min:4008kB low:5008kB high:6012kB active:112720kB inactive:853440kB present:1016472kB pages_scanned:133 all_unreclaimable? no [513525.866441] lowmem_reserve[]: 0 0 0 0 [513525.866445] Node 0 DMA: 4*4kB 0*8kB 0*16kB 0*32kB 2*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513525.866458] Node 0 DMA32: 780*4kB 1*8kB 1*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3848kB [513525.866472] Swap cache: add 21570684, delete 21570059, find 726969/4231667, race 0+265 [513525.866474] Free swap = 3890264kB [513525.866476] Total swap = 3903752kB [513525.866477] Free swap: 3890264kB [513525.871826] 261736 pages of RAM [513525.871829] 5031 reserved pages [513525.871830] 14838 pages shared [513525.871830] 628 pages swap cached [513688.906730] jfsCommit: page allocation failure. order:1, mode:0x4020 [513688.906736] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513688.906739] [513688.906739] Call Trace: [513688.906741] [] __alloc_pages+0x2fd/0x3d0 [513688.906776] [] new_slab+0x220/0x260 [513688.906779] [] __slab_alloc+0x2f5/0x410 [513688.906784] [] __netdev_alloc_skb+0x2b/0x50 [513688.906787] [] __netdev_alloc_skb+0x2b/0x50 [513688.906790] [] __kmalloc_node_track_caller+0x121/0x130 [513688.906793] [] __alloc_skb+0x7b/0x160 [513688.906797] [] __netdev_alloc_skb+0x2b/0x50 [513688.906805] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513688.906810] [] :tg3:tg3_poll+0x8a9/0xa60 [513688.906816] [] net_rx_action+0x128/0x230 [513688.906821] [] __do_softirq+0x75/0xe0 [513688.906825] [] call_softirq+0x1c/0x30 [513688.906828] [] do_softirq+0x35/0x90 [513688.906831] [] irq_exit+0x88/0x90 [513688.906833] [] do_IRQ+0x80/0x100 [513688.906836] [] ret_from_intr+0x0/0xa [513688.906838] [] _spin_unlock_irqrestore+0x8/0x10 [513688.906853] [] :jfs:dbUpdatePMap+0x2a3/0x480 [513688.906862] [] :jfs:txAllocPMap+0xdd/0x120 [513688.906869] [] :jfs:txUpdateMap+0x1ae/0x270 [513688.906873] [] __wake_up+0x43/0x70 [513688.906880] [] :jfs:jfs_lazycommit+0x120/0x270 [513688.906883] [] default_wake_function+0x0/0x10 [513688.906890] [] :jfs:jfs_lazycommit+0x0/0x270 [513688.906894] [] kthread+0x4b/0x80 [513688.906896] [] child_rip+0xa/0x12 [513688.906900] [] kthread+0x0/0x80 [513688.906903] [] child_rip+0x0/0x12 [513688.906905] [513688.906906] Mem-info: [513688.906908] Node 0 DMA per-cpu: [513688.906911] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513688.906913] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513688.906915] Node 0 DMA32 per-cpu: [513688.906918] CPU 0: Hot: hi: 186, btch: 31 usd: 77 Cold: hi: 62, btch: 15 usd: 50 [513688.906921] CPU 1: Hot: hi: 186, btch: 31 usd: 164 Cold: hi: 62, btch: 15 usd: 59 [513688.906924] Active:28989 inactive:214441 dirty:13588 writeback:21 unstable:0 [513688.906925] free:1915 slab:5194 mapped:2099 pagetables:606 bounce:0 [513688.906927] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:156kB inactive:6568kB present:10484kB pages_scanned:0 all_unreclaimable? no [513688.906931] lowmem_reserve[]: 0 992 992 992 [513688.906935] Node 0 DMA32 free:3676kB min:4008kB low:5008kB high:6012kB active:115800kB inactive:851196kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513688.906940] lowmem_reserve[]: 0 0 0 0 [513688.906944] Node 0 DMA: 10*4kB 1*8kB 0*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513688.906955] Node 0 DMA32: 736*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3712kB [513688.906965] Swap cache: add 21570715, delete 21570070, find 727109/4231837, race 0+265 [513688.906967] Free swap = 3890280kB [513688.906968] Total swap = 3903752kB [513688.906970] Free swap: 3890280kB [513688.912108] 261736 pages of RAM [513688.912112] 5031 reserved pages [513688.912113] 14745 pages shared [513688.912114] 648 pages swap cached [513689.066222] jfsCommit: page allocation failure. order:1, mode:0x4020 [513689.066227] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513689.066230] [513689.066231] Call Trace: [513689.066233] [] __alloc_pages+0x2fd/0x3d0 [513689.066257] [] new_slab+0x220/0x260 [513689.066260] [] __slab_alloc+0x2f5/0x410 [513689.066264] [] __netdev_alloc_skb+0x2b/0x50 [513689.066268] [] __netdev_alloc_skb+0x2b/0x50 [513689.066270] [] __kmalloc_node_track_caller+0x121/0x130 [513689.066274] [] __alloc_skb+0x7b/0x160 [513689.066277] [] __netdev_alloc_skb+0x2b/0x50 [513689.066284] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513689.066290] [] :tg3:tg3_poll+0x8a9/0xa60 [513689.066296] [] net_rx_action+0x128/0x230 [513689.066300] [] __do_softirq+0x75/0xe0 [513689.066304] [] call_softirq+0x1c/0x30 [513689.066307] [] do_softirq+0x35/0x90 [513689.066310] [] irq_exit+0x88/0x90 [513689.066312] [] do_IRQ+0x80/0x100 [513689.066315] [] ret_from_intr+0x0/0xa [513689.066317] [] unlock_page+0x9/0x30 [513689.066331] [] :jfs:release_metapage+0xd8/0x160 [513689.066338] [] :jfs:dbUpdatePMap+0x361/0x480 [513689.066347] [] :jfs:txAllocPMap+0xdd/0x120 [513689.066354] [] :jfs:txUpdateMap+0x1ae/0x270 [513689.066357] [] __wake_up+0x43/0x70 [513689.066365] [] :jfs:jfs_lazycommit+0x120/0x270 [513689.066368] [] default_wake_function+0x0/0x10 [513689.066375] [] :jfs:jfs_lazycommit+0x0/0x270 [513689.066378] [] kthread+0x4b/0x80 [513689.066381] [] child_rip+0xa/0x12 [513689.066385] [] kthread+0x0/0x80 [513689.066387] [] child_rip+0x0/0x12 [513689.066389] [513689.066390] Mem-info: [513689.066392] Node 0 DMA per-cpu: [513689.066395] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.066397] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.066399] Node 0 DMA32 per-cpu: [513689.066402] CPU 0: Hot: hi: 186, btch: 31 usd: 75 Cold: hi: 62, btch: 15 usd: 50 [513689.066405] CPU 1: Hot: hi: 186, btch: 31 usd: 157 Cold: hi: 62, btch: 15 usd: 56 [513689.066407] Active:28986 inactive:214250 dirty:13588 writeback:21 unstable:0 [513689.066408] free:2101 slab:5229 mapped:2099 pagetables:606 bounce:0 [513689.066410] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:144kB inactive:6564kB present:10484kB pages_scanned:32 all_unreclaimable? no [513689.066414] lowmem_reserve[]: 0 992 992 992 [513689.066419] Node 0 DMA32 free:4420kB min:4008kB low:5008kB high:6012kB active:115800kB inactive:850436kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513689.066423] lowmem_reserve[]: 0 0 0 0 [513689.066427] Node 0 DMA: 10*4kB 1*8kB 0*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513689.066438] Node 0 DMA32: 921*4kB 0*8kB 0*16kB 1*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4420kB [513689.066449] Swap cache: add 21570715, delete 21570070, find 727109/4231837, race 0+265 [513689.066450] Free swap = 3890280kB [513689.066452] Total swap = 3903752kB [513689.066453] Free swap: 3890280kB [513689.071544] 261736 pages of RAM [513689.071547] 5031 reserved pages [513689.071548] 14747 pages shared [513689.071549] 648 pages swap cached [513689.071562] jfsCommit: page allocation failure. order:1, mode:0x4020 [513689.071564] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513689.071566] [513689.071566] Call Trace: [513689.071568] [] __alloc_pages+0x2fd/0x3d0 [513689.071583] [] new_slab+0x220/0x260 [513689.071586] [] __slab_alloc+0x2f5/0x410 [513689.071590] [] __netdev_alloc_skb+0x2b/0x50 [513689.071593] [] __netdev_alloc_skb+0x2b/0x50 [513689.071596] [] __kmalloc_node_track_caller+0x121/0x130 [513689.071600] [] __alloc_skb+0x7b/0x160 [513689.071603] [] __netdev_alloc_skb+0x2b/0x50 [513689.071609] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513689.071614] [] :tg3:tg3_poll+0x8a9/0xa60 [513689.071620] [] net_rx_action+0x128/0x230 [513689.071624] [] __do_softirq+0x75/0xe0 [513689.071628] [] call_softirq+0x1c/0x30 [513689.071631] [] do_softirq+0x35/0x90 [513689.071633] [] irq_exit+0x88/0x90 [513689.071636] [] do_IRQ+0x80/0x100 [513689.071639] [] ret_from_intr+0x0/0xa [513689.071640] [] unlock_page+0x9/0x30 [513689.071653] [] :jfs:release_metapage+0xd8/0x160 [513689.071659] [] :jfs:dbUpdatePMap+0x361/0x480 [513689.071668] [] :jfs:txAllocPMap+0xdd/0x120 [513689.071675] [] :jfs:txUpdateMap+0x1ae/0x270 [513689.071679] [] __wake_up+0x43/0x70 [513689.071686] [] :jfs:jfs_lazycommit+0x120/0x270 [513689.071689] [] default_wake_function+0x0/0x10 [513689.071696] [] :jfs:jfs_lazycommit+0x0/0x270 [513689.071699] [] kthread+0x4b/0x80 [513689.071702] [] child_rip+0xa/0x12 [513689.071706] [] kthread+0x0/0x80 [513689.071708] [] child_rip+0x0/0x12 [513689.071710] [513689.071711] Mem-info: [513689.071713] Node 0 DMA per-cpu: [513689.071716] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.071719] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.071721] Node 0 DMA32 per-cpu: [513689.071723] CPU 0: Hot: hi: 186, btch: 31 usd: 75 Cold: hi: 62, btch: 15 usd: 50 [513689.071726] CPU 1: Hot: hi: 186, btch: 31 usd: 153 Cold: hi: 62, btch: 15 usd: 56 [513689.071729] Active:28986 inactive:214250 dirty:13588 writeback:21 unstable:0 [513689.071730] free:2101 slab:5229 mapped:2099 pagetables:606 bounce:0 [513689.071731] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:144kB inactive:6564kB present:10484kB pages_scanned:32 all_unreclaimable? no [513689.071735] lowmem_reserve[]: 0 992 992 992 [513689.071740] Node 0 DMA32 free:4420kB min:4008kB low:5008kB high:6012kB active:115800kB inactive:850436kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513689.071744] lowmem_reserve[]: 0 0 0 0 [513689.071748] Node 0 DMA: 10*4kB 1*8kB 0*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513689.071759] Node 0 DMA32: 921*4kB 0*8kB 0*16kB 1*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4420kB [513689.071770] Swap cache: add 21570715, delete 21570070, find 727109/4231837, race 0+265 [513689.071771] Free swap = 3890280kB [513689.071773] Total swap = 3903752kB [513689.071774] Free swap: 3890280kB [513689.076628] 261736 pages of RAM [513689.076631] 5031 reserved pages [513689.076632] 14752 pages shared [513689.076632] 648 pages swap cached [513689.275984] jfsCommit: page allocation failure. order:1, mode:0x4020 [513689.275989] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513689.275992] [513689.275993] Call Trace: [513689.275994] [] __alloc_pages+0x2fd/0x3d0 [513689.276018] [] new_slab+0x220/0x260 [513689.276022] [] __slab_alloc+0x2f5/0x410 [513689.276026] [] __netdev_alloc_skb+0x2b/0x50 [513689.276029] [] __netdev_alloc_skb+0x2b/0x50 [513689.276032] [] __kmalloc_node_track_caller+0x121/0x130 [513689.276035] [] __alloc_skb+0x7b/0x160 [513689.276039] [] __netdev_alloc_skb+0x2b/0x50 [513689.276046] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513689.276051] [] :tg3:tg3_poll+0x8a9/0xa60 [513689.276057] [] net_rx_action+0x128/0x230 [513689.276061] [] __do_softirq+0x75/0xe0 [513689.276065] [] call_softirq+0x1c/0x30 [513689.276068] [] do_softirq+0x35/0x90 [513689.276071] [] irq_exit+0x88/0x90 [513689.276073] [] do_IRQ+0x80/0x100 [513689.276076] [] ret_from_intr+0x0/0xa [513689.276078] [] :jfs:release_metapage+0x80/0x160 [513689.276095] [] :jfs:dbUpdatePMap+0x361/0x480 [513689.276103] [] :jfs:txAllocPMap+0xdd/0x120 [513689.276110] [] :jfs:txUpdateMap+0x1ae/0x270 [513689.276114] [] __wake_up+0x43/0x70 [513689.276121] [] :jfs:jfs_lazycommit+0x120/0x270 [513689.276124] [] default_wake_function+0x0/0x10 [513689.276131] [] :jfs:jfs_lazycommit+0x0/0x270 [513689.276135] [] kthread+0x4b/0x80 [513689.276137] [] child_rip+0xa/0x12 [513689.276141] [] kthread+0x0/0x80 [513689.276144] [] child_rip+0x0/0x12 [513689.276146] [513689.276147] Mem-info: [513689.276149] Node 0 DMA per-cpu: [513689.276152] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.276155] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.276157] Node 0 DMA32 per-cpu: [513689.276159] CPU 0: Hot: hi: 186, btch: 31 usd: 74 Cold: hi: 62, btch: 15 usd: 50 [513689.276162] CPU 1: Hot: hi: 186, btch: 31 usd: 179 Cold: hi: 62, btch: 15 usd: 56 [513689.276165] Active:28997 inactive:214247 dirty:13606 writeback:21 unstable:0 [513689.276166] free:2070 slab:5230 mapped:2099 pagetables:606 bounce:0 [513689.276167] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:160kB inactive:6564kB present:10484kB pages_scanned:32 all_unreclaimable? no [513689.276171] lowmem_reserve[]: 0 992 992 992 [513689.276176] Node 0 DMA32 free:4296kB min:4008kB low:5008kB high:6012kB active:115828kB inactive:850424kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513689.276181] lowmem_reserve[]: 0 0 0 0 [513689.276184] Node 0 DMA: 10*4kB 1*8kB 0*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513689.276194] Node 0 DMA32: 890*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4256kB [513689.276204] Swap cache: add 21570715, delete 21570070, find 727109/4231837, race 0+265 [513689.276205] Free swap = 3890280kB [513689.276207] Total swap = 3903752kB [513689.276208] Free swap: 3890280kB [513689.281267] 261736 pages of RAM [513689.281270] 5031 reserved pages [513689.281271] 14751 pages shared [513689.281273] 648 pages swap cached [513689.281280] jfsCommit: page allocation failure. order:1, mode:0x4020 [513689.281283] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513689.281284] [513689.281285] Call Trace: [513689.281286] [] __alloc_pages+0x2fd/0x3d0 [513689.281300] [] new_slab+0x220/0x260 [513689.281303] [] __slab_alloc+0x2f5/0x410 [513689.281307] [] __netdev_alloc_skb+0x2b/0x50 [513689.281310] [] __netdev_alloc_skb+0x2b/0x50 [513689.281313] [] __kmalloc_node_track_caller+0x121/0x130 [513689.281317] [] __alloc_skb+0x7b/0x160 [513689.281320] [] __netdev_alloc_skb+0x2b/0x50 [513689.281326] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513689.281331] [] :tg3:tg3_poll+0x8a9/0xa60 [513689.281337] [] net_rx_action+0x128/0x230 [513689.281342] [] __do_softirq+0x75/0xe0 [513689.281345] [] call_softirq+0x1c/0x30 [513689.281348] [] do_softirq+0x35/0x90 [513689.281351] [] irq_exit+0x88/0x90 [513689.281353] [] do_IRQ+0x80/0x100 [513689.281356] [] ret_from_intr+0x0/0xa [513689.281358] [] :jfs:release_metapage+0x80/0x160 [513689.281374] [] :jfs:dbUpdatePMap+0x361/0x480 [513689.281383] [] :jfs:txAllocPMap+0xdd/0x120 [513689.281390] [] :jfs:txUpdateMap+0x1ae/0x270 [513689.281393] [] __wake_up+0x43/0x70 [513689.281400] [] :jfs:jfs_lazycommit+0x120/0x270 [513689.281404] [] default_wake_function+0x0/0x10 [513689.281411] [] :jfs:jfs_lazycommit+0x0/0x270 [513689.281414] [] kthread+0x4b/0x80 [513689.281417] [] child_rip+0xa/0x12 [513689.281421] [] kthread+0x0/0x80 [513689.281423] [] child_rip+0x0/0x12 [513689.281425] [513689.281427] Mem-info: [513689.281428] Node 0 DMA per-cpu: [513689.281431] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.281434] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.281436] Node 0 DMA32 per-cpu: [513689.281439] CPU 0: Hot: hi: 186, btch: 31 usd: 74 Cold: hi: 62, btch: 15 usd: 50 [513689.281441] CPU 1: Hot: hi: 186, btch: 31 usd: 174 Cold: hi: 62, btch: 15 usd: 56 [513689.281444] Active:28997 inactive:214247 dirty:13606 writeback:21 unstable:0 [513689.281445] free:2070 slab:5230 mapped:2099 pagetables:606 bounce:0 [513689.281447] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:160kB inactive:6564kB present:10484kB pages_scanned:32 all_unreclaimable? no [513689.281451] lowmem_reserve[]: 0 992 992 992 [513689.281456] Node 0 DMA32 free:4296kB min:4008kB low:5008kB high:6012kB active:115828kB inactive:850424kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513689.281460] lowmem_reserve[]: 0 0 0 0 [513689.281464] Node 0 DMA: 10*4kB 1*8kB 0*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513689.281475] Node 0 DMA32: 890*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4256kB [513689.281486] Swap cache: add 21570715, delete 21570070, find 727109/4231837, race 0+265 [513689.281488] Free swap = 3890280kB [513689.281489] Total swap = 3903752kB [513689.281491] Free swap: 3890280kB [513689.286320] 261736 pages of RAM [513689.286324] 5031 reserved pages [513689.286325] 14747 pages shared [513689.286326] 648 pages swap cached [513689.286336] jfsCommit: page allocation failure. order:1, mode:0x4020 [513689.286339] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513689.286340] [513689.286341] Call Trace: [513689.286342] [] __alloc_pages+0x2fd/0x3d0 [513689.286354] [] hrtimer_interrupt+0x17b/0x1d0 [513689.286359] [] new_slab+0x220/0x260 [513689.286362] [] __slab_alloc+0x2f5/0x410 [513689.286366] [] __netdev_alloc_skb+0x2b/0x50 [513689.286369] [] __netdev_alloc_skb+0x2b/0x50 [513689.286372] [] __kmalloc_node_track_caller+0x121/0x130 [513689.286375] [] __alloc_skb+0x7b/0x160 [513689.286378] [] __netdev_alloc_skb+0x2b/0x50 [513689.286384] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513689.286390] [] :tg3:tg3_poll+0x8a9/0xa60 [513689.286395] [] net_rx_action+0x128/0x230 [513689.286400] [] __do_softirq+0x75/0xe0 [513689.286404] [] call_softirq+0x1c/0x30 [513689.286406] [] do_softirq+0x35/0x90 [513689.286409] [] irq_exit+0x88/0x90 [513689.286411] [] do_IRQ+0x80/0x100 [513689.286414] [] ret_from_intr+0x0/0xa [513689.286416] [] :jfs:release_metapage+0x80/0x160 [513689.286432] [] :jfs:dbUpdatePMap+0x361/0x480 [513689.286441] [] :jfs:txAllocPMap+0xdd/0x120 [513689.286448] [] :jfs:txUpdateMap+0x1ae/0x270 [513689.286451] [] __wake_up+0x43/0x70 [513689.286459] [] :jfs:jfs_lazycommit+0x120/0x270 [513689.286462] [] default_wake_function+0x0/0x10 [513689.286469] [] :jfs:jfs_lazycommit+0x0/0x270 [513689.286472] [] kthread+0x4b/0x80 [513689.286474] [] child_rip+0xa/0x12 [513689.286479] [] kthread+0x0/0x80 [513689.286481] [] child_rip+0x0/0x12 [513689.286483] [513689.286485] Mem-info: [513689.286486] Node 0 DMA per-cpu: [513689.286490] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.286492] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.286494] Node 0 DMA32 per-cpu: [513689.286497] CPU 0: Hot: hi: 186, btch: 31 usd: 74 Cold: hi: 62, btch: 15 usd: 50 [513689.286499] CPU 1: Hot: hi: 186, btch: 31 usd: 170 Cold: hi: 62, btch: 15 usd: 56 [513689.286502] Active:28997 inactive:214247 dirty:13606 writeback:21 unstable:0 [513689.286503] free:2070 slab:5230 mapped:2099 pagetables:606 bounce:0 [513689.286505] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:160kB inactive:6564kB present:10484kB pages_scanned:32 all_unreclaimable? no [513689.286509] lowmem_reserve[]: 0 992 992 992 [513689.286513] Node 0 DMA32 free:4296kB min:4008kB low:5008kB high:6012kB active:115828kB inactive:850424kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513689.286518] lowmem_reserve[]: 0 0 0 0 [513689.286521] Node 0 DMA: 10*4kB 1*8kB 0*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513689.286532] Node 0 DMA32: 890*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4256kB [513689.286543] Swap cache: add 21570715, delete 21570070, find 727109/4231837, race 0+265 [513689.286545] Free swap = 3890280kB [513689.286546] Total swap = 3903752kB [513689.286548] Free swap: 3890280kB [513689.291408] 261736 pages of RAM [513689.291413] 5031 reserved pages [513689.291413] 14751 pages shared [513689.291414] 648 pages swap cached [513689.315809] jfsCommit: page allocation failure. order:1, mode:0x4020 [513689.315815] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513689.315819] [513689.315819] Call Trace: [513689.315821] [] __alloc_pages+0x2fd/0x3d0 [513689.315842] [] new_slab+0x220/0x260 [513689.315846] [] __slab_alloc+0x2f5/0x410 [513689.315849] [] __netdev_alloc_skb+0x2b/0x50 [513689.315853] [] __netdev_alloc_skb+0x2b/0x50 [513689.315855] [] __kmalloc_node_track_caller+0x121/0x130 [513689.315859] [] __alloc_skb+0x7b/0x160 [513689.315863] [] __netdev_alloc_skb+0x2b/0x50 [513689.315870] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513689.315875] [] :tg3:tg3_poll+0x8a9/0xa60 [513689.315881] [] net_rx_action+0x128/0x230 [513689.315886] [] __do_softirq+0x75/0xe0 [513689.315895] [] :jfs:metapage_readpage+0x0/0x180 [513689.315898] [] call_softirq+0x1c/0x30 [513689.315901] [] do_softirq+0x35/0x90 [513689.315904] [] irq_exit+0x88/0x90 [513689.315906] [] do_IRQ+0x80/0x100 [513689.315909] [] ret_from_intr+0x0/0xa [513689.315911] [] find_get_page+0x52/0x70 [513689.315919] [] read_cache_page_async+0x46/0x140 [513689.315922] [] read_cache_page+0x6/0x40 [513689.315929] [] :jfs:__get_metapage+0xb0/0x460 [513689.315933] [] __wake_up+0x43/0x70 [513689.315936] [] set_page_dirty+0x33/0x90 [513689.315943] [] :jfs:dbUpdatePMap+0x381/0x480 [513689.315952] [] :jfs:txAllocPMap+0xdd/0x120 [513689.315959] [] :jfs:txUpdateMap+0x1ae/0x270 [513689.315962] [] __wake_up+0x43/0x70 [513689.315969] [] :jfs:jfs_lazycommit+0x120/0x270 [513689.315972] [] default_wake_function+0x0/0x10 [513689.315979] [] :jfs:jfs_lazycommit+0x0/0x270 [513689.315982] [] kthread+0x4b/0x80 [513689.315985] [] child_rip+0xa/0x12 [513689.315989] [] kthread+0x0/0x80 [513689.315991] [] child_rip+0x0/0x12 [513689.315993] [513689.315995] Mem-info: [513689.315997] Node 0 DMA per-cpu: [513689.316000] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.316002] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.316004] Node 0 DMA32 per-cpu: [513689.316007] CPU 0: Hot: hi: 186, btch: 31 usd: 75 Cold: hi: 62, btch: 15 usd: 50 [513689.316009] CPU 1: Hot: hi: 186, btch: 31 usd: 164 Cold: hi: 62, btch: 15 usd: 56 [513689.316012] Active:28997 inactive:214272 dirty:13581 writeback:21 unstable:0 [513689.316013] free:2070 slab:5230 mapped:2099 pagetables:606 bounce:0 [513689.316015] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:160kB inactive:6564kB present:10484kB pages_scanned:32 all_unreclaimable? no [513689.316019] lowmem_reserve[]: 0 992 992 992 [513689.316024] Node 0 DMA32 free:4296kB min:4008kB low:5008kB high:6012kB active:115828kB inactive:850524kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513689.316028] lowmem_reserve[]: 0 0 0 0 [513689.316032] Node 0 DMA: 10*4kB 1*8kB 0*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513689.316043] Node 0 DMA32: 890*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4256kB [513689.316055] Swap cache: add 21570715, delete 21570070, find 727109/4231837, race 0+265 [513689.316057] Free swap = 3890280kB [513689.316058] Total swap = 3903752kB [513689.316060] Free swap: 3890280kB [513689.321141] 261736 pages of RAM [513689.321144] 5031 reserved pages [513689.321145] 14741 pages shared [513689.321146] 648 pages swap cached [513689.585712] jfsCommit: page allocation failure. order:1, mode:0x4020 [513689.585718] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513689.585719] [513689.585720] Call Trace: [513689.585721] [] __alloc_pages+0x2fd/0x3d0 [513689.585748] [] new_slab+0x220/0x260 [513689.585751] [] __slab_alloc+0x2f5/0x410 [513689.585755] [] __netdev_alloc_skb+0x2b/0x50 [513689.585758] [] __netdev_alloc_skb+0x2b/0x50 [513689.585761] [] __kmalloc_node_track_caller+0x121/0x130 [513689.585765] [] __alloc_skb+0x7b/0x160 [513689.585768] [] __netdev_alloc_skb+0x2b/0x50 [513689.585775] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513689.585780] [] :tg3:tg3_poll+0x8a9/0xa60 [513689.585786] [] net_rx_action+0x128/0x230 [513689.585791] [] __do_softirq+0x75/0xe0 [513689.585795] [] call_softirq+0x1c/0x30 [513689.585798] [] do_softirq+0x35/0x90 [513689.585800] [] irq_exit+0x88/0x90 [513689.585802] [] do_IRQ+0x80/0x100 [513689.585805] [] ret_from_intr+0x0/0xa [513689.585807] [] _spin_unlock_irqrestore+0x8/0x10 [513689.585821] [] :jfs:dbUpdatePMap+0x2a3/0x480 [513689.585830] [] :jfs:txAllocPMap+0xdd/0x120 [513689.585837] [] :jfs:txUpdateMap+0x1ae/0x270 [513689.585841] [] __wake_up+0x43/0x70 [513689.585848] [] :jfs:jfs_lazycommit+0x120/0x270 [513689.585851] [] default_wake_function+0x0/0x10 [513689.585858] [] :jfs:jfs_lazycommit+0x0/0x270 [513689.585861] [] kthread+0x4b/0x80 [513689.585864] [] child_rip+0xa/0x12 [513689.585868] [] kthread+0x0/0x80 [513689.585870] [] child_rip+0x0/0x12 [513689.585872] [513689.585874] Mem-info: [513689.585876] Node 0 DMA per-cpu: [513689.585879] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.585881] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513689.585883] Node 0 DMA32 per-cpu: [513689.585886] CPU 0: Hot: hi: 186, btch: 31 usd: 75 Cold: hi: 62, btch: 15 usd: 50 [513689.585888] CPU 1: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 56 [513689.585892] Active:28997 inactive:214272 dirty:13581 writeback:21 unstable:0 [513689.585893] free:2070 slab:5230 mapped:2099 pagetables:606 bounce:0 [513689.585894] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:160kB inactive:6564kB present:10484kB pages_scanned:32 all_unreclaimable? no [513689.585899] lowmem_reserve[]: 0 992 992 992 [513689.585903] Node 0 DMA32 free:4296kB min:4008kB low:5008kB high:6012kB active:115828kB inactive:850524kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513689.585907] lowmem_reserve[]: 0 0 0 0 [513689.585911] Node 0 DMA: 10*4kB 1*8kB 0*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513689.585923] Node 0 DMA32: 890*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4256kB [513689.585934] Swap cache: add 21570715, delete 21570070, find 727109/4231837, race 0+265 [513689.585936] Free swap = 3890280kB [513689.585938] Total swap = 3903752kB [513689.585939] Free swap: 3890280kB [513689.591015] 261736 pages of RAM [513689.591018] 5031 reserved pages [513689.591019] 14745 pages shared [513689.591020] 648 pages swap cached [513690.244442] jfsCommit: page allocation failure. order:1, mode:0x4020 [513690.244448] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513690.244451] [513690.244452] Call Trace: [513690.244453] [] __alloc_pages+0x2fd/0x3d0 [513690.244479] [] new_slab+0x220/0x260 [513690.244482] [] __slab_alloc+0x2f5/0x410 [513690.244486] [] __netdev_alloc_skb+0x2b/0x50 [513690.244489] [] __netdev_alloc_skb+0x2b/0x50 [513690.244492] [] __kmalloc_node_track_caller+0x121/0x130 [513690.244496] [] __alloc_skb+0x7b/0x160 [513690.244499] [] __netdev_alloc_skb+0x2b/0x50 [513690.244506] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513690.244511] [] :tg3:tg3_poll+0x8a9/0xa60 [513690.244517] [] net_rx_action+0x128/0x230 [513690.244522] [] __do_softirq+0x75/0xe0 [513690.244526] [] call_softirq+0x1c/0x30 [513690.244529] [] do_softirq+0x35/0x90 [513690.244531] [] irq_exit+0x88/0x90 [513690.244534] [] do_IRQ+0x80/0x100 [513690.244537] [] ret_from_intr+0x0/0xa [513690.244538] [] :jfs:dbUpdatePMap+0x2f4/0x480 [513690.244557] [] :jfs:txAllocPMap+0xdd/0x120 [513690.244564] [] :jfs:txUpdateMap+0x1ae/0x270 [513690.244568] [] __wake_up+0x43/0x70 [513690.244575] [] :jfs:jfs_lazycommit+0x120/0x270 [513690.244578] [] default_wake_function+0x0/0x10 [513690.244585] [] :jfs:jfs_lazycommit+0x0/0x270 [513690.244589] [] kthread+0x4b/0x80 [513690.244592] [] child_rip+0xa/0x12 [513690.244596] [] kthread+0x0/0x80 [513690.244598] [] child_rip+0x0/0x12 [513690.244600] [513690.244601] Mem-info: [513690.244602] Node 0 DMA per-cpu: [513690.244606] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513690.244608] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513690.244610] Node 0 DMA32 per-cpu: [513690.244613] CPU 0: Hot: hi: 186, btch: 31 usd: 89 Cold: hi: 62, btch: 15 usd: 50 [513690.244615] CPU 1: Hot: hi: 186, btch: 31 usd: 166 Cold: hi: 62, btch: 15 usd: 56 [513690.244618] Active:29005 inactive:214277 dirty:13595 writeback:13 unstable:0 [513690.244620] free:2021 slab:5234 mapped:2099 pagetables:606 bounce:0 [513690.244621] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:160kB inactive:6564kB present:10484kB pages_scanned:32 all_unreclaimable? no [513690.244626] lowmem_reserve[]: 0 992 992 992 [513690.244630] Node 0 DMA32 free:4100kB min:4008kB low:5008kB high:6012kB active:115860kB inactive:850544kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513690.244635] lowmem_reserve[]: 0 0 0 0 [513690.244639] Node 0 DMA: 10*4kB 1*8kB 0*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513690.244650] Node 0 DMA32: 859*4kB 1*8kB 1*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4100kB [513690.244661] Swap cache: add 21570718, delete 21570070, find 727109/4231840, race 0+265 [513690.244663] Free swap = 3890280kB [513690.244664] Total swap = 3903752kB [513690.244666] Free swap: 3890280kB [513690.249760] 261736 pages of RAM [513690.249763] 5031 reserved pages [513690.249764] 14743 pages shared [513690.249766] 651 pages swap cached [513690.249773] jfsCommit: page allocation failure. order:1, mode:0x4020 [513690.249776] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513690.249777] [513690.249778] Call Trace: [513690.249780] [] __alloc_pages+0x2fd/0x3d0 [513690.249794] [] new_slab+0x220/0x260 [513690.249797] [] __slab_alloc+0x2f5/0x410 [513690.249801] [] __netdev_alloc_skb+0x2b/0x50 [513690.249804] [] __netdev_alloc_skb+0x2b/0x50 [513690.249807] [] __kmalloc_node_track_caller+0x121/0x130 [513690.249811] [] __alloc_skb+0x7b/0x160 [513690.249814] [] __netdev_alloc_skb+0x2b/0x50 [513690.249820] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513690.249825] [] :tg3:tg3_poll+0x8a9/0xa60 [513690.249831] [] net_rx_action+0x128/0x230 [513690.249835] [] __do_softirq+0x75/0xe0 [513690.249839] [] call_softirq+0x1c/0x30 [513690.249842] [] do_softirq+0x35/0x90 [513690.249844] [] irq_exit+0x88/0x90 [513690.249847] [] do_IRQ+0x80/0x100 [513690.249850] [] ret_from_intr+0x0/0xa [513690.249851] [] :jfs:dbUpdatePMap+0x2f4/0x480 [513690.249869] [] :jfs:txAllocPMap+0xdd/0x120 [513690.249876] [] :jfs:txUpdateMap+0x1ae/0x270 [513690.249880] [] __wake_up+0x43/0x70 [513690.249887] [] :jfs:jfs_lazycommit+0x120/0x270 [513690.249890] [] default_wake_function+0x0/0x10 [513690.249897] [] :jfs:jfs_lazycommit+0x0/0x270 [513690.249900] [] kthread+0x4b/0x80 [513690.249903] [] child_rip+0xa/0x12 [513690.249907] [] kthread+0x0/0x80 [513690.249910] [] child_rip+0x0/0x12 [513690.249912] [513690.249913] Mem-info: [513690.249914] Node 0 DMA per-cpu: [513690.249918] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513690.249920] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513690.249922] Node 0 DMA32 per-cpu: [513690.249925] CPU 0: Hot: hi: 186, btch: 31 usd: 89 Cold: hi: 62, btch: 15 usd: 50 [513690.249927] CPU 1: Hot: hi: 186, btch: 31 usd: 162 Cold: hi: 62, btch: 15 usd: 56 [513690.249930] Active:29005 inactive:214277 dirty:13595 writeback:13 unstable:0 [513690.249931] free:2021 slab:5234 mapped:2099 pagetables:606 bounce:0 [513690.249933] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:160kB inactive:6564kB present:10484kB pages_scanned:32 all_unreclaimable? no [513690.249937] lowmem_reserve[]: 0 992 992 992 [513690.249942] Node 0 DMA32 free:4100kB min:4008kB low:5008kB high:6012kB active:115860kB inactive:850544kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513690.249946] lowmem_reserve[]: 0 0 0 0 [513690.249950] Node 0 DMA: 10*4kB 1*8kB 0*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513690.249961] Node 0 DMA32: 859*4kB 1*8kB 1*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4100kB [513690.249971] Swap cache: add 21570718, delete 21570070, find 727109/4231840, race 0+265 [513690.249973] Free swap = 3890280kB [513690.249974] Total swap = 3903752kB [513690.249976] Free swap: 3890280kB [513690.254801] 261736 pages of RAM [513690.254804] 5031 reserved pages [513690.254805] 14746 pages shared [513690.254806] 651 pages swap cached [513694.138072] printk: 5 messages suppressed. [513694.138078] jfsCommit: page allocation failure. order:1, mode:0x4020 [513694.138081] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513694.138084] [513694.138085] Call Trace: [513694.138086] [] __alloc_pages+0x2fd/0x3d0 [513694.138115] [] new_slab+0x220/0x260 [513694.138119] [] __slab_alloc+0x2f5/0x410 [513694.138123] [] __netdev_alloc_skb+0x2b/0x50 [513694.138126] [] __netdev_alloc_skb+0x2b/0x50 [513694.138129] [] __kmalloc_node_track_caller+0x121/0x130 [513694.138133] [] __alloc_skb+0x7b/0x160 [513694.138136] [] __netdev_alloc_skb+0x2b/0x50 [513694.138144] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513694.138149] [] :tg3:tg3_poll+0x8a9/0xa60 [513694.138156] [] net_rx_action+0x128/0x230 [513694.138162] [] :ipmi_si:smi_event_handler+0x81/0x4b0 [513694.138167] [] __do_softirq+0x75/0xe0 [513694.138171] [] call_softirq+0x1c/0x30 [513694.138175] [] do_softirq+0x35/0x90 [513694.138177] [] irq_exit+0x88/0x90 [513694.138180] [] do_IRQ+0x80/0x100 [513694.138182] [] ret_from_intr+0x0/0xa [513694.138184] [] __wake_up+0x0/0x70 [513694.138198] [] :jfs:release_metapage+0x45/0x160 [513694.138205] [] :jfs:dbUpdatePMap+0x361/0x480 [513694.138214] [] :jfs:txAllocPMap+0xdd/0x120 [513694.138222] [] :jfs:txUpdateMap+0x1ae/0x270 [513694.138225] [] __wake_up+0x43/0x70 [513694.138233] [] :jfs:jfs_lazycommit+0x120/0x270 [513694.138236] [] default_wake_function+0x0/0x10 [513694.138244] [] :jfs:jfs_lazycommit+0x0/0x270 [513694.138247] [] kthread+0x4b/0x80 [513694.138251] [] child_rip+0xa/0x12 [513694.138255] [] kthread+0x0/0x80 [513694.138258] [] child_rip+0x0/0x12 [513694.138260] [513694.138262] Mem-info: [513694.138264] Node 0 DMA per-cpu: [513694.138268] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513694.138271] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513694.138273] Node 0 DMA32 per-cpu: [513694.138276] CPU 0: Hot: hi: 186, btch: 31 usd: 92 Cold: hi: 62, btch: 15 usd: 50 [513694.138279] CPU 1: Hot: hi: 186, btch: 31 usd: 153 Cold: hi: 62, btch: 15 usd: 56 [513694.138282] Active:29008 inactive:214251 dirty:13603 writeback:13 unstable:0 [513694.138283] free:2021 slab:5234 mapped:2099 pagetables:606 bounce:0 [513694.138284] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:160kB inactive:6564kB present:10484kB pages_scanned:32 all_unreclaimable? no [513694.138289] lowmem_reserve[]: 0 992 992 992 [513694.138293] Node 0 DMA32 free:4100kB min:4008kB low:5008kB high:6012kB active:115872kB inactive:850440kB present:1016472kB pages_scanned:69 all_unreclaimable? no [513694.138298] lowmem_reserve[]: 0 0 0 0 [513694.138301] Node 0 DMA: 10*4kB 1*8kB 0*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513694.138313] Node 0 DMA32: 859*4kB 1*8kB 1*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4100kB [513694.138324] Swap cache: add 21570718, delete 21570070, find 727109/4231840, race 0+265 [513694.138325] Free swap = 3890280kB [513694.138327] Total swap = 3903752kB [513694.138329] Free swap: 3890280kB [513694.143435] 261736 pages of RAM [513694.143439] 5031 reserved pages [513694.143440] 14770 pages shared [513694.143441] 651 pages swap cached [513723.184090] jfsCommit: page allocation failure. order:1, mode:0x4020 [513723.184097] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513723.184099] [513723.184100] Call Trace: [513723.184102] [] __alloc_pages+0x2fd/0x3d0 [513723.184140] [] new_slab+0x220/0x260 [513723.184144] [] __slab_alloc+0x2f5/0x410 [513723.184148] [] __netdev_alloc_skb+0x2b/0x50 [513723.184151] [] __netdev_alloc_skb+0x2b/0x50 [513723.184154] [] __kmalloc_node_track_caller+0x121/0x130 [513723.184158] [] __alloc_skb+0x7b/0x160 [513723.184161] [] __netdev_alloc_skb+0x2b/0x50 [513723.184170] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513723.184175] [] :tg3:tg3_poll+0x8a9/0xa60 [513723.184181] [] net_rx_action+0x128/0x230 [513723.184186] [] __do_softirq+0x75/0xe0 [513723.184190] [] call_softirq+0x1c/0x30 [513723.184193] [] do_softirq+0x35/0x90 [513723.184196] [] irq_exit+0x88/0x90 [513723.184198] [] do_IRQ+0x80/0x100 [513723.184201] [] ret_from_intr+0x0/0xa [513723.184203] [] :jfs:dbUpdatePMap+0x2a3/0x480 [513723.184223] [] :jfs:txAllocPMap+0xdd/0x120 [513723.184230] [] :jfs:txUpdateMap+0x1ae/0x270 [513723.184234] [] __wake_up+0x43/0x70 [513723.184241] [] :jfs:jfs_lazycommit+0x120/0x270 [513723.184244] [] default_wake_function+0x0/0x10 [513723.184251] [] :jfs:jfs_lazycommit+0x0/0x270 [513723.184255] [] kthread+0x4b/0x80 [513723.184257] [] child_rip+0xa/0x12 [513723.184261] [] kthread+0x0/0x80 [513723.184264] [] child_rip+0x0/0x12 [513723.184266] [513723.184267] Mem-info: [513723.184269] Node 0 DMA per-cpu: [513723.184271] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513723.184274] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513723.184276] Node 0 DMA32 per-cpu: [513723.184279] CPU 0: Hot: hi: 186, btch: 31 usd: 106 Cold: hi: 62, btch: 15 usd: 53 [513723.184281] CPU 1: Hot: hi: 186, btch: 31 usd: 118 Cold: hi: 62, btch: 15 usd: 48 [513723.184284] Active:29001 inactive:214325 dirty:12647 writeback:0 unstable:0 [513723.184285] free:1955 slab:5242 mapped:2099 pagetables:606 bounce:0 [513723.184287] Node 0 DMA free:3976kB min:40kB low:48kB high:60kB active:156kB inactive:6588kB present:10484kB pages_scanned:0 all_unreclaimable? no [513723.184292] lowmem_reserve[]: 0 992 992 992 [513723.184296] Node 0 DMA32 free:3844kB min:4008kB low:5008kB high:6012kB active:115848kB inactive:850712kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513723.184301] lowmem_reserve[]: 0 0 0 0 [513723.184305] Node 0 DMA: 0*4kB 3*8kB 1*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB [513723.184314] Node 0 DMA32: 777*4kB 0*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3908kB [513723.184323] Swap cache: add 21570722, delete 21570111, find 727109/4231842, race 0+265 [513723.184325] Free swap = 3890280kB [513723.184326] Total swap = 3903752kB [513723.184328] Free swap: 3890280kB [513723.189683] 261736 pages of RAM [513723.189686] 5031 reserved pages [513723.189687] 14594 pages shared [513723.189688] 614 pages swap cached [513723.623437] jfsCommit: page allocation failure. order:1, mode:0x4020 [513723.623442] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513723.623445] [513723.623446] Call Trace: [513723.623447] [] __alloc_pages+0x2fd/0x3d0 [513723.623472] [] new_slab+0x220/0x260 [513723.623476] [] __slab_alloc+0x2f5/0x410 [513723.623480] [] __netdev_alloc_skb+0x2b/0x50 [513723.623483] [] __netdev_alloc_skb+0x2b/0x50 [513723.623486] [] __kmalloc_node_track_caller+0x121/0x130 [513723.623489] [] __alloc_skb+0x7b/0x160 [513723.623493] [] __netdev_alloc_skb+0x2b/0x50 [513723.623500] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513723.623505] [] :tg3:tg3_poll+0x8a9/0xa60 [513723.623512] [] net_rx_action+0x128/0x230 [513723.623516] [] __do_softirq+0x75/0xe0 [513723.623520] [] call_softirq+0x1c/0x30 [513723.623523] [] do_softirq+0x35/0x90 [513723.623526] [] irq_exit+0x88/0x90 [513723.623528] [] do_IRQ+0x80/0x100 [513723.623531] [] ret_from_intr+0x0/0xa [513723.623533] [] _spin_unlock_irqrestore+0x8/0x10 [513723.623547] [] :jfs:release_metapage+0x45/0x160 [513723.623554] [] :jfs:dbUpdatePMap+0x361/0x480 [513723.623563] [] :jfs:txAllocPMap+0xdd/0x120 [513723.623570] [] :jfs:txUpdateMap+0x1ae/0x270 [513723.623574] [] __wake_up+0x43/0x70 [513723.623581] [] :jfs:jfs_lazycommit+0x120/0x270 [513723.623584] [] default_wake_function+0x0/0x10 [513723.623591] [] :jfs:jfs_lazycommit+0x0/0x270 [513723.623594] [] kthread+0x4b/0x80 [513723.623597] [] child_rip+0xa/0x12 [513723.623601] [] kthread+0x0/0x80 [513723.623604] [] child_rip+0x0/0x12 [513723.623606] [513723.623607] Mem-info: [513723.623608] Node 0 DMA per-cpu: [513723.623611] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513723.623614] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513723.623616] Node 0 DMA32 per-cpu: [513723.623619] CPU 0: Hot: hi: 186, btch: 31 usd: 104 Cold: hi: 62, btch: 15 usd: 53 [513723.623621] CPU 1: Hot: hi: 186, btch: 31 usd: 112 Cold: hi: 62, btch: 15 usd: 52 [513723.623624] Active:29005 inactive:214261 dirty:12647 writeback:0 unstable:0 [513723.623625] free:1986 slab:5276 mapped:2099 pagetables:606 bounce:0 [513723.623627] Node 0 DMA free:3976kB min:40kB low:48kB high:60kB active:156kB inactive:6588kB present:10484kB pages_scanned:0 all_unreclaimable? no [513723.623631] lowmem_reserve[]: 0 992 992 992 [513723.623636] Node 0 DMA32 free:3968kB min:4008kB low:5008kB high:6012kB active:115864kB inactive:850456kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513723.623640] lowmem_reserve[]: 0 0 0 0 [513723.623642] Node 0 DMA: 0*4kB 3*8kB 1*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB [513723.623652] Node 0 DMA32: 813*4kB 0*8kB 1*16kB 1*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4004kB [513723.623662] Swap cache: add 21570722, delete 21570111, find 727109/4231842, race 0+265 [513723.623664] Free swap = 3890280kB [513723.623665] Total swap = 3903752kB [513723.623667] Free swap: 3890280kB [513723.628775] 261736 pages of RAM [513723.628778] 5031 reserved pages [513723.628779] 14595 pages shared [513723.628781] 614 pages swap cached [513724.262414] jfsCommit: page allocation failure. order:1, mode:0x4020 [513724.262420] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513724.262423] [513724.262423] Call Trace: [513724.262425] [] __alloc_pages+0x2fd/0x3d0 [513724.262452] [] new_slab+0x220/0x260 [513724.262455] [] __slab_alloc+0x2f5/0x410 [513724.262459] [] __netdev_alloc_skb+0x2b/0x50 [513724.262462] [] __netdev_alloc_skb+0x2b/0x50 [513724.262465] [] __kmalloc_node_track_caller+0x121/0x130 [513724.262469] [] __alloc_skb+0x7b/0x160 [513724.262472] [] __netdev_alloc_skb+0x2b/0x50 [513724.262479] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513724.262485] [] :tg3:tg3_poll+0x8a9/0xa60 [513724.262491] [] net_rx_action+0x128/0x230 [513724.262495] [] __do_softirq+0x75/0xe0 [513724.262499] [] call_softirq+0x1c/0x30 [513724.262502] [] do_softirq+0x35/0x90 [513724.262505] [] irq_exit+0x88/0x90 [513724.262507] [] do_IRQ+0x80/0x100 [513724.262510] [] ret_from_intr+0x0/0xa [513724.262512] [] :jfs:release_metapage+0x30/0x160 [513724.262528] [] :jfs:dbUpdatePMap+0x361/0x480 [513724.262537] [] :jfs:txAllocPMap+0xdd/0x120 [513724.262544] [] :jfs:txUpdateMap+0x1ae/0x270 [513724.262548] [] __wake_up+0x43/0x70 [513724.262555] [] :jfs:jfs_lazycommit+0x120/0x270 [513724.262558] [] default_wake_function+0x0/0x10 [513724.262565] [] :jfs:jfs_lazycommit+0x0/0x270 [513724.262569] [] kthread+0x4b/0x80 [513724.262572] [] child_rip+0xa/0x12 [513724.262576] [] kthread+0x0/0x80 [513724.262578] [] child_rip+0x0/0x12 [513724.262580] [513724.262581] Mem-info: [513724.262583] Node 0 DMA per-cpu: [513724.262585] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513724.262588] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513724.262590] Node 0 DMA32 per-cpu: [513724.262592] CPU 0: Hot: hi: 186, btch: 31 usd: 99 Cold: hi: 62, btch: 15 usd: 53 [513724.262595] CPU 1: Hot: hi: 186, btch: 31 usd: 108 Cold: hi: 62, btch: 15 usd: 56 [513724.262598] Active:29005 inactive:214202 dirty:12662 writeback:0 unstable:0 [513724.262599] free:2019 slab:5329 mapped:2099 pagetables:606 bounce:0 [513724.262601] Node 0 DMA free:3976kB min:40kB low:48kB high:60kB active:156kB inactive:6588kB present:10484kB pages_scanned:0 all_unreclaimable? no [513724.262605] lowmem_reserve[]: 0 992 992 992 [513724.262610] Node 0 DMA32 free:4100kB min:4008kB low:5008kB high:6012kB active:115864kB inactive:850220kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513724.262614] lowmem_reserve[]: 0 0 0 0 [513724.262618] Node 0 DMA: 0*4kB 3*8kB 1*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB [513724.262629] Node 0 DMA32: 851*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4100kB [513724.262640] Swap cache: add 21570722, delete 21570111, find 727109/4231842, race 0+265 [513724.262642] Free swap = 3890280kB [513724.262643] Total swap = 3903752kB [513724.262645] Free swap: 3890280kB [513724.267729] 261736 pages of RAM [513724.267732] 5031 reserved pages [513724.267733] 14596 pages shared [513724.267734] 614 pages swap cached [513724.267747] jfsCommit: page allocation failure. order:1, mode:0x4020 [513724.267750] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513724.267752] [513724.267753] Call Trace: [513724.267754] [] __alloc_pages+0x2fd/0x3d0 [513724.267769] [] new_slab+0x220/0x260 [513724.267772] [] __slab_alloc+0x2f5/0x410 [513724.267776] [] __netdev_alloc_skb+0x2b/0x50 [513724.267780] [] __netdev_alloc_skb+0x2b/0x50 [513724.267782] [] __kmalloc_node_track_caller+0x121/0x130 [513724.267786] [] __alloc_skb+0x7b/0x160 [513724.267789] [] __netdev_alloc_skb+0x2b/0x50 [513724.267795] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513724.267800] [] :tg3:tg3_poll+0x8a9/0xa60 [513724.267806] [] net_rx_action+0x128/0x230 [513724.267811] [] __do_softirq+0x75/0xe0 [513724.267814] [] call_softirq+0x1c/0x30 [513724.267817] [] do_softirq+0x35/0x90 [513724.267820] [] irq_exit+0x88/0x90 [513724.267822] [] do_IRQ+0x80/0x100 [513724.267825] [] ret_from_intr+0x0/0xa [513724.267827] [] :jfs:release_metapage+0x30/0x160 [513724.267843] [] :jfs:dbUpdatePMap+0x361/0x480 [513724.267852] [] :jfs:txAllocPMap+0xdd/0x120 [513724.267859] [] :jfs:txUpdateMap+0x1ae/0x270 [513724.267862] [] __wake_up+0x43/0x70 [513724.267869] [] :jfs:jfs_lazycommit+0x120/0x270 [513724.267873] [] default_wake_function+0x0/0x10 [513724.267879] [] :jfs:jfs_lazycommit+0x0/0x270 [513724.267883] [] kthread+0x4b/0x80 [513724.267885] [] child_rip+0xa/0x12 [513724.267889] [] kthread+0x0/0x80 [513724.267892] [] child_rip+0x0/0x12 [513724.267894] [513724.267895] Mem-info: [513724.267897] Node 0 DMA per-cpu: [513724.267900] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513724.267902] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513724.267904] Node 0 DMA32 per-cpu: [513724.267907] CPU 0: Hot: hi: 186, btch: 31 usd: 99 Cold: hi: 62, btch: 15 usd: 53 [513724.267909] CPU 1: Hot: hi: 186, btch: 31 usd: 134 Cold: hi: 62, btch: 15 usd: 56 [513724.267912] Active:29005 inactive:214202 dirty:12662 writeback:0 unstable:0 [513724.267913] free:2002 slab:5329 mapped:2099 pagetables:606 bounce:0 [513724.267915] Node 0 DMA free:3976kB min:40kB low:48kB high:60kB active:156kB inactive:6588kB present:10484kB pages_scanned:0 all_unreclaimable? no [513724.267919] lowmem_reserve[]: 0 992 992 992 [513724.267924] Node 0 DMA32 free:4032kB min:4008kB low:5008kB high:6012kB active:115864kB inactive:850220kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513724.267929] lowmem_reserve[]: 0 0 0 0 [513724.267932] Node 0 DMA: 0*4kB 3*8kB 1*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB [513724.267943] Node 0 DMA32: 820*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3976kB [513724.267955] Swap cache: add 21570722, delete 21570111, find 727109/4231842, race 0+265 [513724.267956] Free swap = 3890280kB [513724.267958] Total swap = 3903752kB [513724.267959] Free swap: 3890280kB [513724.272973] 261736 pages of RAM [513724.272977] 5031 reserved pages [513724.272978] 14601 pages shared [513724.272979] 614 pages swap cached [513724.302363] jfsCommit: page allocation failure. order:1, mode:0x4020 [513724.302369] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513724.302372] [513724.302373] Call Trace: [513724.302374] [] __alloc_pages+0x2fd/0x3d0 [513724.302399] [] new_slab+0x220/0x260 [513724.302402] [] __slab_alloc+0x2f5/0x410 [513724.302406] [] __netdev_alloc_skb+0x2b/0x50 [513724.302409] [] __netdev_alloc_skb+0x2b/0x50 [513724.302412] [] __kmalloc_node_track_caller+0x121/0x130 [513724.302416] [] __alloc_skb+0x7b/0x160 [513724.302419] [] __netdev_alloc_skb+0x2b/0x50 [513724.302426] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513724.302432] [] :tg3:tg3_poll+0x8a9/0xa60 [513724.302438] [] net_rx_action+0x128/0x230 [513724.302442] [] __do_softirq+0x75/0xe0 [513724.302446] [] call_softirq+0x1c/0x30 [513724.302449] [] do_softirq+0x35/0x90 [513724.302452] [] irq_exit+0x88/0x90 [513724.302454] [] do_IRQ+0x80/0x100 [513724.302457] [] ret_from_intr+0x0/0xa [513724.302459] [] memset_c+0x20/0x30 [513724.302472] [] :jfs:dbUpdatePMap+0x2f4/0x480 [513724.302481] [] :jfs:txAllocPMap+0xdd/0x120 [513724.302488] [] :jfs:txUpdateMap+0x1ae/0x270 [513724.302492] [] __wake_up+0x43/0x70 [513724.302499] [] :jfs:jfs_lazycommit+0x120/0x270 [513724.302502] [] default_wake_function+0x0/0x10 [513724.302509] [] :jfs:jfs_lazycommit+0x0/0x270 [513724.302512] [] kthread+0x4b/0x80 [513724.302515] [] child_rip+0xa/0x12 [513724.302519] [] kthread+0x0/0x80 [513724.302522] [] child_rip+0x0/0x12 [513724.302524] [513724.302525] Mem-info: [513724.302527] Node 0 DMA per-cpu: [513724.302529] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513724.302532] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513724.302534] Node 0 DMA32 per-cpu: [513724.302537] CPU 0: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 53 [513724.302539] CPU 1: Hot: hi: 186, btch: 31 usd: 132 Cold: hi: 62, btch: 15 usd: 56 [513724.302542] Active:29005 inactive:214202 dirty:12683 writeback:0 unstable:0 [513724.302543] free:1934 slab:5332 mapped:2099 pagetables:606 bounce:0 [513724.302545] Node 0 DMA free:3976kB min:40kB low:48kB high:60kB active:156kB inactive:6588kB present:10484kB pages_scanned:0 all_unreclaimable? no [513724.302550] lowmem_reserve[]: 0 992 992 992 [513724.302554] Node 0 DMA32 free:3760kB min:4008kB low:5008kB high:6012kB active:115864kB inactive:850220kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513724.302559] lowmem_reserve[]: 0 0 0 0 [513724.302563] Node 0 DMA: 0*4kB 3*8kB 1*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB [513724.302573] Node 0 DMA32: 758*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3728kB [513724.302585] Swap cache: add 21570722, delete 21570111, find 727109/4231842, race 0+265 [513724.302587] Free swap = 3890280kB [513724.302588] Total swap = 3903752kB [513724.302590] Free swap: 3890280kB [513724.307606] 261736 pages of RAM [513724.307610] 5031 reserved pages [513724.307611] 14592 pages shared [513724.307612] 614 pages swap cached [513724.307620] jfsCommit: page allocation failure. order:1, mode:0x4020 [513724.307623] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513724.307625] [513724.307625] Call Trace: [513724.307627] [] __alloc_pages+0x2fd/0x3d0 [513724.307641] [] new_slab+0x220/0x260 [513724.307644] [] __slab_alloc+0x2f5/0x410 [513724.307648] [] __netdev_alloc_skb+0x2b/0x50 [513724.307651] [] __netdev_alloc_skb+0x2b/0x50 [513724.307654] [] __kmalloc_node_track_caller+0x121/0x130 [513724.307657] [] __alloc_skb+0x7b/0x160 [513724.307661] [] __netdev_alloc_skb+0x2b/0x50 [513724.307667] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513724.307672] [] :tg3:tg3_poll+0x8a9/0xa60 [513724.307678] [] net_rx_action+0x128/0x230 [513724.307682] [] __do_softirq+0x75/0xe0 [513724.307686] [] call_softirq+0x1c/0x30 [513724.307689] [] do_softirq+0x35/0x90 [513724.307691] [] irq_exit+0x88/0x90 [513724.307694] [] do_IRQ+0x80/0x100 [513724.307697] [] ret_from_intr+0x0/0xa [513724.307699] [] memset_c+0x20/0x30 [513724.307711] [] :jfs:dbUpdatePMap+0x2f4/0x480 [513724.307720] [] :jfs:txAllocPMap+0xdd/0x120 [513724.307727] [] :jfs:txUpdateMap+0x1ae/0x270 [513724.307730] [] __wake_up+0x43/0x70 [513724.307738] [] :jfs:jfs_lazycommit+0x120/0x270 [513724.307741] [] default_wake_function+0x0/0x10 [513724.307747] [] :jfs:jfs_lazycommit+0x0/0x270 [513724.307751] [] kthread+0x4b/0x80 [513724.307753] [] child_rip+0xa/0x12 [513724.307757] [] kthread+0x0/0x80 [513724.307760] [] child_rip+0x0/0x12 [513724.307762] [513724.307763] Mem-info: [513724.307765] Node 0 DMA per-cpu: [513724.307768] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513724.307770] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513724.307772] Node 0 DMA32 per-cpu: [513724.307775] CPU 0: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 53 [513724.307778] CPU 1: Hot: hi: 186, btch: 31 usd: 132 Cold: hi: 62, btch: 15 usd: 60 [513724.307781] Active:29005 inactive:214151 dirty:12683 writeback:0 unstable:0 [513724.307782] free:1985 slab:5332 mapped:2099 pagetables:606 bounce:0 [513724.307784] Node 0 DMA free:3976kB min:40kB low:48kB high:60kB active:156kB inactive:6588kB present:10484kB pages_scanned:0 all_unreclaimable? no [513724.307788] lowmem_reserve[]: 0 992 992 992 [513724.307792] Node 0 DMA32 free:3964kB min:4008kB low:5008kB high:6012kB active:115864kB inactive:850016kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513724.307796] lowmem_reserve[]: 0 0 0 0 [513724.307800] Node 0 DMA: 0*4kB 3*8kB 1*16kB 1*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB [513724.307810] Node 0 DMA32: 814*4kB 3*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3968kB [513724.307821] Swap cache: add 21570722, delete 21570111, find 727109/4231842, race 0+265 [513724.307822] Free swap = 3890280kB [513724.307824] Total swap = 3903752kB [513724.307825] Free swap: 3890280kB [513724.312390] 261736 pages of RAM [513724.312394] 5031 reserved pages [513724.312395] 14592 pages shared [513724.312397] 614 pages swap cached [513886.085087] printk: 12 messages suppressed. [513886.085092] jfsCommit: page allocation failure. order:1, mode:0x4020 [513886.085096] Pid: 2336, comm: jfsCommit Not tainted 2.6.24-19-server #1 [513886.085098] [513886.085099] Call Trace: [513886.085101] [] __alloc_pages+0x2fd/0x3d0 [513886.085135] [] new_slab+0x220/0x260 [513886.085138] [] __slab_alloc+0x2f5/0x410 [513886.085143] [] __netdev_alloc_skb+0x2b/0x50 [513886.085146] [] __netdev_alloc_skb+0x2b/0x50 [513886.085149] [] __kmalloc_node_track_caller+0x121/0x130 [513886.085152] [] __alloc_skb+0x7b/0x160 [513886.085156] [] __netdev_alloc_skb+0x2b/0x50 [513886.085164] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [513886.085170] [] :tg3:tg3_poll+0x8a9/0xa60 [513886.085176] [] net_rx_action+0x128/0x230 [513886.085181] [] __do_softirq+0x75/0xe0 [513886.085185] [] call_softirq+0x1c/0x30 [513886.085188] [] do_softirq+0x35/0x90 [513886.085190] [] irq_exit+0x88/0x90 [513886.085193] [] do_IRQ+0x80/0x100 [513886.085195] [] ret_from_intr+0x0/0xa [513886.085197] [] _spin_unlock_irqrestore+0x8/0x10 [513886.085212] [] :jfs:dbUpdatePMap+0x2a3/0x480 [513886.085221] [] :jfs:txAllocPMap+0xdd/0x120 [513886.085228] [] :jfs:txUpdateMap+0x1ae/0x270 [513886.085232] [] __wake_up+0x43/0x70 [513886.085240] [] :jfs:jfs_lazycommit+0x120/0x270 [513886.085243] [] default_wake_function+0x0/0x10 [513886.085250] [] :jfs:jfs_lazycommit+0x0/0x270 [513886.085253] [] kthread+0x4b/0x80 [513886.085256] [] child_rip+0xa/0x12 [513886.085260] [] kthread+0x0/0x80 [513886.085262] [] child_rip+0x0/0x12 [513886.085264] [513886.085265] Mem-info: [513886.085267] Node 0 DMA per-cpu: [513886.085270] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513886.085272] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [513886.085274] Node 0 DMA32 per-cpu: [513886.085277] CPU 0: Hot: hi: 186, btch: 31 usd: 143 Cold: hi: 62, btch: 15 usd: 60 [513886.085279] CPU 1: Hot: hi: 186, btch: 31 usd: 124 Cold: hi: 62, btch: 15 usd: 53 [513886.085282] Active:28365 inactive:215479 dirty:12508 writeback:0 unstable:0 [513886.085283] free:1708 slab:4977 mapped:2099 pagetables:606 bounce:0 [513886.085285] Node 0 DMA free:3984kB min:40kB low:48kB high:60kB active:156kB inactive:6620kB present:10484kB pages_scanned:0 all_unreclaimable? no [513886.085289] lowmem_reserve[]: 0 992 992 992 [513886.085294] Node 0 DMA32 free:2848kB min:4008kB low:5008kB high:6012kB active:113304kB inactive:855296kB present:1016472kB pages_scanned:0 all_unreclaimable? no [513886.085298] lowmem_reserve[]: 0 0 0 0 [513886.085302] Node 0 DMA: 2*4kB 1*8kB 0*16kB 0*32kB 2*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3984kB [513886.085313] Node 0 DMA32: 527*4kB 1*8kB 1*16kB 1*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 2804kB [513886.085324] Swap cache: add 21570722, delete 21570119, find 727109/4231842, race 0+265 [513886.085326] Free swap = 3890280kB [513886.085327] Total swap = 3903752kB [513886.085329] Free swap: 3890280kB [513886.090484] 261736 pages of RAM [513886.090488] 5031 reserved pages [513886.090489] 14297 pages shared [513886.090490] 606 pages swap cached [514472.587974] jfsCommit: page allocation failure. order:1, mode:0x4020 [514472.587980] Pid: 2336, comm: jfsCommit Not tainted 2.6.24-19-server #1 [514472.587983] [514472.587984] Call Trace: [514472.587986] [] __alloc_pages+0x2fd/0x3d0 [514472.588023] [] new_slab+0x220/0x260 [514472.588026] [] __slab_alloc+0x2f5/0x410 [514472.588030] [] __netdev_alloc_skb+0x2b/0x50 [514472.588034] [] __netdev_alloc_skb+0x2b/0x50 [514472.588037] [] __kmalloc_node_track_caller+0x121/0x130 [514472.588040] [] __alloc_skb+0x7b/0x160 [514472.588044] [] __netdev_alloc_skb+0x2b/0x50 [514472.588052] [] :tg3:tg3_alloc_rx_skb+0xb6/0x190 [514472.588057] [] :tg3:tg3_poll+0x8a9/0xa60 [514472.588063] [] net_rx_action+0x128/0x230 [514472.588068] [] __do_softirq+0x75/0xe0 [514472.588072] [] call_softirq+0x1c/0x30 [514472.588075] [] do_softirq+0x35/0x90 [514472.588077] [] irq_exit+0x88/0x90 [514472.588080] [] do_IRQ+0x80/0x100 [514472.588083] [] ret_from_intr+0x0/0xa [514472.588084] [] _spin_unlock_irqrestore+0x8/0x10 [514472.588100] [] :jfs:release_metapage+0x45/0x160 [514472.588107] [] :jfs:dbUpdatePMap+0x361/0x480 [514472.588116] [] :jfs:txAllocPMap+0xdd/0x120 [514472.588123] [] :jfs:txUpdateMap+0x1ae/0x270 [514472.588127] [] __wake_up+0x43/0x70 [514472.588134] [] :jfs:jfs_lazycommit+0x120/0x270 [514472.588137] [] default_wake_function+0x0/0x10 [514472.588144] [] :jfs:jfs_lazycommit+0x0/0x270 [514472.588148] [] kthread+0x4b/0x80 [514472.588151] [] child_rip+0xa/0x12 [514472.588154] [] kthread+0x0/0x80 [514472.588157] [] child_rip+0x0/0x12 [514472.588159] [514472.588160] Mem-info: [514472.588162] Node 0 DMA per-cpu: [514472.588166] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [514472.588168] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 [514472.588170] Node 0 DMA32 per-cpu: [514472.588173] CPU 0: Hot: hi: 186, btch: 31 usd: 112 Cold: hi: 62, btch: 15 usd: 60 [514472.588176] CPU 1: Hot: hi: 186, btch: 31 usd: 123 Cold: hi: 62, btch: 15 usd: 54 [514472.588179] Active:28480 inactive:214985 dirty:6593 writeback:12 unstable:0 [514472.588180] free:1821 slab:5281 mapped:2099 pagetables:606 bounce:0 [514472.588182] Node 0 DMA free:3980kB min:40kB low:48kB high:60kB active:156kB inactive:6640kB present:10484kB pages_scanned:0 all_unreclaimable? no [514472.588186] lowmem_reserve[]: 0 992 992 992 [514472.588190] Node 0 DMA32 free:3304kB min:4008kB low:5008kB high:6012kB active:113764kB inactive:853300kB present:1016472kB pages_scanned:0 all_unreclaimable? no [514472.588195] lowmem_reserve[]: 0 0 0 0 [514472.588198] Node 0 DMA: 1*4kB 1*8kB 0*16kB 2*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3980kB [514472.588210] Node 0 DMA32: 645*4kB 1*8kB 1*16kB 1*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3340kB [514472.588221] Swap cache: add 21570802, delete 21570146, find 727170/4231930, race 0+265 [514472.588223] Free swap = 3890268kB [514472.588224] Total swap = 3903752kB [514472.588226] Free swap: 3890268kB [514472.593437] 261736 pages of RAM [514472.593441] 5031 reserved pages [514472.593442] 14315 pages shared [514472.593443] 659 pages swap cached [514527.213472] BUG: soft lockup - CPU#0 stuck for 11s! [jfsCommit:2338] [514527.214360] CPU 0: [514527.214361] Modules linked in: iptable_filter ip_tables x_tables 8021q parport_pc lp parport loop ipv6 evdev usbhid hid ipmi_si ipmi_msghandler container ata_piix pata_acpi button psmouse pcspkr serio_raw shpchp pci_hotplug iTCO_wdt iTCO_vendor_support jfs ata_generic ehci_hcd uhci_hcd libata usbcore tg3 cciss scsi_mod dm_mirror dm_snapshot dm_mod thermal processor fan fbcon tileblit font bitblit softcursor fuse [514527.214404] Pid: 2338, comm: jfsCommit Not tainted 2.6.24-19-server #1 [514527.214406] RIP: 0010:[] [] _spin_unlock_irqrestore+0x8/0x10 [514527.214414] RSP: 0018:ffff81003abc3da8 EFLAGS: 00000202 [514527.214416] RAX: 00000000007fcaf0 RBX: 0000000000000100 RCX: 0000000001ae7c10 [514527.214418] RDX: 00000000012eaff8 RSI: 0000000000000202 RDI: ffff81002682f510 [514527.214420] RBP: ffffffff00000000 R08: ffff81000bce3b80 R09: ffff810027e92c00 [514527.214422] R10: 0000000000000000 R11: 0000000000000000 R12: ffff81003f927ff0 [514527.214424] R13: 0000000000021513 R14: 0000000000000000 R15: 0000000000000100 [514527.214426] FS: 0000000000000000(0000) GS:ffffffff805c4000(0000) knlGS:0000000000000000 [514527.214428] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b [514527.214430] CR2: 00007f7f8b692000 CR3: 0000000038f73000 CR4: 00000000000006e0 [514527.214432] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [514527.214434] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [514527.214435] [514527.214436] Call Trace: [514527.214451] [] :jfs:dbUpdatePMap+0x2a3/0x480 [514527.214460] [] :jfs:txAllocPMap+0xdd/0x120 [514527.214467] [] :jfs:txUpdateMap+0x1ae/0x270 [514527.214472] [] __wake_up+0x43/0x70 [514527.214479] [] :jfs:jfs_lazycommit+0x120/0x270 [514527.214482] [] default_wake_function+0x0/0x10 [514527.214489] [] :jfs:jfs_lazycommit+0x0/0x270 [514527.214493] [] kthread+0x4b/0x80 [514527.214496] [] child_rip+0xa/0x12 [514527.214500] [] kthread+0x0/0x80 [514527.214503] [] child_rip+0x0/0x12 [514527.214505]