I'm seeing this on Linux box05 2.6.32-02063209-generic #02063209 SMP Wed Feb 24 10:09:53 UTC 2010 x86_64 GNU/Linux occurs while coping a disk to nfs share on another box Feb 24 21:11:29 box05 kernel: [ 600.530615] INFO: task flush-0:25:2623 blocked for more than 120 seconds. Feb 24 21:11:29 box05 kernel: [ 600.530618] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Feb 24 21:11:29 box05 kernel: [ 600.530622] flush-0:25 D 0000000000000001 0 2623 2 0x00000000 Feb 24 21:11:29 box05 kernel: [ 600.530628] ffff8800c7bdd110 0000000000000046 0000000000000000 ffff8800c7bddfd8 Feb 24 21:11:29 box05 kernel: [ 600.530634] ffff880129f45b40 0000000000015a80 0000000000015a80 ffff8800c7bddfd8 Feb 24 21:11:29 box05 kernel: [ 600.530640] 0000000000015a80 ffff8800c7bddfd8 0000000000015a80 ffff880129f45f00 Feb 24 21:11:29 box05 kernel: [ 600.530645] Call Trace: Feb 24 21:11:29 box05 kernel: [ 600.530651] [] io_schedule+0x42/0x60 Feb 24 21:11:29 box05 kernel: [ 600.530668] [] nfs_wait_bit_uninterruptible+0x9/0x10 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.530673] [] __wait_on_bit+0x55/0x80 Feb 24 21:11:29 box05 kernel: [ 600.530689] [] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.530706] [] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.530711] [] out_of_line_wait_on_bit+0x78/0x90 Feb 24 21:11:29 box05 kernel: [ 600.530716] [] ? wake_bit_function+0x0/0x30 Feb 24 21:11:29 box05 kernel: [ 600.530732] [] nfs_wait_on_request+0x28/0x30 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.530750] [] nfs_wait_on_requests_locked+0x79/0xd0 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.530757] [] ? get_partial_node+0x9b/0xc0 Feb 24 21:11:29 box05 kernel: [ 600.530775] [] nfs_sync_mapping_wait+0xb3/0x140 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.530782] [] ? pskb_expand_head+0x58/0x1a0 Feb 24 21:11:29 box05 kernel: [ 600.530800] [] nfs_wb_page_priority+0x86/0xe0 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.530806] [] ? page_cgroup_zoneinfo+0x2e/0x40 Feb 24 21:11:29 box05 kernel: [ 600.530823] [] nfs_wb_page+0xe/0x10 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.530836] [] nfs_release_page+0x35/0x60 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.530842] [] try_to_release_page+0x2b/0x40 Feb 24 21:11:29 box05 kernel: [ 600.530847] [] shrink_page_list+0x4b7/0x550 Feb 24 21:11:29 box05 kernel: [ 600.530852] [] ? isolate_lru_pages+0x23d/0x280 Feb 24 21:11:29 box05 kernel: [ 600.530858] [] shrink_inactive_list+0x2f3/0x700 Feb 24 21:11:29 box05 kernel: [ 600.530864] [] ? __alloc_skb+0x49/0x180 Feb 24 21:11:29 box05 kernel: [ 600.530870] [] ? move_freepages_block+0x73/0x80 Feb 24 21:11:29 box05 kernel: [ 600.530875] [] shrink_list+0x51/0xa0 Feb 24 21:11:29 box05 kernel: [ 600.530880] [] shrink_zone+0x1ea/0x200 Feb 24 21:11:29 box05 kernel: [ 600.530885] [] shrink_zones+0x63/0xf0 Feb 24 21:11:29 box05 kernel: [ 600.530891] [] do_try_to_free_pages+0x70/0x280 Feb 24 21:11:29 box05 kernel: [ 600.530896] [] try_to_free_pages+0x9c/0xc0 Feb 24 21:11:29 box05 kernel: [ 600.530901] [] ? isolate_pages_global+0x0/0x50 Feb 24 21:11:29 box05 kernel: [ 600.530907] [] __alloc_pages_slowpath+0x25b/0x540 Feb 24 21:11:29 box05 kernel: [ 600.530913] [] __alloc_pages_nodemask+0x146/0x180 Feb 24 21:11:29 box05 kernel: [ 600.530919] [] alloc_pages_current+0x87/0xd0 Feb 24 21:11:29 box05 kernel: [ 600.530925] [] allocate_slab+0x11c/0x1b0 Feb 24 21:11:29 box05 kernel: [ 600.530931] [] new_slab+0x2b/0x190 Feb 24 21:11:29 box05 kernel: [ 600.530935] [] __slab_alloc+0x121/0x230 Feb 24 21:11:29 box05 kernel: [ 600.530952] [] ? nfs_writedata_alloc+0x82/0xb0 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.530970] [] ? nfs_writedata_alloc+0x82/0xb0 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.530975] [] __kmalloc+0x1a6/0x1f0 Feb 24 21:11:29 box05 kernel: [ 600.530992] [] nfs_writedata_alloc+0x82/0xb0 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.531009] [] nfs_flush_one+0x1d/0xf0 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.531026] [] nfs_pageio_doio+0x48/0x70 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.531042] [] nfs_pageio_complete+0x9/0x10 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.531059] [] nfs_writepages+0xd4/0x120 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.531077] [] ? nfs_flush_one+0x0/0xf0 [nfs] Feb 24 21:11:29 box05 kernel: [ 600.531082] [] ? update_curr+0xb6/0x150 Feb 24 21:11:29 box05 kernel: [ 600.531088] [] do_writepages+0x1c/0x30 Feb 24 21:11:29 box05 kernel: [ 600.531095] [] writeback_single_inode+0xb7/0x270 Feb 24 21:11:29 box05 kernel: [ 600.531100] [] ? down_read_trylock+0x9/0x10 Feb 24 21:11:29 box05 kernel: [ 600.531106] [] writeback_inodes_wb+0x162/0x210 Feb 24 21:11:29 box05 kernel: [ 600.531112] [] ? default_spin_lock_flags+0x9/0x10 Feb 24 21:11:29 box05 kernel: [ 600.531118] [] wb_writeback+0x126/0x1e0 Feb 24 21:11:29 box05 kernel: [ 600.531124] [] ? wb_work_complete+0x2e/0x60 Feb 24 21:11:29 box05 kernel: [ 600.531129] [] wb_do_writeback+0x2c/0xc0 Feb 24 21:11:29 box05 kernel: [ 600.531135] [] bdi_writeback_task+0x38/0xc0 Feb 24 21:11:29 box05 kernel: [ 600.531140] [] ? bdi_start_fn+0x0/0x100 Feb 24 21:11:29 box05 kernel: [ 600.531145] [] bdi_start_fn+0x87/0x100 Feb 24 21:11:29 box05 kernel: [ 600.531150] [] ? bdi_start_fn+0x0/0x100 Feb 24 21:11:29 box05 kernel: [ 600.531154] [] kthread+0x8e/0xa0 Feb 24 21:11:29 box05 kernel: [ 600.531159] [] child_rip+0xa/0x20 Feb 24 21:11:29 box05 kernel: [ 600.531164] [] ? kthread+0x0/0xa0 Feb 24 21:11:29 box05 kernel: [ 600.531168] [] ? child_rip+0x0/0x20