Rsync and rm Froze xfs

[RazorX]

I had a long rsync running copying stuff onto the system. Millions of files. I also had a bunch hardlink and removals going down. The whole file system seemed to lock up:

INFO: task rsync:26670 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
rsync D ffffffff81806240 0 26670 26668 0x00000000
ffff8806700fb3a8 0000000000000086 ffff8806700fb348 ffffffff8103ec69
ffff8806700fbfd8 ffff8806700fbfd8 ffff8806700fbfd8 00000000000137c0
ffff880c31095c00 ffff8809b845c500 ffff880a557a57c0 7fffffffffffffff
Call Trace:
[<ffffffff8103ec69>] ? default_spin_lock_flags+0x9/0x10
[<ffffffff8165c58f>] schedule+0x3f/0x60
[<ffffffff8165cbd5>] schedule_timeout+0x2a5/0x320
[<ffffffff81165dfd>] ? kmem_cache_alloc+0x11d/0x140
[<ffffffffa02db7b7>] ? kmem_zone_alloc+0x67/0xe0 [xfs]
[<ffffffff8165d82b>] __down_common+0xa0/0xf0
[<ffffffffa02c5295>] ? _xfs_buf_find+0xd5/0x240 [xfs]
[<ffffffff8165d8ee>] __down+0x1d/0x1f
[<ffffffff810914e1>] down+0x41/0x50
[<ffffffffa02c50f4>] xfs_buf_lock+0x44/0x110 [xfs]
[<ffffffffa02c5295>] _xfs_buf_find+0xd5/0x240 [xfs]
[<ffffffffa02c5684>] xfs_buf_get+0x34/0x1c0 [xfs]
[<ffffffffa02c5f2d>] xfs_buf_read+0x2d/0x120 [xfs]
[<ffffffffa03219df>] xfs_trans_read_buf+0x2bf/0x470 [xfs]
[<ffffffffa02dd775>] xfs_read_agf+0x65/0x1a0 [xfs]
[<ffffffffa02dd8e2>] xfs_alloc_read_agf+0x32/0x60 [xfs]
[<ffffffffa02df6ff>] xfs_alloc_fix_freelist+0x42f/0x490 [xfs]
[<ffffffffa02db7b7>] ? kmem_zone_alloc+0x67/0xe0 [xfs]
[<ffffffff813128db>] ? radix_tree_lookup+0xb/0x10
[<ffffffffa03142d8>] ? xfs_perag_get+0x38/0xd0 [xfs]
[<ffffffffa02dfbec>] ? xfs_alloc_vextent+0x36c/0x690 [xfs]
[<ffffffffa02dfc01>] xfs_alloc_vextent+0x381/0x690 [xfs]
[<ffffffffa0321a17>] ? xfs_trans_read_buf+0x2f7/0x470 [xfs]
[<ffffffff813128db>] ? radix_tree_lookup+0xb/0x10
[<ffffffffa03142d8>] ? xfs_perag_get+0x38/0xd0 [xfs]
[<ffffffffa0306f0e>] xfs_ialloc_ag_alloc+0x15e/0x510 [xfs]
[<ffffffffa030808f>] xfs_dialloc+0xdf/0x910 [xfs]
[<ffffffffa02fad5c>] ? xfs_da_do_buf+0x47c/0x630 [xfs]
[<ffffffff8108bdea>] ? remove_wait_queue+0x5a/0x70
[<ffffffffa02c4da1>] ? xfs_buf_rele+0x51/0x130 [xfs]
[<ffffffff81165dfd>] ? kmem_cache_alloc+0x11d/0x140
[<ffffffffa02db7b7>] ? kmem_zone_alloc+0x67/0xe0 [xfs]
[<ffffffffa0309d61>] xfs_ialloc+0x61/0x650 [xfs]
[<ffffffffa02db7b7>] ? kmem_zone_alloc+0x67/0xe0 [xfs]
[<ffffffffa031a3e8>] ? xlog_grant_log_space+0x168/0x1c0 [xfs]
[<ffffffffa02d7d97>] xfs_dir_ialloc+0x77/0x2b0 [xfs]
[<ffffffffa02cb9bc>] ? xfs_ilock+0xcc/0x120 [xfs]
[<ffffffffa02d9c36>] xfs_create+0x436/0x680 [xfs]
[<ffffffffa02cc17e>] ? xfs_iunlock_map_shared+0xe/0x10 [xfs]
[<ffffffffa02d00fa>] xfs_vn_mknod+0x7a/0x1a0 [xfs]
[<ffffffffa02d0250>] xfs_vn_create+0x10/0x20 [xfs]
[<ffffffff81186144>] vfs_create+0xb4/0x120
[<ffffffff81187d19>] do_last+0x5c9/0x730
[<ffffffff81189221>] path_openat+0xd1/0x3f0
[<ffffffff81189662>] do_filp_open+0x42/0xa0
[<ffffffff8131b671>] ? strncpy_from_user+0x31/0x40
[<ffffffff811849aa>] ? do_getname+0x10a/0x180
[<ffffffff8165e49e>] ? _raw_spin_lock+0xe/0x20
[<ffffffff81196967>] ? alloc_fd+0xf7/0x150
[<ffffffff81178c18>] do_sys_open+0xf8/0x240
[<ffffffff81178d80>] sys_open+0x20/0x30
[<ffffffff81666a82>] system_call_fastpath+0x16/0x1b
INFO: task rm:16340 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
rm D ffffffff81806240 0 16340 4203 0x00000000
ffff880fdbbb9968 0000000000000086 ffff880fdbbb99f8 ffffffffa02e7e35
ffff880fdbbb9fd8 ffff880fdbbb9fd8 ffff880fdbbb9fd8 00000000000137c0
ffff880c317a1700 ffff8803ed568000 ffff8814a2087018 7fffffffffffffff
Call Trace:
[<ffffffffa02e7e35>] ? xfs_bmap_extents_to_btree+0x345/0x410 [xfs]
[<ffffffff8165c58f>] schedule+0x3f/0x60
[<ffffffff8165cbd5>] schedule_timeout+0x2a5/0x320
[<ffffffffa02c4da1>] ? xfs_buf_rele+0x51/0x130 [xfs]
[<ffffffff8165d82b>] __down_common+0xa0/0xf0
[<ffffffffa02c5295>] ? _xfs_buf_find+0xd5/0x240 [xfs]
[<ffffffff8165d8ee>] __down+0x1d/0x1f
[<ffffffff810914e1>] down+0x41/0x50
[<ffffffffa02c50f4>] xfs_buf_lock+0x44/0x110 [xfs]
[<ffffffffa02c5295>] _xfs_buf_find+0xd5/0x240 [xfs]
[<ffffffffa02c5684>] xfs_buf_get+0x34/0x1c0 [xfs]
[<ffffffffa02c5f2d>] xfs_buf_read+0x2d/0x120 [xfs]
[<ffffffffa03219df>] xfs_trans_read_buf+0x2bf/0x470 [xfs]
[<ffffffffa0307333>] xfs_read_agi+0x73/0x100 [xfs]
[<ffffffffa030a6c8>] xfs_iunlink+0x48/0x150 [xfs]
[<ffffffff8106dce6>] ? current_fs_time+0x16/0x60
[<ffffffffa03221d7>] ? xfs_trans_ichgtime+0x27/0xa0 [xfs]
[<ffffffffa02d802a>] xfs_droplink+0x5a/0x70 [xfs]
[<ffffffffa02da48d>] xfs_remove+0x31d/0x400 [xfs]
[<ffffffff8165e49e>] ? _raw_spin_lock+0xe/0x20
[<ffffffffa02d0378>] xfs_vn_unlink+0x48/0x90 [xfs]
[<ffffffff811868a0>] vfs_unlink.part.26+0x80/0xf0
[<ffffffff8118694c>] vfs_unlink+0x3c/0x60
[<ffffffff81188fba>] do_unlinkat+0x1aa/0x1d0
[<ffffffff8117e81a>] ? sys_newfstatat+0x2a/0x40
[<ffffffff81189b02>] sys_unlinkat+0x22/0x40
[<ffffffff81666a82>] system_call_fastpath+0x16/0x1b

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.