xfs_check eats up memory

[Tamas Papp]

Binary package hint: xfsprogs

There is two problems.

1. xfs_check eats up all memories on the system, including the swap space.

2. On kernel 2.6.32 it was killed by kernel, on 2.6.38 the system freeze up until cold reboot. It responses to ping, but cannot be accessed through ssh. In this case there is no log messages in syslog.

On 2.6.32:

Apr 28 07:46:28 backup1 kernel: [40872.124470] xfs_db invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0
Apr 28 07:46:28 backup1 kernel: [40872.124476] xfs_db cpuset=/ mems_allowed=0
Apr 28 07:46:28 backup1 kernel: [40872.124480] Pid: 4095, comm: xfs_db Not tainted 2.6.32-31-server #61-Ubuntu
Apr 28 07:46:28 backup1 kernel: [40872.124483] Call Trace:
Apr 28 07:46:28 backup1 kernel: [40872.124493] [<ffffffff810b49bd>] ? cpuset_print_task_mems_allowed+0x9d/0xb0
Apr 28 07:46:28 backup1 kernel: [40872.124500] [<ffffffff810f8d44>] oom_kill_process+0xd4/0x2f0
Apr 28 07:46:28 backup1 kernel: [40872.124504] [<ffffffff810f9300>] ? select_bad_process+0xd0/0x110
Apr 28 07:46:28 backup1 kernel: [40872.124508] [<ffffffff810f9398>] __out_of_memory+0x58/0xc0
Apr 28 07:46:28 backup1 kernel: [40872.124511] [<ffffffff810f952e>] out_of_memory+0x12e/0x1a0
Apr 28 07:46:28 backup1 kernel: [40872.124517] [<ffffffff8155e7be>] ? _spin_lock+0xe/0x20
Apr 28 07:46:28 backup1 kernel: [40872.124521] [<ffffffff810fc691>] __alloc_pages_slowpath+0x571/0x590
Apr 28 07:46:28 backup1 kernel: [40872.124526] [<ffffffff810fc821>] __alloc_pages_nodemask+0x171/0x180
Apr 28 07:46:28 backup1 kernel: [40872.124532] [<ffffffff8112f9c2>] alloc_page_vma+0x72/0xf0
Apr 28 07:46:28 backup1 kernel: [40872.124535] [<ffffffff81101231>] ? lru_cache_add_lru+0x21/0x40
Apr 28 07:46:28 backup1 kernel: [40872.124540] [<ffffffff81117240>] do_wp_page+0x480/0x850
Apr 28 07:46:28 backup1 kernel: [40872.124547] [<ffffffff8103975d>] ? __ticket_spin_lock+0xd/0x20
Apr 28 07:46:28 backup1 kernel: [40872.124552] [<ffffffff8111314c>] ? do_anonymous_page+0x11c/0x330
Apr 28 07:46:28 backup1 kernel: [40872.124555] [<ffffffff81117dbc>] handle_mm_fault+0x2ec/0x3c0
Apr 28 07:46:28 backup1 kernel: [40872.124560] [<ffffffff81561335>] do_page_fault+0x125/0x3b0
Apr 28 07:46:28 backup1 kernel: [40872.124563] [<ffffffff8155ec85>] page_fault+0x25/0x30
Apr 28 07:46:28 backup1 kernel: [40872.124566] Mem-Info:
Apr 28 07:46:28 backup1 kernel: [40872.124568] Node 0 DMA per-cpu:
Apr 28 07:46:28 backup1 kernel: [40872.124571] CPU 0: hi: 0, btch: 1 usd: 0
Apr 28 07:46:28 backup1 kernel: [40872.124573] CPU 1: hi: 0, btch: 1 usd: 0
Apr 28 07:46:28 backup1 kernel: [40872.124575] CPU 2: hi: 0, btch: 1 usd: 0
Apr 28 07:46:28 backup1 kernel: [40872.124577] CPU 3: hi: 0, btch: 1 usd: 0
Apr 28 07:46:28 backup1 kernel: [40872.124579] Node 0 DMA32 per-cpu:
Apr 28 07:46:28 backup1 kernel: [40872.124582] CPU 0: hi: 186, btch: 31 usd: 30
Apr 28 07:46:28 backup1 kernel: [40872.124585] CPU 1: hi: 186, btch: 31 usd: 0
Apr 28 07:46:28 backup1 kernel: [40872.124587] CPU 2: hi: 186, btch: 31 usd: 0
Apr 28 07:46:28 backup1 kernel: [40872.124589] CPU 3: hi: 186, btch: 31 usd: 0
Apr 28 07:46:28 backup1 kernel: [40872.124591] Node 0 Normal per-cpu:
Apr 28 07:46:28 backup1 kernel: [40872.124594] CPU 0: hi: 186, btch: 31 usd: 30
Apr 28 07:46:28 backup1 kernel: [40872.124596] CPU 1: hi: 186, btch: 31 usd: 40
Apr 28 07:46:28 backup1 kernel: [40872.124598] CPU 2: hi: 186, btch: 31 usd: 0
Apr 28 07:46:28 backup1 kernel: [40872.124600] CPU 3: hi: 186, btch: 31 usd: 0
Apr 28 07:46:28 backup1 kernel: [40872.124606] active_anon:1178429 inactive_anon:294664 isolated_anon:64
Apr 28 07:46:28 backup1 kernel: [40872.124607] active_file:41 inactive_file:5 isolated_file:0
Apr 28 07:46:28 backup1 kernel: [40872.124608] unevictable:0 dirty:0 writeback:90 unstable:0
Apr 28 07:46:28 backup1 kernel: [40872.124609] free:9382 slab_reclaimable:1735 slab_unreclaimable:4891
Apr 28 07:46:28 backup1 kernel: [40872.124611] mapped:69 shmem:64 pagetables:5546 bounce:0
Apr 28 07:46:28 backup1 kernel: [40872.124613] Node 0 DMA free:15896kB min:24kB low:28kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15332kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Apr 28 07:46:28 backup1 kernel: [40872.124624] lowmem_reserve[]: 0 2991 6021 6021
Apr 28 07:46:28 backup1 kernel: [40872.124629] Node 0 DMA32 free:16864kB min:4928kB low:6160kB high:7392kB active_anon:2335364kB inactive_anon:583932kB active_file:132kB inactive_file:20kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3063392kB mlocked:0kB dirty:0kB writeback:0kB mapped:220kB shmem:236kB slab_reclaimable:1792kB slab_unreclaimable:9204kB kernel_stack:48kB pagetables:7812kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:223 all_unreclaimable? no
Apr 28 07:46:28 backup1 kernel: [40872.124641] lowmem_reserve[]: 0 0 3030 3030
Apr 28 07:46:28 backup1 kernel: [40872.124645] Node 0 Normal free:4768kB min:4988kB low:6232kB high:7480kB active_anon:2378352kB inactive_anon:594724kB active_file:32kB inactive_file:0kB unevictable:0kB isolated(anon):256kB isolated(file):0kB present:3102720kB mlocked:0kB dirty:0kB writeback:360kB mapped:56kB shmem:20kB slab_reclaimable:5148kB slab_unreclaimable:10360kB kernel_stack:1056kB pagetables:14372kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:178 all_unreclaimable? yes
Apr 28 07:46:28 backup1 kernel: [40872.124657] lowmem_reserve[]: 0 0 0 0
Apr 28 07:46:28 backup1 kernel: [40872.124661] Node 0 DMA: 2*4kB 2*8kB 4*16kB 4*32kB 1*64kB 2*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15896kB
Apr 28 07:46:28 backup1 kernel: [40872.124671] Node 0 DMA32: 1238*4kB 33*8kB 26*16kB 45*32kB 73*64kB 32*128kB 4*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 16864kB
Apr 28 07:46:28 backup1 kernel: [40872.124682] Node 0 Normal: 290*4kB 3*8kB 2*16kB 11*32kB 10*64kB 8*128kB 4*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4768kB
Apr 28 07:46:28 backup1 kernel: [40872.124692] 4440 total pagecache pages
Apr 28 07:46:28 backup1 kernel: [40872.124694] 4315 pages in swap cache
Apr 28 07:46:28 backup1 kernel: [40872.124696] Swap cache stats: add 1151241, delete 1146926, find 1084735/1099361
Apr 28 07:46:28 backup1 kernel: [40872.124698] Free swap = 0kB
Apr 28 07:46:28 backup1 kernel: [40872.124700] Total swap = 3911816kB
Apr 28 07:46:28 backup1 kernel: [40872.142514] 1572864 pages RAM
Apr 28 07:46:28 backup1 kernel: [40872.142517] 43385 pages reserved
Apr 28 07:46:28 backup1 kernel: [40872.142519] 103 pages shared
Apr 28 07:46:28 backup1 kernel: [40872.142520] 1519492 pages non-shared
Apr 28 07:46:28 backup1 kernel: [40872.142524] Out of memory: kill process 4094 (xfs_check) score 205603 or a child
Apr 28 07:46:28 backup1 kernel: [40872.143146] Killed process 4095 (xfs_db)

Previously it was mounted with this:

/dev/sdb1 /data xfs delaylog,sunit=512,swidth=5632,logbufs=8,logbsize=256k,noatime,nodiratime,noauto 0 0

ProblemType: Bug
DistroRelease: Ubuntu 11.04
Package: xfsprogs 3.1.4ubuntu2
ProcVersionSignature: Ubuntu 2.6.38-8.42-server 2.6.38.2
Uname: Linux 2.6.38-8-server x86_64
Architecture: amd64
Date: Thu Apr 28 11:28:54 2011
SourcePackage: xfsprogs
UpgradeStatus: Upgraded to natty on 2011-04-27 (0 days ago)

[Dave Chiluk (chiluk)]

Closing Won't fix as this version has end of lifed and has likely been resolved. Please reopen if this is still an issue.