Sep 17 13:50:39 lorca kernel: [98491.470654] EXT4-fs error (device dm-6): ext4_mb_generate_buddy:757: group 1928, block bitmap and bg descriptor inconsistent: 164 vs 162 free clusters Sep 17 13:50:39 lorca kernel: [98491.480687] Aborting journal on device dm-6-8. Sep 17 13:50:39 lorca kernel: [98491.482108] EXT4-fs (dm-6): Remounting filesystem read-only Sep 17 13:51:32 lorca kernel: [98544.496346] grep invoked oom-killer: gfp_mask=0x200da, order=0, oom_score_adj=0 Sep 17 13:51:32 lorca kernel: [98544.496351] grep cpuset=/ mems_allowed=0 Sep 17 13:51:32 lorca kernel: [98544.496400] CPU: 1 PID: 9062 Comm: grep Not tainted 4.1.0-0.bpo.2-amd64 #1 Debian 4.1.6-1~bpo8+1 Sep 17 13:51:32 lorca kernel: [98544.496402] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS debian/1.7.5-1-0-g506b58d-dirty-20140812_231322-gandalf 04/01/2014 Sep 17 13:51:32 lorca kernel: [98544.496404] 0000000000000000 0000000000000000 ffffffff815732fe ffff88003caef330 Sep 17 13:51:32 lorca kernel: [98544.496406] ffffffff81572664 0000000000000000 0000000000000000 0000000000000000 Sep 17 13:51:32 lorca kernel: [98544.496408] 0000000000000000 00000000ffffffff 0000000000000001 ffffffff819044c0 Sep 17 13:51:32 lorca kernel: [98544.496410] Call Trace: Sep 17 13:51:32 lorca kernel: [98544.496437] [] ? dump_stack+0x40/0x50 Sep 17 13:51:32 lorca kernel: [98544.496439] [] ? dump_header+0x9b/0x218 Sep 17 13:51:32 lorca kernel: [98544.496456] [] ? rcu_oom_notify+0xe5/0x110 Sep 17 13:51:32 lorca kernel: [98544.496468] [] ? oom_kill_process+0x1db/0x3b0 Sep 17 13:51:32 lorca kernel: [98544.496476] [] ? has_capability_noaudit+0x1e/0x30 Sep 17 13:51:32 lorca kernel: [98544.496477] [] ? __out_of_memory+0x315/0x540 Sep 17 13:51:32 lorca kernel: [98544.496479] [] ? out_of_memory+0x53/0x70 Sep 17 13:51:32 lorca kernel: [98544.496481] [] ? __alloc_pages_nodemask+0x928/0xa70 Sep 17 13:51:32 lorca kernel: [98544.496485] [] ? alloc_pages_vma+0xc6/0x250 Sep 17 13:51:32 lorca kernel: [98544.496488] [] ? pagecache_get_page+0x27/0x1a0 Sep 17 13:51:32 lorca kernel: [98544.496491] [] ? read_swap_cache_async+0xe7/0x160 Sep 17 13:51:32 lorca kernel: [98544.496493] [] ? swapin_readahead+0x130/0x190 Sep 17 13:51:32 lorca kernel: [98544.496506] [] ? radix_tree_lookup_slot+0x10/0x30 Sep 17 13:51:32 lorca kernel: [98544.496508] [] ? find_get_entry+0x1d/0xc0 Sep 17 13:51:32 lorca kernel: [98544.496510] [] ? pagecache_get_page+0x27/0x1a0 Sep 17 13:51:32 lorca kernel: [98544.496512] [] ? handle_mm_fault+0x10c9/0x1640 Sep 17 13:51:32 lorca kernel: [98544.496515] [] ? __do_page_fault+0x1c2/0x4c0 Sep 17 13:51:32 lorca kernel: [98544.496518] [] ? async_page_fault+0x28/0x30 Sep 17 13:51:32 lorca kernel: [98544.496519] Mem-Info: Sep 17 13:51:32 lorca kernel: [98544.496523] active_anon:111334 inactive_anon:112583 isolated_anon:0 Sep 17 13:51:32 lorca kernel: [98544.496523] active_file:157 inactive_file:163 isolated_file:0 Sep 17 13:51:32 lorca kernel: [98544.496523] unevictable:0 dirty:0 writeback:0 unstable:0 Sep 17 13:51:32 lorca kernel: [98544.496523] slab_reclaimable:7171 slab_unreclaimable:5957 Sep 17 13:51:32 lorca kernel: [98544.496523] mapped:362 shmem:475 pagetables:8835 bounce:0 Sep 17 13:51:32 lorca kernel: [98544.496523] free:2215 free_pcp:320 free_cma:0 Sep 17 13:51:32 lorca kernel: [98544.496527] Node 0 DMA free:3948kB min:60kB low:72kB high:88kB active_anon:3212kB inactive_anon:4500kB active_file:12kB inactive_file:20kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15992kB managed:15908kB mlocked:0kB dirty:0kB writeback:0kB mapped:96kB shmem:536kB slab_reclaimable:280kB slab_unreclaimable:476kB kernel_stack:896kB pagetables:176kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:930196 all_unreclaimable? yes Sep 17 13:51:32 lorca kernel: [98544.496532] lowmem_reserve[]: 0 980 980 980 Sep 17 13:51:32 lorca kernel: [98544.496534] Node 0 DMA32 free:4912kB min:3836kB low:4792kB high:5752kB active_anon:442124kB inactive_anon:445832kB active_file:616kB inactive_file:632kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:1032064kB managed:1005632kB mlocked:0kB dirty:0kB writeback:0kB mapped:1352kB shmem:1364kB slab_reclaimable:28404kB slab_unreclaimable:23352kB kernel_stack:1808kB pagetables:35164kB unstable:0kB bounce:0kB free_pcp:1280kB local_pcp:688kB free_cma:0kB writeback_tmp:0kB pages_scanned:5336660 all_unreclaimable? yes Sep 17 13:51:32 lorca kernel: [98544.496541] lowmem_reserve[]: 0 0 0 0 Sep 17 13:51:32 lorca kernel: [98544.496543] Node 0 DMA: 383*4kB (UM) 256*8kB (U) 1*16kB (M) 1*32kB (R) 1*64kB (R) 0*128kB 1*256kB (R) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3948kB Sep 17 13:51:32 lorca kernel: [98544.496565] Node 0 DMA32: 1059*4kB (UEM) 0*8kB 0*16kB 2*32kB (R) 2*64kB (R) 2*128kB (R) 1*256kB (R) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4940kB Sep 17 13:51:32 lorca kernel: [98544.496573] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Sep 17 13:51:32 lorca kernel: [98544.496574] 3076 total pagecache pages Sep 17 13:51:32 lorca kernel: [98544.496576] 2289 pages in swap cache Sep 17 13:51:32 lorca kernel: [98544.496578] Swap cache stats: add 643912, delete 641623, find 231316/456095 Sep 17 13:51:32 lorca kernel: [98544.496579] Free swap = 3166660kB Sep 17 13:51:32 lorca kernel: [98544.496580] Total swap = 3903484kB Sep 17 13:51:32 lorca kernel: [98544.496581] 262014 pages RAM Sep 17 13:51:32 lorca kernel: [98544.496582] 0 pages HighMem/MovableOnly Sep 17 13:51:32 lorca kernel: [98544.496582] 6629 pages reserved Sep 17 13:51:32 lorca kernel: [98544.496583] 0 pages hwpoisoned Sep 17 13:51:32 lorca kernel: [98544.496593] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name Sep 17 13:51:32 lorca kernel: [98544.496597] [ 162] 0 162 7216 110 19 3 44 0 systemd-journal Sep 17 13:51:32 lorca kernel: [98544.496599] [ 530] 0 530 13791 3 32 3 165 -1000 sshd Sep 17 13:51:32 lorca kernel: [98544.496601] [ 531] 0 531 3264 2 12 3 45 0 rsync Sep 17 13:51:32 lorca kernel: [98544.496603] [ 542] 102 542 11599 7 29 3 133 -900 dbus-daemon Sep 17 13:51:32 lorca kernel: [98544.496605] [ 564] 0 564 4835 23 14 3 34 0 irqbalance Sep 17 13:51:32 lorca kernel: [98544.496606] [ 565] 107 565 7442 0 19 3 145 0 nrpe Sep 17 13:51:32 lorca kernel: [98544.496608] [ 566] 0 566 6163 53 15 3 71 0 nvpmgr Sep 17 13:51:32 lorca kernel: [98544.496610] [ 567] 0 567 4750 35 13 3 57 0 nvcmgr Sep 17 13:51:32 lorca kernel: [98544.496611] [ 570] 0 570 1062 2 7 3 36 0 acpid Sep 17 13:51:32 lorca kernel: [98544.496613] [ 582] 0 582 4816 91 12 3 57 0 nvnmgr Sep 17 13:51:32 lorca kernel: [98544.496615] [ 583] 0 583 7065 48 19 3 119 0 nvstatsmngr Sep 17 13:51:32 lorca kernel: [98544.496617] [ 601] 0 601 59799 61 113 3 391 0 winbindd Sep 17 13:51:32 lorca kernel: [98544.496618] [ 602] 0 602 49737 49 95 3 336 0 nmbd Sep 17 13:51:32 lorca kernel: [98544.496620] [ 608] 0 608 61910 32 118 3 463 0 winbindd Sep 17 13:51:32 lorca kernel: [98544.496622] [ 613] 0 613 70878 78 138 3 483 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496623] [ 617] 0 617 61218 37 117 3 425 0 winbindd Sep 17 13:51:32 lorca kernel: [98544.496625] [ 618] 0 618 62492 76 119 3 396 0 winbindd Sep 17 13:51:32 lorca kernel: [98544.496627] [ 619] 0 619 59799 31 112 3 420 0 winbindd Sep 17 13:51:32 lorca kernel: [98544.496629] [ 620] 0 620 70878 52 130 3 509 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496631] [ 2347] 0 2347 10178 3 22 3 98 -1000 systemd-udevd Sep 17 13:51:32 lorca kernel: [98544.496632] [ 4969] 0 4969 7086 16 19 3 65 0 systemd-logind Sep 17 13:51:32 lorca kernel: [98544.496634] [ 7023] 0 7023 6986 19 19 3 42 0 cron Sep 17 13:51:32 lorca kernel: [98544.496636] [ 7127] 0 7127 64666 61 28 4 295 0 rsyslogd Sep 17 13:51:32 lorca kernel: [98544.496638] [ 7731] 0 7731 3722 1 12 3 37 0 agetty Sep 17 13:51:32 lorca kernel: [98544.496639] [ 7760] 0 7760 73015 71 141 3 517 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496641] [ 7903] 0 7903 73684 78 142 3 509 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496643] [ 8148] 0 8148 74063 79 143 3 516 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496644] [17599] 0 17599 14008 372 33 3 6220 0 rsync Sep 17 13:51:32 lorca kernel: [98544.496646] [16419] 0 16419 74644 30 143 3 557 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496648] [ 9944] 11429 9944 75545 534 148 3 716 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496649] [15032] 0 15032 74644 73 143 3 515 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496651] [ 5704] 0 5704 6846 0 18 3 167 0 systemd Sep 17 13:51:32 lorca kernel: [98544.496653] [ 5709] 0 5709 16178 10 36 3 544 0 (sd-pam) Sep 17 13:51:32 lorca kernel: [98544.496655] [22820] 0 22820 74644 74 143 3 513 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496656] [ 4451] 0 4451 74700 87 145 3 515 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496658] [ 6119] 0 6119 74644 77 143 3 510 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496659] [26742] 0 26742 74176 78 142 3 516 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496661] [ 5320] 0 5320 74644 46 145 3 542 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496668] [10442] 0 10442 74644 83 144 3 504 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496678] [22250] 0 22250 74644 64 143 3 523 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496680] [ 575] 0 575 74644 66 143 3 521 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496682] [ 8800] 0 8800 74644 88 143 3 499 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496684] [16658] 0 16658 74644 69 144 3 519 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496685] [30127] 0 30127 74644 77 144 3 510 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496687] [ 7007] 0 7007 74716 141 145 3 559 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496694] [ 347] 0 347 74717 72 145 3 557 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496696] [ 3162] 0 3162 74826 61 146 3 718 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496697] [16394] 0 16394 74644 74 143 3 514 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496699] [23707] 0 23707 75224 78 146 3 896 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496701] [ 2189] 11447 2189 75066 412 146 3 526 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496702] [ 2288] 0 2288 74644 94 143 3 512 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496704] [15716] 0 15716 74644 97 143 3 511 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496706] [20787] 0 20787 74719 74 145 3 558 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496708] [30029] 11284 30029 75086 348 146 3 510 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496709] [32335] 0 32335 74381 196 143 3 628 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496711] [ 1180] 0 1180 74644 78 143 3 509 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496713] [13633] 0 13633 74644 91 143 3 496 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496714] [15742] 0 15742 27486 1 57 4 260 0 sshd Sep 17 13:51:32 lorca kernel: [98544.496716] [16163] 0 16163 5636 1 16 3 146 0 bash Sep 17 13:51:32 lorca kernel: [98544.496718] [22503] 34437 22503 79856 563 155 3 5000 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496719] [23410] 0 23410 74238 102 142 3 541 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496721] [27124] 11366 27124 75528 526 148 3 719 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496723] [20125] 0 20125 74644 83 144 3 505 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496724] [24397] 0 24397 74767 40 144 3 547 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496726] [ 2142] 0 2142 75015 90 146 3 819 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496728] [ 551] 0 551 74644 74 143 3 513 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496729] [19873] 11219 19873 74930 173 145 3 532 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496731] [11563] 0 11563 74644 85 143 3 502 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496733] [11577] 0 11577 74841 107 145 3 568 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496734] [11656] 0 11656 3442 1 11 3 72 0 hsmrsrc.sh Sep 17 13:51:32 lorca kernel: [98544.496736] [11687] 0 11687 3443 0 11 3 74 0 hsmrsrc.sh Sep 17 13:51:32 lorca kernel: [98544.496738] [ 1590] 0 1590 75194 87 146 3 917 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496740] [ 4033] 0 4033 74127 86 141 3 495 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496741] [ 4681] 0 4681 75122 256 146 3 577 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496743] [ 2750] 11143 2750 74905 202 145 3 496 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496745] [29518] 0 29518 74767 94 144 3 507 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496747] [ 9059] 0 9059 3443 0 11 3 74 0 hsmrsrc.sh Sep 17 13:51:32 lorca kernel: [98544.496748] [ 9060] 0 9060 3443 0 10 3 74 0 hsmrsrc.sh Sep 17 13:51:32 lorca kernel: [98544.496750] [ 9062] 0 9062 372145 217232 729 4 149579 0 grep Sep 17 13:51:32 lorca kernel: [98544.496752] [ 9063] 0 9063 1670 0 9 3 28 0 wc Sep 17 13:51:32 lorca kernel: [98544.496775] [ 9074] 0 9074 76421 393 148 3 264 0 smbd Sep 17 13:51:32 lorca kernel: [98544.496777] Out of memory: Kill process 9062 (grep) score 289 or sacrifice child Sep 17 13:51:32 lorca kernel: [98544.497005] Killed process 9062 (grep) total-vm:1488580kB, anon-rss:868928kB, file-rss:0kB Sep 17 14:21:52 lorca kernel: [100364.432119] EXT4-fs error (device dm-3): ext4_mb_generate_buddy:757: group 1625, block bitmap and bg descriptor inconsistent: 7621 vs 7619 free clusters Sep 17 14:21:52 lorca kernel: [100364.432616] Aborting journal on device dm-3-8. Sep 17 14:21:52 lorca kernel: [100364.433184] EXT4-fs (dm-3): Remounting filesystem read-only Sep 17 14:21:52 lorca kernel: [100364.433397] EXT4-fs error (device dm-3) in ext4_free_blocks:4873: Journal has aborted Sep 17 14:21:52 lorca kernel: [100364.433801] EXT4-fs error (device dm-3) in ext4_reserve_inode_write:4980: Journal has aborted Sep 17 14:21:52 lorca kernel: [100364.434165] EXT4-fs error (device dm-3) in ext4_reserve_inode_write:4980: Journal has aborted Sep 17 14:21:52 lorca kernel: [100364.434562] EXT4-fs error (device dm-3) in ext4_ext_remove_space:3042: Journal has aborted Sep 17 14:21:52 lorca kernel: [100364.434934] EXT4-fs error (device dm-3) in ext4_ext_truncate:4654: Journal has aborted Sep 17 14:21:52 lorca kernel: [100364.435714] EXT4-fs error (device dm-3) in ext4_reserve_inode_write:4980: Journal has aborted Sep 17 14:21:52 lorca kernel: [100364.436524] EXT4-fs error (device dm-3) in ext4_orphan_del:2987: Journal has aborted Sep 17 14:21:52 lorca kernel: [100364.437272] EXT4-fs error (device dm-3) in ext4_reserve_inode_write:4980: Journal has aborted Sep 17 15:27:08 lorca kernel: [104280.189747] EXT4-fs error (device dm-3): ext4_put_super:765: Couldn't clean up the journal Sep 17 15:31:04 lorca kernel: [104516.033128] EXT4-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro Sep 17 15:38:24 lorca kernel: [104955.944592] EXT4-fs error (device dm-6): ext4_put_super:765: Couldn't clean up the journal Sep 17 15:40:29 lorca kernel: [105081.108455] EXT4-fs (dm-6): mounted filesystem with ordered data mode. Opts: errors=remount-ro