_fault+0x864/0xd78 Mar 20 06:59:23 s1lp14 kernel: [345142.176303] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 06:59:23 s1lp14 kernel: [345142.176306] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 06:59:23 s1lp14 kernel: [345142.176308] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 06:59:23 s1lp14 kernel: [345142.176309] Mem-Info: Mar 20 06:59:23 s1lp14 kernel: [345142.176312] active_anon:4562528 inactive_anon:351697 isolated_anon:0 Mar 20 06:59:23 s1lp14 kernel: [345142.176312] active_file:29 inactive_file:172 isolated_file:0 Mar 20 06:59:23 s1lp14 kernel: [345142.176312] unevictable:7099 dirty:0 writeback:218 unstable:0 Mar 20 06:59:23 s1lp14 kernel: [345142.176312] slab_reclaimable:17336 slab_unreclaimable:40872 Mar 20 06:59:23 s1lp14 kernel: [345142.176312] mapped:2890 shmem:986 pagetables:21101 bounce:0 Mar 20 06:59:23 s1lp14 kernel: [345142.176312] free:23396 free_pcp:0 free_cma:0 Mar 20 06:59:23 s1lp14 kernel: [345142.176314] Node 0 active_anon:18250112kB inactive_anon:1406788kB active_file:116kB inactive_file:688kB unevictable:28396kB isolated(anon):0kB isolated(file):0kB mapped:11560kB dirty:0kB writeback:872kB shmem:3944kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 06:59:23 s1lp14 kernel: [345142.176315] Node 0 DMA free:73604kB min:2280kB low:4344kB high:6408kB active_anon:1843712kB inactive_anon:152904kB active_file:0kB inactive_file:44kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:32kB pagetables:7964kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 06:59:23 s1lp14 kernel: [345142.176317] lowmem_reserve[]: 0 17889 17889 Mar 20 06:59:23 s1lp14 kernel: [345142.176319] Node 0 Normal free:19980kB min:20244kB low:38560kB high:56876kB active_anon:16406108kB inactive_anon:1253884kB active_file:128kB inactive_file:412kB unevictable:28396kB writepending:412kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8096kB pagetables:76440kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 06:59:23 s1lp14 kernel: [345142.176321] lowmem_reserve[]: 0 0 0 Mar 20 06:59:23 s1lp14 kernel: [345142.176322] Node 0 DMA: 83*4kB (UM) 94*8kB (U) 70*16kB (UE) 47*32kB (UME) 16*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73724kB Mar 20 06:59:23 s1lp14 kernel: [345142.176328] Node 0 Normal: 566*4kB (UME) 689*8kB (UME) 290*16kB (UME) 53*32kB (UME) 102*64kB (UME) 0*128kB 0*256kB 0*512kB 0*1024kB = 20640kB Mar 20 06:59:23 s1lp14 kernel: [345142.176334] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 06:59:23 s1lp14 kernel: [345142.176334] 17314 total pagecache pages Mar 20 06:59:23 s1lp14 kernel: [345142.176335] 14187 pages in swap cache Mar 20 06:59:23 s1lp14 kernel: [345142.176335] Swap cache stats: add 1664405, delete 1650177, find 9741/16290 Mar 20 06:59:23 s1lp14 kernel: [345142.176336] Free swap = 0kB Mar 20 06:59:23 s1lp14 kernel: [345142.176336] Total swap = 640412kB Mar 20 06:59:23 s1lp14 kernel: [345142.176336] 5242880 pages RAM Mar 20 06:59:23 s1lp14 kernel: [345142.176337] 0 pages HighMem/MovableOnly Mar 20 06:59:23 s1lp14 kernel: [345142.176337] 142387 pages reserved Mar 20 06:59:23 s1lp14 kernel: [345142.176337] 0 pages cma reserved Mar 20 06:59:23 s1lp14 kernel: [345142.176337] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 06:59:23 s1lp14 kernel: [345142.176340] [ 551] 0 551 10702 598 124928 272 0 systemd-journal Mar 20 06:59:23 s1lp14 kernel: [345142.176341] [ 635] 0 635 3774 464 86016 566 -1000 systemd-udevd Mar 20 06:59:23 s1lp14 kernel: [345142.176342] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 06:59:23 s1lp14 kernel: [345142.176343] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 06:59:23 s1lp14 kernel: [345142.176344] [ 1078] 100 1078 20782 491 100352 167 0 systemd-timesyn Mar 20 06:59:23 s1lp14 kernel: [345142.176345] [ 1132] 102 1132 2482 491 98304 196 0 systemd-resolve Mar 20 06:59:23 s1lp14 kernel: [345142.176345] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 06:59:23 s1lp14 kernel: [345142.176346] [ 1226] 0 1226 1547 436 79872 51 0 cron Mar 20 06:59:23 s1lp14 kernel: [345142.176347] [ 1229] 0 1229 2444 571 98304 198 0 systemd-logind Mar 20 06:59:23 s1lp14 kernel: [345142.176348] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 06:59:23 s1lp14 kernel: [345142.176349] [ 1255] 0 1255 58495 586 131072 216 0 accounts-daemon Mar 20 06:59:23 s1lp14 kernel: [345142.176350] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 06:59:23 s1lp14 kernel: [345142.176351] [ 1259] 0 1259 20060 484 83968 58 0 irqbalance Mar 20 06:59:23 s1lp14 kernel: [345142.176351] [ 1265] 0 1265 2673 1153 83968 315 0 pkcsslotd Mar 20 06:59:23 s1lp14 kernel: [345142.176352] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 06:59:23 s1lp14 kernel: [345142.176353] [ 1433] 0 1433 1125 457 73728 39 0 iscsid Mar 20 06:59:23 s1lp14 kernel: [345142.176354] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 06:59:23 s1lp14 kernel: [345142.176355] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 06:59:23 s1lp14 kernel: [345142.176356] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 06:59:23 s1lp14 kernel: [345142.176357] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 06:59:23 s1lp14 kernel: [345142.176358] [ 7772] 101 7772 2793 509 100352 217 0 systemd-network Mar 20 06:59:23 s1lp14 kernel: [345142.176359] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 06:59:23 s1lp14 kernel: [345142.176359] [66598] 0 66598 394264 9 253952 2374 -900 snapd Mar 20 06:59:23 s1lp14 kernel: [345142.176360] [113723] 0 113723 2359 451 88064 122 0 wpa_supplicant Mar 20 06:59:23 s1lp14 kernel: [345142.176361] [116349] 0 116349 8972 400 83968 132 0 master Mar 20 06:59:23 s1lp14 kernel: [345142.176362] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 06:59:23 s1lp14 kernel: [345142.176363] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 06:59:23 s1lp14 kernel: [345142.176364] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 06:59:23 s1lp14 kernel: [345142.176365] [117440] 103 117440 54882 459 98304 146 0 rsyslogd Mar 20 06:59:23 s1lp14 kernel: [345142.176366] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 06:59:23 s1lp14 kernel: [345142.176366] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 06:59:23 s1lp14 kernel: [345142.176367] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 06:59:23 s1lp14 kernel: [345142.176368] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 06:59:23 s1lp14 kernel: [345142.176369] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 06:59:23 s1lp14 kernel: [345142.176370] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 06:59:23 s1lp14 kernel: [345142.176371] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 06:59:23 s1lp14 kernel: [345142.176372] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 06:59:23 s1lp14 kernel: [345142.176372] [70732] 111 70732 9042 420 88064 125 0 pickup Mar 20 06:59:23 s1lp14 kernel: [345142.176373] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 06:59:23 s1lp14 kernel: [345142.176374] [190296] 0 190296 3262 449 104448 65 -1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176375] [190297] 0 190297 3262 273 102400 57 -1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176376] [190298] 0 190298 3262 311 102400 53 -1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176377] [190299] 0 190299 3262 293 102400 61 -1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176378] [190300] 0 190300 3262 311 102400 55 -1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176379] [190302] 0 190302 3262 278 102400 67 -1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176379] [190304] 0 190304 3262 253 102400 64 -1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176380] [190307] 0 190307 3262 313 102400 53 -1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176381] [190308] 0 190308 3262 242 102400 52 -1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176382] [190396] 0 190396 1284202 1167497 10383360 113581 1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176383] [190397] 0 190397 1177155 1150639 9527296 23388 1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176384] [190398] 0 190398 574725 571538 4691968 62 1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176385] [190399] 0 190399 814691 811521 6627328 54 1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176385] [190404] 0 190404 364121 360950 3006464 51 1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176386] [190405] 0 190405 708293 705116 5758976 51 1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176387] [190410] 0 190410 129541 126333 1114112 51 1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176388] [190412] 0 190412 8810 5635 147456 51 1000 stress-ng Mar 20 06:59:23 s1lp14 kernel: [345142.176388] Out of memory: Kill process 190396 (stress-ng) score 1236 or sacrifice child Mar 20 06:59:23 s1lp14 kernel: [345142.176393] Killed process 190396 (stress-ng) total-vm:5136808kB, anon-rss:4669748kB, file-rss:236kB, shmem-rss:4kB Mar 20 06:59:23 s1lp14 kernel: [345142.977092] oom_reaper: reaped process 190396 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 06:59:26 s1lp14 stress-ng: memory (MB): total 19923.80, free 518.40, shared 2.07, buffer 0.37, swap 625.40, free swap 183.78 Mar 20 06:59:34 s1lp14 kernel: [345152.853456] master invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 06:59:34 s1lp14 kernel: [345152.853457] master cpuset=/ mems_allowed=0 Mar 20 06:59:34 s1lp14 kernel: [345152.853463] CPU: 6 PID: 116349 Comm: master Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 06:59:34 s1lp14 kernel: [345152.853464] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 06:59:34 s1lp14 kernel: [345152.853465] Call Trace: Mar 20 06:59:34 s1lp14 kernel: [345152.853474] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 06:59:34 s1lp14 kernel: [345152.853478] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 06:59:34 s1lp14 kernel: [345152.853482] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 06:59:34 s1lp14 kernel: [345152.853484] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 06:59:34 s1lp14 kernel: [345152.853486] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 06:59:34 s1lp14 kernel: [345152.853489] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 06:59:34 s1lp14 kernel: [345152.853491] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 06:59:34 s1lp14 kernel: [345152.853495] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 06:59:34 s1lp14 kernel: [345152.853500] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 06:59:34 s1lp14 kernel: [345152.853502] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 06:59:34 s1lp14 kernel: [345152.853504] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 06:59:34 s1lp14 kernel: [345152.853507] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 06:59:34 s1lp14 kernel: [345152.853510] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 06:59:34 s1lp14 kernel: [345152.853511] Mem-Info: Mar 20 06:59:34 s1lp14 kernel: [345152.853516] active_anon:4562434 inactive_anon:351464 isolated_anon:0 Mar 20 06:59:34 s1lp14 kernel: [345152.853516] active_file:82 inactive_file:177 isolated_file:0 Mar 20 06:59:34 s1lp14 kernel: [345152.853516] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 06:59:34 s1lp14 kernel: [345152.853516] slab_reclaimable:17336 slab_unreclaimable:40908 Mar 20 06:59:34 s1lp14 kernel: [345152.853516] mapped:2379 shmem:450 pagetables:21082 bounce:0 Mar 20 06:59:34 s1lp14 kernel: [345152.853516] free:23439 free_pcp:0 free_cma:0 Mar 20 06:59:34 s1lp14 kernel: [345152.853520] Node 0 active_anon:18249736kB inactive_anon:1405856kB active_file:328kB inactive_file:708kB unevictable:28396kB isolated(anon):0kB isolated(file):0kB mapped:9516kB dirty:0kB writeback:0kB shmem:1800kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 06:59:34 s1lp14 kernel: [345152.853521] Node 0 DMA free:73760kB min:2280kB low:4344kB high:6408kB active_anon:1870980kB inactive_anon:125140kB active_file:36kB inactive_file:16kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:32kB pagetables:8012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 06:59:34 s1lp14 kernel: [345152.853526] lowmem_reserve[]: 0 17889 17889 Mar 20 06:59:34 s1lp14 kernel: [345152.853529] Node 0 Normal free:19996kB min:20244kB low:38560kB high:56876kB active_anon:16378464kB inactive_anon:1280716kB active_file:292kB inactive_file:672kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8096kB pagetables:76316kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 06:59:34 s1lp14 kernel: [345152.853533] lowmem_reserve[]: 0 0 0 Mar 20 06:59:34 s1lp14 kernel: [345152.853536] Node 0 DMA: 191*4kB (UM) 106*8kB (UM) 126*16kB (UME) 38*32kB (UME) 6*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74220kB Mar 20 06:59:34 s1lp14 kernel: [345152.853547] Node 0 Normal: 1006*4kB (UME) 625*8kB (UME) 444*16kB (UME) 83*32kB (UM) 40*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 21344kB Mar 20 06:59:34 s1lp14 kernel: [345152.853559] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 06:59:34 s1lp14 kernel: [345152.853559] 21250 total pagecache pages Mar 20 06:59:34 s1lp14 kernel: [345152.853561] 18613 pages in swap cache Mar 20 06:59:34 s1lp14 kernel: [345152.853562] Swap cache stats: add 1778251, delete 1759593, find 9857/16474 Mar 20 06:59:34 s1lp14 kernel: [345152.853563] Free swap = 0kB Mar 20 06:59:34 s1lp14 kernel: [345152.853563] Total swap = 640412kB Mar 20 06:59:34 s1lp14 kernel: [345152.853564] 5242880 pages RAM Mar 20 06:59:34 s1lp14 kernel: [345152.853565] 0 pages HighMem/MovableOnly Mar 20 06:59:34 s1lp14 kernel: [345152.853565] 142387 pages reserved Mar 20 06:59:34 s1lp14 kernel: [345152.853566] 0 pages cma reserved Mar 20 06:59:34 s1lp14 kernel: [345152.853567] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 06:59:34 s1lp14 kernel: [345152.853570] [ 551] 0 551 10702 637 124928 269 0 systemd-journal Mar 20 06:59:34 s1lp14 kernel: [345152.853573] [ 635] 0 635 3774 464 86016 566 -1000 systemd-udevd Mar 20 06:59:34 s1lp14 kernel: [345152.853575] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 06:59:34 s1lp14 kernel: [345152.853576] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 06:59:34 s1lp14 kernel: [345152.853578] [ 1078] 100 1078 20782 491 100352 167 0 systemd-timesyn Mar 20 06:59:34 s1lp14 kernel: [345152.853580] [ 1132] 102 1132 2482 491 98304 196 0 systemd-resolve Mar 20 06:59:34 s1lp14 kernel: [345152.853582] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 06:59:34 s1lp14 kernel: [345152.853583] [ 1226] 0 1226 1547 436 79872 51 0 cron Mar 20 06:59:34 s1lp14 kernel: [345152.853585] [ 1229] 0 1229 2444 571 98304 198 0 systemd-logind Mar 20 06:59:34 s1lp14 kernel: [345152.853587] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 06:59:34 s1lp14 kernel: [345152.853589] [ 1255] 0 1255 58495 584 131072 216 0 accounts-daemon Mar 20 06:59:34 s1lp14 kernel: [345152.853591] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 06:59:34 s1lp14 kernel: [345152.853593] [ 1259] 0 1259 20060 424 83968 58 0 irqbalance Mar 20 06:59:34 s1lp14 kernel: [345152.853595] [ 1265] 0 1265 2673 588 83968 308 0 pkcsslotd Mar 20 06:59:34 s1lp14 kernel: [345152.853597] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 06:59:34 s1lp14 kernel: [345152.853598] [ 1433] 0 1433 1125 457 73728 39 0 iscsid Mar 20 06:59:34 s1lp14 kernel: [345152.853600] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 06:59:34 s1lp14 kernel: [345152.853601] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 06:59:34 s1lp14 kernel: [345152.853603] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 06:59:34 s1lp14 kernel: [345152.853605] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 06:59:34 s1lp14 kernel: [345152.853607] [ 7772] 101 7772 2793 554 100352 196 0 systemd-network Mar 20 06:59:34 s1lp14 kernel: [345152.853609] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 06:59:34 s1lp14 kernel: [345152.853611] [66598] 0 66598 394264 9 253952 2423 -900 snapd Mar 20 06:59:34 s1lp14 kernel: [345152.853613] [113723] 0 113723 2359 475 88064 116 0 wpa_supplicant Mar 20 06:59:34 s1lp14 kernel: [345152.853614] [116349] 0 116349 8972 394 83968 110 0 master Mar 20 06:59:34 s1lp14 kernel: [345152.853616] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 06:59:34 s1lp14 kernel: [345152.853617] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 06:59:34 s1lp14 kernel: [345152.853619] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 06:59:34 s1lp14 kernel: [345152.853621] [117440] 103 117440 54882 697 98304 138 0 rsyslogd Mar 20 06:59:34 s1lp14 kernel: [345152.853623] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 06:59:34 s1lp14 kernel: [345152.853625] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 06:59:34 s1lp14 kernel: [345152.853626] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 06:59:34 s1lp14 kernel: [345152.853628] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 06:59:34 s1lp14 kernel: [345152.853630] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 06:59:34 s1lp14 kernel: [345152.853632] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 06:59:34 s1lp14 kernel: [345152.853634] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 06:59:34 s1lp14 kernel: [345152.853635] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 06:59:34 s1lp14 kernel: [345152.853637] [70732] 111 70732 9042 323 88064 125 0 pickup Mar 20 06:59:34 s1lp14 kernel: [345152.853639] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 06:59:34 s1lp14 kernel: [345152.853641] [190296] 0 190296 3262 351 104448 65 -1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853643] [190297] 0 190297 3262 273 102400 57 -1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853645] [190298] 0 190298 3262 311 102400 53 -1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853647] [190299] 0 190299 3262 293 102400 61 -1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853649] [190300] 0 190300 3262 249 102400 54 -1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853650] [190302] 0 190302 3262 278 102400 67 -1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853652] [190304] 0 190304 3262 253 102400 64 -1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853654] [190307] 0 190307 3262 313 102400 53 -1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853656] [190308] 0 190308 3262 242 102400 52 -1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853658] [190397] 0 190397 1373794 1234292 11116544 136379 1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853660] [190398] 0 190398 748465 745278 6080512 62 1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853661] [190399] 0 190399 958542 955314 7778304 54 1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853663] [190404] 0 190404 500231 496990 4096000 51 1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853665] [190405] 0 190405 884393 881215 7184384 51 1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853668] [190410] 0 190410 347910 344679 2877440 51 1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853669] [190412] 0 190412 236518 233343 1968128 51 1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853671] [190416] 0 190416 6973 3793 133120 51 1000 stress-ng Mar 20 06:59:34 s1lp14 kernel: [345152.853672] Out of memory: Kill process 190397 (stress-ng) score 1253 or sacrifice child Mar 20 06:59:34 s1lp14 kernel: [345152.853680] Killed process 190397 (stress-ng) total-vm:5495176kB, anon-rss:4936928kB, file-rss:236kB, shmem-rss:4kB Mar 20 06:59:34 s1lp14 kernel: [345153.954800] oom_reaper: reaped process 190397 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 06:59:36 s1lp14 stress-ng: memory (MB): total 19923.80, free 173.38, shared 0.55, buffer 0.48, swap 625.40, free swap 384.59 Mar 20 06:59:49 s1lp14 kernel: [345168.913385] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 06:59:49 s1lp14 kernel: [345168.913386] stress-ng cpuset=/ mems_allowed=0 Mar 20 06:59:49 s1lp14 kernel: [345168.913390] CPU: 4 PID: 190416 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 06:59:49 s1lp14 kernel: [345168.913390] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 06:59:49 s1lp14 kernel: [345168.913391] Call Trace: Mar 20 06:59:49 s1lp14 kernel: [345168.913399] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 06:59:49 s1lp14 kernel: [345168.913403] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 06:59:49 s1lp14 kernel: [345168.913407] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 06:59:49 s1lp14 kernel: [345168.913408] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 06:59:49 s1lp14 kernel: [345168.913408] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 06:59:49 s1lp14 kernel: [345168.913411] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 06:59:49 s1lp14 kernel: [345168.913413] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 06:59:49 s1lp14 kernel: [345168.913416] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 06:59:49 s1lp14 kernel: [345168.913417] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 06:59:49 s1lp14 kernel: [345168.913418] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 06:59:49 s1lp14 kernel: [345168.913421] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 06:59:49 s1lp14 kernel: [345168.913424] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 06:59:49 s1lp14 kernel: [345168.913424] Mem-Info: Mar 20 06:59:49 s1lp14 kernel: [345168.913427] active_anon:4562267 inactive_anon:351625 isolated_anon:0 Mar 20 06:59:49 s1lp14 kernel: [345168.913427] active_file:44 inactive_file:156 isolated_file:0 Mar 20 06:59:49 s1lp14 kernel: [345168.913427] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 06:59:49 s1lp14 kernel: [345168.913427] slab_reclaimable:17534 slab_unreclaimable:40879 Mar 20 06:59:49 s1lp14 kernel: [345168.913427] mapped:2239 shmem:344 pagetables:21082 bounce:0 Mar 20 06:59:49 s1lp14 kernel: [345168.913427] free:23448 free_pcp:399 free_cma:0 Mar 20 06:59:49 s1lp14 kernel: [345168.913429] Node 0 active_anon:18249068kB inactive_anon:1406500kB active_file:176kB inactive_file:624kB unevictable:28396kB isolated(anon):0kB isolated(file):0kB mapped:8956kB dirty:0kB writeback:0kB shmem:1376kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 06:59:49 s1lp14 kernel: [345168.913430] Node 0 DMA free:73588kB min:2280kB low:4344kB high:6408kB active_anon:1865296kB inactive_anon:131244kB active_file:8kB inactive_file:16kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:48kB pagetables:8008kB bounce:0kB free_pcp:360kB local_pcp:0kB free_cma:0kB Mar 20 06:59:49 s1lp14 kernel: [345168.913433] lowmem_reserve[]: 0 17889 17889 Mar 20 06:59:49 s1lp14 kernel: [345168.913434] Node 0 Normal free:20204kB min:20244kB low:38560kB high:56876kB active_anon:16383772kB inactive_anon:1275256kB active_file:168kB inactive_file:316kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8080kB pagetables:76320kB bounce:0kB free_pcp:1236kB local_pcp:296kB free_cma:0kB Mar 20 06:59:49 s1lp14 kernel: [345168.913437] lowmem_reserve[]: 0 0 0 Mar 20 06:59:49 s1lp14 kernel: [345168.913438] Node 0 DMA: 129*4kB (U) 100*8kB (U) 85*16kB (UME) 42*32kB (UME) 9*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73588kB Mar 20 06:59:49 s1lp14 kernel: [345168.913444] Node 0 Normal: 559*4kB (UME) 768*8kB (UE) 526*16kB (UME) 83*32kB (UME) 4*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 19708kB Mar 20 06:59:49 s1lp14 kernel: [345168.913450] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 06:59:49 s1lp14 kernel: [345168.913451] 20592 total pagecache pages Mar 20 06:59:49 s1lp14 kernel: [345168.913451] 18135 pages in swap cache Mar 20 06:59:49 s1lp14 kernel: [345168.913452] Swap cache stats: add 1938543, delete 1920308, find 10328/17156 Mar 20 06:59:49 s1lp14 kernel: [345168.913452] Free swap = 0kB Mar 20 06:59:49 s1lp14 kernel: [345168.913452] Total swap = 640412kB Mar 20 06:59:49 s1lp14 kernel: [345168.913453] 5242880 pages RAM Mar 20 06:59:49 s1lp14 kernel: [345168.913453] 0 pages HighMem/MovableOnly Mar 20 06:59:49 s1lp14 kernel: [345168.913453] 142387 pages reserved Mar 20 06:59:49 s1lp14 kernel: [345168.913454] 0 pages cma reserved Mar 20 06:59:49 s1lp14 kernel: [345168.913454] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 06:59:49 s1lp14 kernel: [345168.913456] [ 551] 0 551 10702 478 124928 272 0 systemd-journal Mar 20 06:59:49 s1lp14 kernel: [345168.913457] [ 635] 0 635 3774 462 86016 568 -1000 systemd-udevd Mar 20 06:59:49 s1lp14 kernel: [345168.913458] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 06:59:49 s1lp14 kernel: [345168.913459] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 06:59:49 s1lp14 kernel: [345168.913460] [ 1078] 100 1078 20782 491 100352 171 0 systemd-timesyn Mar 20 06:59:49 s1lp14 kernel: [345168.913461] [ 1132] 102 1132 2482 491 98304 201 0 systemd-resolve Mar 20 06:59:49 s1lp14 kernel: [345168.913462] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 06:59:49 s1lp14 kernel: [345168.913463] [ 1226] 0 1226 1547 424 79872 63 0 cron Mar 20 06:59:49 s1lp14 kernel: [345168.913464] [ 1229] 0 1229 2444 571 98304 200 0 systemd-logind Mar 20 06:59:49 s1lp14 kernel: [345168.913464] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 06:59:49 s1lp14 kernel: [345168.913465] [ 1255] 0 1255 58495 597 131072 218 0 accounts-daemon Mar 20 06:59:49 s1lp14 kernel: [345168.913466] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 06:59:49 s1lp14 kernel: [345168.913467] [ 1259] 0 1259 20060 465 83968 86 0 irqbalance Mar 20 06:59:49 s1lp14 kernel: [345168.913468] [ 1265] 0 1265 2673 544 83968 315 0 pkcsslotd Mar 20 06:59:49 s1lp14 kernel: [345168.913469] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 06:59:49 s1lp14 kernel: [345168.913470] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 06:59:49 s1lp14 kernel: [345168.913470] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 06:59:49 s1lp14 kernel: [345168.913471] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 06:59:49 s1lp14 kernel: [345168.913472] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 06:59:49 s1lp14 kernel: [345168.913473] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 06:59:49 s1lp14 kernel: [345168.913474] [ 7772] 101 7772 2793 566 100352 195 0 systemd-network Mar 20 06:59:49 s1lp14 kernel: [345168.913475] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 06:59:49 s1lp14 kernel: [345168.913476] [66598] 0 66598 394264 14 253952 2440 -900 snapd Mar 20 06:59:49 s1lp14 kernel: [345168.913477] [113723] 0 113723 2359 423 88064 132 0 wpa_supplicant Mar 20 06:59:49 s1lp14 kernel: [345168.913478] [116349] 0 116349 8972 432 83968 115 0 master Mar 20 06:59:49 s1lp14 kernel: [345168.913479] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 06:59:49 s1lp14 kernel: [345168.913479] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 06:59:49 s1lp14 kernel: [345168.913480] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 06:59:49 s1lp14 kernel: [345168.913481] [117440] 103 117440 54882 650 98304 167 0 rsyslogd Mar 20 06:59:49 s1lp14 kernel: [345168.913482] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 06:59:49 s1lp14 kernel: [345168.913483] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 06:59:49 s1lp14 kernel: [345168.913484] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 06:59:49 s1lp14 kernel: [345168.913485] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 06:59:49 s1lp14 kernel: [345168.913486] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 06:59:49 s1lp14 kernel: [345168.913486] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 06:59:49 s1lp14 kernel: [345168.913487] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 06:59:49 s1lp14 kernel: [345168.913488] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 06:59:49 s1lp14 kernel: [345168.913489] [70732] 111 70732 9042 417 88064 126 0 pickup Mar 20 06:59:49 s1lp14 kernel: [345168.913490] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 06:59:49 s1lp14 kernel: [345168.913491] [190296] 0 190296 3262 402 104448 65 -1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913492] [190297] 0 190297 3262 273 102400 57 -1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913493] [190298] 0 190298 3262 304 102400 60 -1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913494] [190299] 0 190299 3262 293 102400 61 -1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913495] [190300] 0 190300 3262 242 102400 61 -1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913496] [190302] 0 190302 3262 314 102400 52 -1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913497] [190304] 0 190304 3262 250 102400 67 -1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913498] [190307] 0 190307 3262 313 102400 53 -1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913499] [190308] 0 190308 3262 242 102400 52 -1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913500] [190398] 0 190398 878097 738712 7135232 136229 1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913501] [190399] 0 190399 1190913 1187686 9635840 54 1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913501] [190404] 0 190404 710884 707647 5779456 51 1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913502] [190405] 0 190405 1222721 1219539 9891840 51 1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913503] [190410] 0 190410 515221 511993 4214784 51 1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913504] [190412] 0 190412 403877 400693 3323904 58 1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913505] [190416] 0 190416 125524 122331 1081344 58 1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913506] [190418] 0 190418 9960 6782 155648 51 1000 stress-ng Mar 20 06:59:49 s1lp14 kernel: [345168.913506] Out of memory: Kill process 190405 (stress-ng) score 1225 or sacrifice child Mar 20 06:59:49 s1lp14 kernel: [345168.913512] Killed process 190405 (stress-ng) total-vm:4890884kB, anon-rss:4877944kB, file-rss:208kB, shmem-rss:4kB Mar 20 06:59:50 s1lp14 kernel: [345169.994509] oom_reaper: reaped process 190405 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 06:59:50 s1lp14 stress-ng: memory (MB): total 19923.80, free 305.00, shared 3.59, buffer 0.34, swap 625.40, free swap 0.00 Mar 20 06:59:51 s1lp14 kernel: [345170.163470] systemd-journal invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 06:59:51 s1lp14 kernel: [345170.163471] systemd-journal cpuset=/ mems_allowed=0 Mar 20 06:59:51 s1lp14 kernel: [345170.163476] CPU: 7 PID: 551 Comm: systemd-journal Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 06:59:51 s1lp14 kernel: [345170.163476] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 06:59:51 s1lp14 kernel: [345170.163477] Call Trace: Mar 20 06:59:51 s1lp14 kernel: [345170.163485] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 06:59:51 s1lp14 kernel: [345170.163489] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 06:59:51 s1lp14 kernel: [345170.163493] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 06:59:51 s1lp14 kernel: [345170.163494] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 06:59:51 s1lp14 kernel: [345170.163494] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 06:59:51 s1lp14 kernel: [345170.163497] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 06:59:51 s1lp14 kernel: [345170.163497] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 06:59:51 s1lp14 kernel: [345170.163501] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 06:59:51 s1lp14 kernel: [345170.163505] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 06:59:51 s1lp14 kernel: [345170.163507] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 06:59:51 s1lp14 kernel: [345170.163507] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 06:59:51 s1lp14 kernel: [345170.163510] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 06:59:51 s1lp14 kernel: [345170.163513] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 06:59:51 s1lp14 kernel: [345170.163513] Mem-Info: Mar 20 06:59:51 s1lp14 kernel: [345170.163516] active_anon:4562012 inactive_anon:351958 isolated_anon:0 Mar 20 06:59:51 s1lp14 kernel: [345170.163516] active_file:131 inactive_file:108 isolated_file:0 Mar 20 06:59:51 s1lp14 kernel: [345170.163516] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 06:59:51 s1lp14 kernel: [345170.163516] slab_reclaimable:17542 slab_unreclaimable:40863 Mar 20 06:59:51 s1lp14 kernel: [345170.163516] mapped:2877 shmem:920 pagetables:21023 bounce:0 Mar 20 06:59:51 s1lp14 kernel: [345170.163516] free:23299 free_pcp:169 free_cma:0 Mar 20 06:59:51 s1lp14 kernel: [345170.163519] Node 0 active_anon:18248048kB inactive_anon:1407832kB active_file:524kB inactive_file:432kB unevictable:28396kB isolated(anon):0kB isolated(file):0kB mapped:11508kB dirty:0kB writeback:0kB shmem:3680kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 06:59:51 s1lp14 kernel: [345170.163520] Node 0 DMA free:73660kB min:2280kB low:4344kB high:6408kB active_anon:1883348kB inactive_anon:112652kB active_file:0kB inactive_file:56kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:48kB pagetables:7896kB bounce:0kB free_pcp:224kB local_pcp:20kB free_cma:0kB Mar 20 06:59:51 s1lp14 kernel: [345170.163522] lowmem_reserve[]: 0 17889 17889 Mar 20 06:59:51 s1lp14 kernel: [345170.163524] Node 0 Normal free:19536kB min:20244kB low:38560kB high:56876kB active_anon:16364400kB inactive_anon:1295180kB active_file:352kB inactive_file:440kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8064kB pagetables:76196kB bounce:0kB free_pcp:452kB local_pcp:248kB free_cma:0kB Mar 20 06:59:51 s1lp14 kernel: [345170.163526] lowmem_reserve[]: 0 0 0 Mar 20 06:59:51 s1lp14 kernel: [345170.163527] Node 0 DMA: 84*4kB (UM) 98*8kB (UM) 77*16kB (UE) 47*32kB (UME) 13*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73680kB Mar 20 06:59:51 s1lp14 kernel: [345170.163533] Node 0 Normal: 740*4kB (UME) 639*8kB (UE) 403*16kB (UE) 79*32kB (UM) 47*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 20056kB Mar 20 06:59:51 s1lp14 kernel: [345170.163539] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 06:59:51 s1lp14 kernel: [345170.163539] 21168 total pagecache pages Mar 20 06:59:51 s1lp14 kernel: [345170.163540] 18060 pages in swap cache Mar 20 06:59:51 s1lp14 kernel: [345170.163541] Swap cache stats: add 1940004, delete 1921844, find 10763/17847 Mar 20 06:59:51 s1lp14 kernel: [345170.163541] Free swap = 0kB Mar 20 06:59:51 s1lp14 kernel: [345170.163541] Total swap = 640412kB Mar 20 06:59:51 s1lp14 kernel: [345170.163541] 5242880 pages RAM Mar 20 06:59:51 s1lp14 kernel: [345170.163542] 0 pages HighMem/MovableOnly Mar 20 06:59:51 s1lp14 kernel: [345170.163542] 142387 pages reserved Mar 20 06:59:51 s1lp14 kernel: [345170.163542] 0 pages cma reserved Mar 20 06:59:51 s1lp14 kernel: [345170.163543] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 06:59:51 s1lp14 kernel: [345170.163545] [ 551] 0 551 10702 409 124928 271 0 systemd-journal Mar 20 06:59:51 s1lp14 kernel: [345170.163546] [ 635] 0 635 3774 462 86016 568 -1000 systemd-udevd Mar 20 06:59:51 s1lp14 kernel: [345170.163547] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 06:59:51 s1lp14 kernel: [345170.163548] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 06:59:51 s1lp14 kernel: [345170.163549] [ 1078] 100 1078 20782 491 100352 171 0 systemd-timesyn Mar 20 06:59:51 s1lp14 kernel: [345170.163550] [ 1132] 102 1132 2482 491 98304 201 0 systemd-resolve Mar 20 06:59:51 s1lp14 kernel: [345170.163551] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 06:59:51 s1lp14 kernel: [345170.163552] [ 1226] 0 1226 1547 424 79872 63 0 cron Mar 20 06:59:51 s1lp14 kernel: [345170.163552] [ 1229] 0 1229 2444 571 98304 200 0 systemd-logind Mar 20 06:59:51 s1lp14 kernel: [345170.163553] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 06:59:51 s1lp14 kernel: [345170.163554] [ 1255] 0 1255 58495 230 131072 217 0 accounts-daemon Mar 20 06:59:51 s1lp14 kernel: [345170.163555] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 06:59:51 s1lp14 kernel: [345170.163556] [ 1259] 0 1259 20060 501 83968 67 0 irqbalance Mar 20 06:59:51 s1lp14 kernel: [345170.163557] [ 1265] 0 1265 2673 1090 83968 315 0 pkcsslotd Mar 20 06:59:51 s1lp14 kernel: [345170.163557] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 06:59:51 s1lp14 kernel: [345170.163558] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 06:59:51 s1lp14 kernel: [345170.163559] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 06:59:51 s1lp14 kernel: [345170.163560] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 06:59:51 s1lp14 kernel: [345170.163561] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 06:59:51 s1lp14 kernel: [345170.163562] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 06:59:51 s1lp14 kernel: [345170.163563] [ 7772] 101 7772 2793 555 100352 206 0 systemd-network Mar 20 06:59:51 s1lp14 kernel: [345170.163564] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 06:59:51 s1lp14 kernel: [345170.163565] [66598] 0 66598 394264 14 253952 2449 -900 snapd Mar 20 06:59:51 s1lp14 kernel: [345170.163565] [113723] 0 113723 2359 423 88064 134 0 wpa_supplicant Mar 20 06:59:51 s1lp14 kernel: [345170.163566] [116349] 0 116349 8972 432 83968 115 0 master Mar 20 06:59:51 s1lp14 kernel: [345170.163567] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 06:59:51 s1lp14 kernel: [345170.163568] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 06:59:51 s1lp14 kernel: [345170.163569] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 06:59:51 s1lp14 kernel: [345170.163570] [117440] 103 117440 54882 585 98304 144 0 rsyslogd Mar 20 06:59:51 s1lp14 kernel: [345170.163571] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 06:59:51 s1lp14 kernel: [345170.163572] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 06:59:51 s1lp14 kernel: [345170.163572] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 06:59:51 s1lp14 kernel: [345170.163573] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 06:59:51 s1lp14 kernel: [345170.163574] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 06:59:51 s1lp14 kernel: [345170.163575] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 06:59:51 s1lp14 kernel: [345170.163576] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 06:59:51 s1lp14 kernel: [345170.163576] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 06:59:51 s1lp14 kernel: [345170.163577] [70732] 111 70732 9042 417 88064 126 0 pickup Mar 20 06:59:51 s1lp14 kernel: [345170.163578] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 06:59:51 s1lp14 kernel: [345170.163579] [190296] 0 190296 3262 434 104448 65 -1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163580] [190297] 0 190297 3262 273 102400 57 -1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163581] [190298] 0 190298 3262 304 102400 60 -1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163582] [190299] 0 190299 3262 248 102400 60 -1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163583] [190300] 0 190300 3262 242 102400 61 -1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163584] [190302] 0 190302 3262 314 102400 52 -1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163585] [190304] 0 190304 3262 250 102400 67 -1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163586] [190307] 0 190307 3262 313 102400 53 -1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163587] [190308] 0 190308 3262 242 102400 52 -1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163588] [190398] 0 190398 1079020 939193 8740864 136702 1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163588] [190399] 0 190399 1350330 1347025 10928128 183 1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163589] [190404] 0 190404 914438 911260 7426048 51 1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163590] [190410] 0 190410 676242 673064 5502976 51 1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163591] [190412] 0 190412 488967 485786 4005888 58 1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163592] [190416] 0 190416 405805 402619 3340288 58 1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163593] [190418] 0 190418 128487 125314 1103872 51 1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163593] [190423] 0 190423 14061 10885 188416 51 1000 stress-ng Mar 20 06:59:51 s1lp14 kernel: [345170.163594] Out of memory: Kill process 190399 (stress-ng) score 1248 or sacrifice child Mar 20 06:59:51 s1lp14 kernel: [345170.163600] Killed process 190399 (stress-ng) total-vm:5401320kB, anon-rss:5387856kB, file-rss:240kB, shmem-rss:4kB Mar 20 06:59:52 s1lp14 kernel: [345171.701379] oom_reaper: reaped process 190399 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:4kB Mar 20 06:59:52 s1lp14 kernel: [345171.759515] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 06:59:52 s1lp14 kernel: [345171.759518] stress-ng cpuset=/ mems_allowed=0 Mar 20 06:59:52 s1lp14 kernel: [345171.759526] CPU: 0 PID: 190423 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 06:59:52 s1lp14 kernel: [345171.759527] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 06:59:52 s1lp14 kernel: [345171.759528] Call Trace: Mar 20 06:59:52 s1lp14 kernel: [345171.759537] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 06:59:52 s1lp14 kernel: [345171.759542] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 06:59:52 s1lp14 kernel: [345171.759546] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 06:59:52 s1lp14 kernel: [345171.759548] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 06:59:52 s1lp14 kernel: [345171.759550] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 06:59:52 s1lp14 kernel: [345171.759553] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 06:59:52 s1lp14 kernel: [345171.759557] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 06:59:52 s1lp14 kernel: [345171.759561] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 06:59:52 s1lp14 kernel: [345171.759562] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 06:59:52 s1lp14 kernel: [345171.759564] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 06:59:52 s1lp14 kernel: [345171.759568] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 06:59:52 s1lp14 kernel: [345171.759571] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 06:59:52 s1lp14 kernel: [345171.759572] Mem-Info: Mar 20 06:59:52 s1lp14 kernel: [345171.759577] active_anon:4622892 inactive_anon:285938 isolated_anon:0 Mar 20 06:59:52 s1lp14 kernel: [345171.759577] active_file:64 inactive_file:86 isolated_file:2 Mar 20 06:59:52 s1lp14 kernel: [345171.759577] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 06:59:52 s1lp14 kernel: [345171.759577] slab_reclaimable:17542 slab_unreclaimable:40935 Mar 20 06:59:52 s1lp14 kernel: [345171.759577] mapped:2763 shmem:894 pagetables:26235 bounce:0 Mar 20 06:59:52 s1lp14 kernel: [345171.759577] free:23407 free_pcp:0 free_cma:0 Mar 20 06:59:52 s1lp14 kernel: [345171.759582] Node 0 active_anon:18491568kB inactive_anon:1143752kB active_file:256kB inactive_file:344kB unevictable:28396kB isolated(anon):0kB isolated(file):8kB mapped:11052kB dirty:0kB writeback:0kB shmem:3576kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 06:59:52 s1lp14 kernel: [345171.759583] Node 0 DMA free:73716kB min:2280kB low:4344kB high:6408kB active_anon:1868640kB inactive_anon:125488kB active_file:88kB inactive_file:156kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:48kB pagetables:9880kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 06:59:52 s1lp14 kernel: [345171.759587] lowmem_reserve[]: 0 17889 17889 Mar 20 06:59:52 s1lp14 kernel: [345171.759591] Node 0 Normal free:19912kB min:20244kB low:38560kB high:56876kB active_anon:16623356kB inactive_anon:1016360kB active_file:168kB inactive_file:188kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8064kB pagetables:95060kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 06:59:52 s1lp14 kernel: [345171.759595] lowmem_reserve[]: 0 0 0 Mar 20 06:59:52 s1lp14 kernel: [345171.759597] Node 0 DMA: 241*4kB (UM) 6*8kB (UM) 27*16kB (UME) 46*32kB (UE) 38*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74340kB Mar 20 06:59:52 s1lp14 kernel: [345171.759612] Node 0 Normal: 205*4kB (UME) 347*8kB (UME) 300*16kB (UME) 365*32kB (UME) 6*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 20460kB Mar 20 06:59:52 s1lp14 kernel: [345171.759624] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 06:59:52 s1lp14 kernel: [345171.759624] 21035 total pagecache pages Mar 20 06:59:52 s1lp14 kernel: [345171.759626] 18089 pages in swap cache Mar 20 06:59:52 s1lp14 kernel: [345171.759627] Swap cache stats: add 1940143, delete 1921954, find 10765/17849 Mar 20 06:59:52 s1lp14 kernel: [345171.759628] Free swap = 0kB Mar 20 06:59:52 s1lp14 kernel: [345171.759628] Total swap = 640412kB Mar 20 06:59:52 s1lp14 kernel: [345171.759629] 5242880 pages RAM Mar 20 06:59:52 s1lp14 kernel: [345171.759630] 0 pages HighMem/MovableOnly Mar 20 06:59:52 s1lp14 kernel: [345171.759631] 142387 pages reserved Mar 20 06:59:52 s1lp14 kernel: [345171.759631] 0 pages cma reserved Mar 20 06:59:52 s1lp14 kernel: [345171.759632] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 06:59:52 s1lp14 kernel: [345171.759636] [ 551] 0 551 10702 628 124928 274 0 systemd-journal Mar 20 06:59:52 s1lp14 kernel: [345171.759638] [ 635] 0 635 3774 462 86016 568 -1000 systemd-udevd Mar 20 06:59:52 s1lp14 kernel: [345171.759641] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 06:59:52 s1lp14 kernel: [345171.759643] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 06:59:52 s1lp14 kernel: [345171.759645] [ 1078] 100 1078 20782 491 100352 171 0 systemd-timesyn Mar 20 06:59:52 s1lp14 kernel: [345171.759647] [ 1132] 102 1132 2482 491 98304 201 0 systemd-resolve Mar 20 06:59:52 s1lp14 kernel: [345171.759648] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 06:59:52 s1lp14 kernel: [345171.759650] [ 1226] 0 1226 1547 421 79872 66 0 cron Mar 20 06:59:52 s1lp14 kernel: [345171.759651] [ 1229] 0 1229 2444 571 98304 200 0 systemd-logind Mar 20 06:59:52 s1lp14 kernel: [345171.759653] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 06:59:52 s1lp14 kernel: [345171.759655] [ 1255] 0 1255 58495 598 131072 217 0 accounts-daemon Mar 20 06:59:52 s1lp14 kernel: [345171.759657] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 06:59:52 s1lp14 kernel: [345171.759659] [ 1259] 0 1259 20060 498 83968 70 0 irqbalance Mar 20 06:59:52 s1lp14 kernel: [345171.759661] [ 1265] 0 1265 2673 1065 83968 315 0 pkcsslotd Mar 20 06:59:52 s1lp14 kernel: [345171.759663] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 06:59:52 s1lp14 kernel: [345171.759665] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 06:59:52 s1lp14 kernel: [345171.759667] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 06:59:52 s1lp14 kernel: [345171.759668] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 06:59:52 s1lp14 kernel: [345171.759670] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 06:59:52 s1lp14 kernel: [345171.759672] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 06:59:52 s1lp14 kernel: [345171.759675] [ 7772] 101 7772 2793 555 100352 208 0 systemd-network Mar 20 06:59:52 s1lp14 kernel: [345171.759677] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 06:59:52 s1lp14 kernel: [345171.759679] [66598] 0 66598 394264 14 253952 2461 -900 snapd Mar 20 06:59:52 s1lp14 kernel: [345171.759680] [113723] 0 113723 2359 423 88064 136 0 wpa_supplicant Mar 20 06:59:52 s1lp14 kernel: [345171.759682] [116349] 0 116349 8972 431 83968 116 0 master Mar 20 06:59:52 s1lp14 kernel: [345171.759684] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 06:59:52 s1lp14 kernel: [345171.759685] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 06:59:52 s1lp14 kernel: [345171.759687] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 06:59:52 s1lp14 kernel: [345171.759689] [117440] 103 117440 54882 385 98304 144 0 rsyslogd Mar 20 06:59:52 s1lp14 kernel: [345171.759691] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 06:59:52 s1lp14 kernel: [345171.759692] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 06:59:52 s1lp14 kernel: [345171.759694] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 06:59:52 s1lp14 kernel: [345171.759696] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 06:59:52 s1lp14 kernel: [345171.759698] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 06:59:52 s1lp14 kernel: [345171.759700] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 06:59:52 s1lp14 kernel: [345171.759702] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 06:59:52 s1lp14 kernel: [345171.759704] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 06:59:52 s1lp14 kernel: [345171.759705] [70732] 111 70732 9042 417 88064 126 0 pickup Mar 20 06:59:52 s1lp14 kernel: [345171.759707] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 06:59:52 s1lp14 kernel: [345171.759708] [190296] 0 190296 3262 444 104448 65 -1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759709] [190297] 0 190297 3262 271 102400 57 -1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759711] [190298] 0 190298 3262 304 102400 60 -1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759713] [190299] 0 190299 3262 247 102400 60 -1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759714] [190300] 0 190300 3262 242 102400 61 -1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759715] [190302] 0 190302 3262 314 102400 52 -1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759717] [190304] 0 190304 3262 250 102400 67 -1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759718] [190307] 0 190307 3262 313 102400 53 -1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759720] [190308] 0 190308 3262 242 102400 52 -1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759723] [190398] 0 190398 1221921 1082015 9885696 136777 1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759724] [190404] 0 190404 1158330 1155153 9375744 51 1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759727] [190410] 0 190410 901102 897924 7317504 51 1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759729] [190412] 0 190412 632329 629145 5152768 58 1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759731] [190416] 0 190416 628232 625050 5120000 58 1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759733] [190418] 0 190418 216338 213163 1808384 51 1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759735] [190423] 0 190423 290574 287398 2418688 51 1000 stress-ng Mar 20 06:59:52 s1lp14 kernel: [345171.759736] Out of memory: Kill process 190398 (stress-ng) score 1225 or sacrifice child Mar 20 06:59:52 s1lp14 kernel: [345171.759744] Killed process 190398 (stress-ng) total-vm:4887684kB, anon-rss:4327820kB, file-rss:236kB, shmem-rss:4kB Mar 20 06:59:53 s1lp14 kernel: [345172.216814] oom_reaper: reaped process 190398 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 06:59:53 s1lp14 stress-ng: memory (MB): total 19923.80, free 1283.92, shared 2.17, buffer 0.32, swap 625.40, free swap 482.75 Mar 20 06:59:53 s1lp14 stress-ng: memory (MB): total 19923.80, free 1933.07, shared 2.17, buffer 0.32, swap 625.40, free swap 505.50 Mar 20 07:00:08 s1lp14 kernel: [345187.174856] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:00:08 s1lp14 kernel: [345187.174858] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:00:08 s1lp14 kernel: [345187.174866] CPU: 0 PID: 190423 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:00:08 s1lp14 kernel: [345187.174867] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:00:08 s1lp14 kernel: [345187.174868] Call Trace: Mar 20 07:00:08 s1lp14 kernel: [345187.174879] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:00:08 s1lp14 kernel: [345187.174884] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:00:08 s1lp14 kernel: [345187.174889] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:00:08 s1lp14 kernel: [345187.174890] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:00:08 s1lp14 kernel: [345187.174892] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:00:08 s1lp14 kernel: [345187.174895] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:00:08 s1lp14 kernel: [345187.174899] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:00:08 s1lp14 kernel: [345187.174903] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:00:08 s1lp14 kernel: [345187.174905] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:00:08 s1lp14 kernel: [345187.174906] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:00:08 s1lp14 kernel: [345187.174909] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:00:08 s1lp14 kernel: [345187.174913] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:00:08 s1lp14 kernel: [345187.174914] Mem-Info: Mar 20 07:00:08 s1lp14 kernel: [345187.174919] active_anon:4562596 inactive_anon:351128 isolated_anon:252 Mar 20 07:00:08 s1lp14 kernel: [345187.174919] active_file:217 inactive_file:201 isolated_file:0 Mar 20 07:00:08 s1lp14 kernel: [345187.174919] unevictable:7099 dirty:0 writeback:74 unstable:0 Mar 20 07:00:08 s1lp14 kernel: [345187.174919] slab_reclaimable:17374 slab_unreclaimable:40936 Mar 20 07:00:08 s1lp14 kernel: [345187.174919] mapped:2270 shmem:167 pagetables:21077 bounce:0 Mar 20 07:00:08 s1lp14 kernel: [345187.174919] free:23465 free_pcp:0 free_cma:0 Mar 20 07:00:08 s1lp14 kernel: [345187.174923] Node 0 active_anon:18250384kB inactive_anon:1404512kB active_file:868kB inactive_file:804kB unevictable:28396kB isolated(anon):1008kB isolated(file):0kB mapped:9080kB dirty:0kB writeback:296kB shmem:668kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:00:08 s1lp14 kernel: [345187.174924] Node 0 DMA free:73732kB min:2280kB low:4344kB high:6408kB active_anon:1848932kB inactive_anon:147276kB active_file:0kB inactive_file:112kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:48kB pagetables:8020kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:00:08 s1lp14 kernel: [345187.174929] lowmem_reserve[]: 0 17889 17889 Mar 20 07:00:08 s1lp14 kernel: [345187.174933] Node 0 Normal free:20128kB min:20244kB low:38560kB high:56876kB active_anon:16403264kB inactive_anon:1255288kB active_file:736kB inactive_file:968kB unevictable:28396kB writepending:128kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8080kB pagetables:76288kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:00:08 s1lp14 kernel: [345187.174937] lowmem_reserve[]: 0 0 0 Mar 20 07:00:08 s1lp14 kernel: [345187.174940] Node 0 DMA: 222*4kB (UM) 146*8kB (UM) 59*16kB (UME) 67*32kB (UME) 5*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74456kB Mar 20 07:00:08 s1lp14 kernel: [345187.174953] Node 0 Normal: 370*4kB (UM) 1041*8kB (UME) 489*16kB (UME) 105*32kB (UME) 16*64kB (UME) 0*128kB 0*256kB 0*512kB 0*1024kB = 22016kB Mar 20 07:00:08 s1lp14 kernel: [345187.174965] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:00:08 s1lp14 kernel: [345187.174966] 20710 total pagecache pages Mar 20 07:00:08 s1lp14 kernel: [345187.174967] 18268 pages in swap cache Mar 20 07:00:08 s1lp14 kernel: [345187.174968] Swap cache stats: add 2111279, delete 2092882, find 10923/18232 Mar 20 07:00:08 s1lp14 kernel: [345187.174969] Free swap = 0kB Mar 20 07:00:08 s1lp14 kernel: [345187.174970] Total swap = 640412kB Mar 20 07:00:08 s1lp14 kernel: [345187.174970] 5242880 pages RAM Mar 20 07:00:08 s1lp14 kernel: [345187.174971] 0 pages HighMem/MovableOnly Mar 20 07:00:08 s1lp14 kernel: [345187.174972] 142387 pages reserved Mar 20 07:00:08 s1lp14 kernel: [345187.174973] 0 pages cma reserved Mar 20 07:00:08 s1lp14 kernel: [345187.174973] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:00:08 s1lp14 kernel: [345187.174978] [ 551] 0 551 10702 674 124928 258 0 systemd-journal Mar 20 07:00:08 s1lp14 kernel: [345187.174980] [ 635] 0 635 3774 462 86016 568 -1000 systemd-udevd Mar 20 07:00:08 s1lp14 kernel: [345187.174982] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:00:08 s1lp14 kernel: [345187.174984] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:00:08 s1lp14 kernel: [345187.174986] [ 1078] 100 1078 20782 491 100352 171 0 systemd-timesyn Mar 20 07:00:08 s1lp14 kernel: [345187.174988] [ 1132] 102 1132 2482 491 98304 201 0 systemd-resolve Mar 20 07:00:08 s1lp14 kernel: [345187.174990] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:00:08 s1lp14 kernel: [345187.174992] [ 1226] 0 1226 1547 405 79872 73 0 cron Mar 20 07:00:08 s1lp14 kernel: [345187.174994] [ 1229] 0 1229 2444 571 98304 200 0 systemd-logind Mar 20 07:00:08 s1lp14 kernel: [345187.174995] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:00:08 s1lp14 kernel: [345187.174997] [ 1255] 0 1255 58495 595 131072 220 0 accounts-daemon Mar 20 07:00:08 s1lp14 kernel: [345187.174999] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:00:08 s1lp14 kernel: [345187.175001] [ 1259] 0 1259 20060 504 83968 62 0 irqbalance Mar 20 07:00:08 s1lp14 kernel: [345187.175002] [ 1265] 0 1265 2673 321 83968 310 0 pkcsslotd Mar 20 07:00:08 s1lp14 kernel: [345187.175004] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:00:08 s1lp14 kernel: [345187.175006] [ 1433] 0 1433 1125 454 73728 42 0 iscsid Mar 20 07:00:08 s1lp14 kernel: [345187.175008] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:00:08 s1lp14 kernel: [345187.175010] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:00:08 s1lp14 kernel: [345187.175012] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:00:08 s1lp14 kernel: [345187.175013] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:00:08 s1lp14 kernel: [345187.175015] [ 7772] 101 7772 2793 555 100352 213 0 systemd-network Mar 20 07:00:08 s1lp14 kernel: [345187.175017] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:00:08 s1lp14 kernel: [345187.175020] [66598] 0 66598 394264 14 253952 2469 -900 snapd Mar 20 07:00:08 s1lp14 kernel: [345187.175022] [113723] 0 113723 2359 425 88064 136 0 wpa_supplicant Mar 20 07:00:08 s1lp14 kernel: [345187.175023] [116349] 0 116349 8972 420 83968 127 0 master Mar 20 07:00:08 s1lp14 kernel: [345187.175025] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:00:08 s1lp14 kernel: [345187.175027] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:00:08 s1lp14 kernel: [345187.175029] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:00:08 s1lp14 kernel: [345187.175031] [117440] 103 117440 54882 679 98304 146 0 rsyslogd Mar 20 07:00:08 s1lp14 kernel: [345187.175033] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:00:08 s1lp14 kernel: [345187.175035] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:00:08 s1lp14 kernel: [345187.175037] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:00:08 s1lp14 kernel: [345187.175039] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:00:08 s1lp14 kernel: [345187.175041] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:00:08 s1lp14 kernel: [345187.175043] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:00:08 s1lp14 kernel: [345187.175045] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:00:08 s1lp14 kernel: [345187.175048] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:00:08 s1lp14 kernel: [345187.175050] [70732] 111 70732 9042 417 88064 134 0 pickup Mar 20 07:00:08 s1lp14 kernel: [345187.175051] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:00:08 s1lp14 kernel: [345187.175053] [190296] 0 190296 3262 449 104448 65 -1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175055] [190297] 0 190297 3262 192 102400 62 -1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175057] [190298] 0 190298 3262 296 102400 68 -1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175059] [190299] 0 190299 3262 234 102400 73 -1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175061] [190300] 0 190300 3262 236 102400 67 -1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175063] [190302] 0 190302 3262 308 102400 58 -1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175064] [190304] 0 190304 3262 305 102400 61 -1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175066] [190307] 0 190307 3262 307 102400 59 -1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175068] [190308] 0 190308 3262 221 102400 73 -1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175070] [190404] 0 190404 1193620 1054469 9658368 136022 1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175072] [190410] 0 190410 1176288 1173097 9519104 62 1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175074] [190412] 0 190412 742369 739177 6031360 66 1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175076] [190416] 0 190416 958231 955038 7776256 64 1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175078] [190418] 0 190418 220933 217749 1845248 57 1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175079] [190423] 0 190423 539943 536754 4413440 63 1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175081] [190424] 0 190424 76286 73101 686080 57 1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175083] [190425] 0 190425 149224 146041 1269760 57 1000 stress-ng Mar 20 07:00:08 s1lp14 kernel: [345187.175085] Out of memory: Kill process 190404 (stress-ng) score 1219 or sacrifice child Mar 20 07:00:08 s1lp14 kernel: [345187.175093] Killed process 190404 (stress-ng) total-vm:4774480kB, anon-rss:4217636kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:00:09 s1lp14 kernel: [345188.148165] oom_reaper: reaped process 190404 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:00:09 s1lp14 stress-ng: memory (MB): total 19923.80, free 108.89, shared 3.57, buffer 0.45, swap 625.40, free swap 490.30 Mar 20 07:00:24 s1lp14 kernel: [345203.295796] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:00:24 s1lp14 kernel: [345203.295798] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:00:24 s1lp14 kernel: [345203.295805] CPU: 0 PID: 190423 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:00:24 s1lp14 kernel: [345203.295806] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:00:24 s1lp14 kernel: [345203.295807] Call Trace: Mar 20 07:00:24 s1lp14 kernel: [345203.295815] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:00:24 s1lp14 kernel: [345203.295819] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:00:24 s1lp14 kernel: [345203.295825] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:00:24 s1lp14 kernel: [345203.295826] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:00:24 s1lp14 kernel: [345203.295828] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:00:24 s1lp14 kernel: [345203.295831] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:00:24 s1lp14 kernel: [345203.295834] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:00:24 s1lp14 kernel: [345203.295839] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:00:24 s1lp14 kernel: [345203.295841] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:00:24 s1lp14 kernel: [345203.295842] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:00:24 s1lp14 kernel: [345203.295846] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:00:24 s1lp14 kernel: [345203.295849] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:00:24 s1lp14 kernel: [345203.295850] Mem-Info: Mar 20 07:00:24 s1lp14 kernel: [345203.295855] active_anon:4562046 inactive_anon:351883 isolated_anon:0 Mar 20 07:00:24 s1lp14 kernel: [345203.295855] active_file:56 inactive_file:109 isolated_file:0 Mar 20 07:00:24 s1lp14 kernel: [345203.295855] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 07:00:24 s1lp14 kernel: [345203.295855] slab_reclaimable:17372 slab_unreclaimable:40912 Mar 20 07:00:24 s1lp14 kernel: [345203.295855] mapped:2890 shmem:1012 pagetables:21075 bounce:0 Mar 20 07:00:24 s1lp14 kernel: [345203.295855] free:23452 free_pcp:1 free_cma:0 Mar 20 07:00:24 s1lp14 kernel: [345203.295859] Node 0 active_anon:18248184kB inactive_anon:1407532kB active_file:224kB inactive_file:436kB unevictable:28396kB isolated(anon):0kB isolated(file):0kB mapped:11560kB dirty:0kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:00:24 s1lp14 kernel: [345203.295860] Node 0 DMA free:73740kB min:2280kB low:4344kB high:6408kB active_anon:1929376kB inactive_anon:66436kB active_file:32kB inactive_file:328kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:64kB pagetables:8104kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:00:24 s1lp14 kernel: [345203.295865] lowmem_reserve[]: 0 17889 17889 Mar 20 07:00:24 s1lp14 kernel: [345203.295868] Node 0 Normal free:20068kB min:20244kB low:38560kB high:56876kB active_anon:16318696kB inactive_anon:1341096kB active_file:192kB inactive_file:200kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8064kB pagetables:76196kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB Mar 20 07:00:24 s1lp14 kernel: [345203.295873] lowmem_reserve[]: 0 0 0 Mar 20 07:00:24 s1lp14 kernel: [345203.295875] Node 0 DMA: 117*4kB (UM) 141*8kB (UME) 67*16kB (UM) 61*32kB (UME) 6*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73996kB Mar 20 07:00:24 s1lp14 kernel: [345203.295885] Node 0 Normal: 665*4kB (UME) 905*8kB (UME) 475*16kB (UME) 83*32kB (UM) 18*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 21308kB Mar 20 07:00:24 s1lp14 kernel: [345203.295895] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:00:24 s1lp14 kernel: [345203.295895] 23188 total pagecache pages Mar 20 07:00:24 s1lp14 kernel: [345203.295897] 19954 pages in swap cache Mar 20 07:00:24 s1lp14 kernel: [345203.295898] Swap cache stats: add 2259353, delete 2239253, find 11948/19492 Mar 20 07:00:24 s1lp14 kernel: [345203.295898] Free swap = 0kB Mar 20 07:00:24 s1lp14 kernel: [345203.295899] Total swap = 640412kB Mar 20 07:00:24 s1lp14 kernel: [345203.295900] 5242880 pages RAM Mar 20 07:00:24 s1lp14 kernel: [345203.295901] 0 pages HighMem/MovableOnly Mar 20 07:00:24 s1lp14 kernel: [345203.295901] 142387 pages reserved Mar 20 07:00:24 s1lp14 kernel: [345203.295902] 0 pages cma reserved Mar 20 07:00:24 s1lp14 kernel: [345203.295903] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:00:24 s1lp14 kernel: [345203.295906] [ 551] 0 551 10702 602 124928 267 0 systemd-journal Mar 20 07:00:24 s1lp14 kernel: [345203.295909] [ 635] 0 635 3774 462 86016 568 -1000 systemd-udevd Mar 20 07:00:24 s1lp14 kernel: [345203.295911] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:00:24 s1lp14 kernel: [345203.295913] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:00:24 s1lp14 kernel: [345203.295915] [ 1078] 100 1078 20782 491 100352 171 0 systemd-timesyn Mar 20 07:00:24 s1lp14 kernel: [345203.295917] [ 1132] 102 1132 2482 491 98304 201 0 systemd-resolve Mar 20 07:00:24 s1lp14 kernel: [345203.295919] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:00:24 s1lp14 kernel: [345203.295921] [ 1226] 0 1226 1547 405 79872 84 0 cron Mar 20 07:00:24 s1lp14 kernel: [345203.295923] [ 1229] 0 1229 2444 571 98304 200 0 systemd-logind Mar 20 07:00:24 s1lp14 kernel: [345203.295924] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:00:24 s1lp14 kernel: [345203.295926] [ 1255] 0 1255 58495 595 131072 220 0 accounts-daemon Mar 20 07:00:24 s1lp14 kernel: [345203.295928] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:00:24 s1lp14 kernel: [345203.295930] [ 1259] 0 1259 20060 488 83968 67 0 irqbalance Mar 20 07:00:24 s1lp14 kernel: [345203.295931] [ 1265] 0 1265 2673 1226 83968 308 0 pkcsslotd Mar 20 07:00:24 s1lp14 kernel: [345203.295933] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:00:24 s1lp14 kernel: [345203.295935] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:00:24 s1lp14 kernel: [345203.295937] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:00:24 s1lp14 kernel: [345203.295938] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:00:24 s1lp14 kernel: [345203.295940] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:00:24 s1lp14 kernel: [345203.295942] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:00:24 s1lp14 kernel: [345203.295944] [ 7772] 101 7772 2793 555 100352 213 0 systemd-network Mar 20 07:00:24 s1lp14 kernel: [345203.295946] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:00:24 s1lp14 kernel: [345203.295948] [66598] 0 66598 394264 14 253952 2474 -900 snapd Mar 20 07:00:24 s1lp14 kernel: [345203.295950] [113723] 0 113723 2359 488 88064 122 0 wpa_supplicant Mar 20 07:00:24 s1lp14 kernel: [345203.295952] [116349] 0 116349 8972 420 83968 127 0 master Mar 20 07:00:24 s1lp14 kernel: [345203.295953] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:00:24 s1lp14 kernel: [345203.295955] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:00:24 s1lp14 kernel: [345203.295958] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:00:24 s1lp14 kernel: [345203.295959] [117440] 103 117440 54882 637 98304 179 0 rsyslogd Mar 20 07:00:24 s1lp14 kernel: [345203.295961] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:00:24 s1lp14 kernel: [345203.295963] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:00:24 s1lp14 kernel: [345203.295965] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:00:24 s1lp14 kernel: [345203.295966] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:00:24 s1lp14 kernel: [345203.295968] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:00:24 s1lp14 kernel: [345203.295970] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:00:24 s1lp14 kernel: [345203.295972] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:00:24 s1lp14 kernel: [345203.295974] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:00:24 s1lp14 kernel: [345203.295976] [70732] 111 70732 9042 417 88064 134 0 pickup Mar 20 07:00:24 s1lp14 kernel: [345203.295978] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:00:24 s1lp14 kernel: [345203.295980] [190296] 0 190296 3262 449 104448 65 -1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.295982] [190297] 0 190297 3262 192 102400 62 -1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.295983] [190298] 0 190298 3262 290 102400 74 -1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.295985] [190299] 0 190299 3262 234 102400 73 -1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.295987] [190300] 0 190300 3262 236 102400 67 -1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.295989] [190302] 0 190302 3262 308 102400 58 -1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.295991] [190304] 0 190304 3262 305 102400 61 -1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.295993] [190307] 0 190307 3262 304 102400 62 -1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.295994] [190308] 0 190308 3262 268 102400 67 -1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.295996] [190410] 0 190410 1281333 1166765 10360832 111443 1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.295998] [190412] 0 190412 841796 813227 6844416 25444 1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.296000] [190416] 0 190416 1152967 1149778 9332736 64 1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.296002] [190418] 0 190418 361913 358729 2988032 57 1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.296004] [190423] 0 190423 760082 756890 6174720 63 1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.296006] [190424] 0 190424 230545 227360 1921024 57 1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.296008] [190425] 0 190425 406164 402983 3342336 57 1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.296009] [190430] 0 190430 20722 17548 241664 51 1000 stress-ng Mar 20 07:00:24 s1lp14 kernel: [345203.296011] Out of memory: Kill process 190410 (stress-ng) score 1236 or sacrifice child Mar 20 07:00:24 s1lp14 kernel: [345203.296020] Killed process 190410 (stress-ng) total-vm:5125332kB, anon-rss:4666820kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:00:25 s1lp14 kernel: [345204.460975] oom_reaper: reaped process 190410 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:00:35 s1lp14 kernel: [345215.056276] stress-ng invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:00:35 s1lp14 kernel: [345215.056278] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:00:35 s1lp14 kernel: [345215.056286] CPU: 0 PID: 190423 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:00:35 s1lp14 kernel: [345215.056287] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:00:35 s1lp14 kernel: [345215.056288] Call Trace: Mar 20 07:00:35 s1lp14 kernel: [345215.056298] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:00:35 s1lp14 kernel: [345215.056302] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:00:35 s1lp14 kernel: [345215.056306] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:00:35 s1lp14 kernel: [345215.056308] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:00:35 s1lp14 kernel: [345215.056310] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:00:35 s1lp14 kernel: [345215.056313] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:00:35 s1lp14 kernel: [345215.056315] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:00:35 s1lp14 kernel: [345215.056319] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:00:35 s1lp14 kernel: [345215.056324] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:00:35 s1lp14 kernel: [345215.056327] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:00:35 s1lp14 kernel: [345215.056329] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:00:35 s1lp14 kernel: [345215.056332] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:00:35 s1lp14 kernel: [345215.056335] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:00:35 s1lp14 kernel: [345215.056337] Mem-Info: Mar 20 07:00:35 s1lp14 kernel: [345215.056342] active_anon:4562420 inactive_anon:351670 isolated_anon:64 Mar 20 07:00:35 s1lp14 kernel: [345215.056342] active_file:140 inactive_file:8 isolated_file:0 Mar 20 07:00:35 s1lp14 kernel: [345215.056342] unevictable:7099 dirty:0 writeback:121 unstable:0 Mar 20 07:00:35 s1lp14 kernel: [345215.056342] slab_reclaimable:17372 slab_unreclaimable:40929 Mar 20 07:00:35 s1lp14 kernel: [345215.056342] mapped:2349 shmem:426 pagetables:21044 bounce:0 Mar 20 07:00:35 s1lp14 kernel: [345215.056342] free:23429 free_pcp:0 free_cma:0 Mar 20 07:00:35 s1lp14 kernel: [345215.056346] Node 0 active_anon:18249680kB inactive_anon:1406680kB active_file:560kB inactive_file:32kB unevictable:28396kB isolated(anon):256kB isolated(file):0kB mapped:9396kB dirty:0kB writeback:484kB shmem:1704kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:00:35 s1lp14 kernel: [345215.056347] Node 0 DMA free:73740kB min:2280kB low:4344kB high:6408kB active_anon:1800280kB inactive_anon:196220kB active_file:156kB inactive_file:0kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:64kB pagetables:8016kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:00:35 s1lp14 kernel: [345215.056352] lowmem_reserve[]: 0 17889 17889 Mar 20 07:00:35 s1lp14 kernel: [345215.056355] Node 0 Normal free:19976kB min:20244kB low:38560kB high:56876kB active_anon:16448832kB inactive_anon:1210460kB active_file:504kB inactive_file:484kB unevictable:28396kB writepending:436kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8064kB pagetables:76160kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:00:35 s1lp14 kernel: [345215.056361] lowmem_reserve[]: 0 0 0 Mar 20 07:00:35 s1lp14 kernel: [345215.056364] Node 0 DMA: 138*4kB (UM) 136*8kB (UME) 67*16kB (UM) 43*32kB (UME) 11*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73784kB Mar 20 07:00:35 s1lp14 kernel: [345215.056378] Node 0 Normal: 941*4kB (UME) 848*8kB (UME) 503*16kB (UME) 39*32kB (UM) 19*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 21060kB Mar 20 07:00:35 s1lp14 kernel: [345215.056391] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:00:35 s1lp14 kernel: [345215.056392] 27780 total pagecache pages Mar 20 07:00:35 s1lp14 kernel: [345215.056393] 25239 pages in swap cache Mar 20 07:00:35 s1lp14 kernel: [345215.056395] Swap cache stats: add 2375466, delete 2350078, find 12374/20199 Mar 20 07:00:35 s1lp14 kernel: [345215.056395] Free swap = 0kB Mar 20 07:00:35 s1lp14 kernel: [345215.056396] Total swap = 640412kB Mar 20 07:00:35 s1lp14 kernel: [345215.056397] 5242880 pages RAM Mar 20 07:00:35 s1lp14 kernel: [345215.056398] 0 pages HighMem/MovableOnly Mar 20 07:00:35 s1lp14 kernel: [345215.056399] 142387 pages reserved Mar 20 07:00:35 s1lp14 kernel: [345215.056399] 0 pages cma reserved Mar 20 07:00:35 s1lp14 kernel: [345215.056400] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:00:35 s1lp14 kernel: [345215.056404] [ 551] 0 551 10702 573 124928 271 0 systemd-journal Mar 20 07:00:35 s1lp14 kernel: [345215.056406] [ 635] 0 635 3774 389 86016 568 -1000 systemd-udevd Mar 20 07:00:35 s1lp14 kernel: [345215.056409] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:00:35 s1lp14 kernel: [345215.056411] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:00:35 s1lp14 kernel: [345215.056413] [ 1078] 100 1078 20782 582 100352 150 0 systemd-timesyn Mar 20 07:00:35 s1lp14 kernel: [345215.056415] [ 1132] 102 1132 2482 515 98304 181 0 systemd-resolve Mar 20 07:00:35 s1lp14 kernel: [345215.056417] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:00:35 s1lp14 kernel: [345215.056419] [ 1226] 0 1226 1547 405 79872 89 0 cron Mar 20 07:00:35 s1lp14 kernel: [345215.056421] [ 1229] 0 1229 2444 518 98304 181 0 systemd-logind Mar 20 07:00:35 s1lp14 kernel: [345215.056423] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:00:35 s1lp14 kernel: [345215.056425] [ 1255] 0 1255 58495 597 131072 218 0 accounts-daemon Mar 20 07:00:35 s1lp14 kernel: [345215.056427] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:00:35 s1lp14 kernel: [345215.056429] [ 1259] 0 1259 20060 464 83968 66 0 irqbalance Mar 20 07:00:35 s1lp14 kernel: [345215.056431] [ 1265] 0 1265 2673 578 83968 310 0 pkcsslotd Mar 20 07:00:35 s1lp14 kernel: [345215.056433] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:00:35 s1lp14 kernel: [345215.056436] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:00:35 s1lp14 kernel: [345215.056438] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:00:35 s1lp14 kernel: [345215.056440] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:00:35 s1lp14 kernel: [345215.056442] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:00:35 s1lp14 kernel: [345215.056444] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:00:35 s1lp14 kernel: [345215.056446] [ 7772] 101 7772 2793 555 100352 213 0 systemd-network Mar 20 07:00:35 s1lp14 kernel: [345215.056449] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:00:35 s1lp14 kernel: [345215.056450] [66598] 0 66598 394264 14 253952 2474 -900 snapd Mar 20 07:00:35 s1lp14 kernel: [345215.056452] [113723] 0 113723 2359 402 88064 122 0 wpa_supplicant Mar 20 07:00:35 s1lp14 kernel: [345215.056454] [116349] 0 116349 8972 368 83968 127 0 master Mar 20 07:00:35 s1lp14 kernel: [345215.056457] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:00:35 s1lp14 kernel: [345215.056459] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:00:35 s1lp14 kernel: [345215.056460] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:00:35 s1lp14 kernel: [345215.056462] [117440] 103 117440 54882 458 98304 163 0 rsyslogd Mar 20 07:00:35 s1lp14 kernel: [345215.056463] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:00:35 s1lp14 kernel: [345215.056465] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:00:35 s1lp14 kernel: [345215.056467] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:00:35 s1lp14 kernel: [345215.056469] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:00:35 s1lp14 kernel: [345215.056471] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:00:35 s1lp14 kernel: [345215.056473] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:00:35 s1lp14 kernel: [345215.056475] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:00:35 s1lp14 kernel: [345215.056477] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:00:35 s1lp14 kernel: [345215.056479] [70732] 111 70732 9042 417 88064 134 0 pickup Mar 20 07:00:35 s1lp14 kernel: [345215.056481] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:00:35 s1lp14 kernel: [345215.056483] [190296] 0 190296 3262 449 104448 65 -1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056485] [190297] 0 190297 3262 192 102400 62 -1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056488] [190298] 0 190298 3262 290 102400 74 -1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056490] [190299] 0 190299 3262 234 102400 73 -1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056492] [190300] 0 190300 3262 236 102400 67 -1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056494] [190302] 0 190302 3262 308 102400 58 -1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056496] [190304] 0 190304 3262 305 102400 61 -1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056499] [190307] 0 190307 3262 262 102400 62 -1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056500] [190308] 0 190308 3262 268 102400 67 -1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056502] [190412] 0 190412 972260 832734 7886848 136380 1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056504] [190416] 0 190416 1471823 1468635 11900928 64 1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056506] [190418] 0 190418 496094 492912 4061184 57 1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056508] [190423] 0 190423 1049787 1046579 8507392 63 1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056510] [190424] 0 190424 231391 228148 1927168 57 1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056512] [190425] 0 190425 576722 573512 4706304 57 1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056514] [190430] 0 190430 247035 243800 2052096 51 1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056516] [190435] 0 190435 5248 2046 118784 50 1000 stress-ng Mar 20 07:00:35 s1lp14 kernel: [345215.056518] Out of memory: Kill process 190416 (stress-ng) score 1271 or sacrifice child Mar 20 07:00:35 s1lp14 kernel: [345215.056527] Killed process 190416 (stress-ng) total-vm:5887292kB, anon-rss:5874300kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:00:36 s1lp14 stress-ng: memory (MB): total 19923.80, free 91.34, shared 1.08, buffer 0.42, swap 625.40, free swap 203.32 Mar 20 07:00:36 s1lp14 stress-ng: memory (MB): total 19923.80, free 1538.58, shared 3.94, buffer 0.54, swap 625.40, free swap 2.46 Mar 20 07:00:36 s1lp14 kernel: [345215.626814] oom_reaper: reaped process 190416 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:00:36 s1lp14 kernel: [345216.011586] stress-ng invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:00:36 s1lp14 kernel: [345216.011588] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:00:36 s1lp14 kernel: [345216.011595] CPU: 6 PID: 190425 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:00:36 s1lp14 kernel: [345216.011596] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:00:36 s1lp14 kernel: [345216.011597] Call Trace: Mar 20 07:00:36 s1lp14 kernel: [345216.011606] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:00:36 s1lp14 kernel: [345216.011611] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:00:36 s1lp14 kernel: [345216.011616] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:00:36 s1lp14 kernel: [345216.011618] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:00:36 s1lp14 kernel: [345216.011619] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:00:36 s1lp14 kernel: [345216.011623] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:00:36 s1lp14 kernel: [345216.011625] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:00:36 s1lp14 kernel: [345216.011630] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:00:36 s1lp14 kernel: [345216.011634] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:00:36 s1lp14 kernel: [345216.011637] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:00:36 s1lp14 kernel: [345216.011639] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:00:36 s1lp14 kernel: [345216.011643] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:00:36 s1lp14 kernel: [345216.011646] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:00:36 s1lp14 kernel: [345216.011647] Mem-Info: Mar 20 07:00:36 s1lp14 kernel: [345216.011652] active_anon:4629860 inactive_anon:284205 isolated_anon:0 Mar 20 07:00:36 s1lp14 kernel: [345216.011652] active_file:132 inactive_file:128 isolated_file:0 Mar 20 07:00:36 s1lp14 kernel: [345216.011652] unevictable:7099 dirty:0 writeback:30 unstable:0 Mar 20 07:00:36 s1lp14 kernel: [345216.011652] slab_reclaimable:17376 slab_unreclaimable:40985 Mar 20 07:00:36 s1lp14 kernel: [345216.011652] mapped:2958 shmem:1012 pagetables:21136 bounce:0 Mar 20 07:00:36 s1lp14 kernel: [345216.011652] free:23386 free_pcp:16 free_cma:0 Mar 20 07:00:36 s1lp14 kernel: [345216.011657] Node 0 active_anon:18519440kB inactive_anon:1136820kB active_file:528kB inactive_file:512kB unevictable:28396kB isolated(anon):0kB isolated(file):0kB mapped:11832kB dirty:0kB writeback:120kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:00:36 s1lp14 kernel: [345216.011659] Node 0 DMA free:73588kB min:2280kB low:4344kB high:6408kB active_anon:1826544kB inactive_anon:170172kB active_file:0kB inactive_file:88kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:64kB pagetables:8204kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:00:36 s1lp14 kernel: [345216.011664] lowmem_reserve[]: 0 17889 17889 Mar 20 07:00:36 s1lp14 kernel: [345216.011667] Node 0 Normal free:19956kB min:20244kB low:38560kB high:56876kB active_anon:16693376kB inactive_anon:965096kB active_file:520kB inactive_file:716kB unevictable:28396kB writepending:580kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8048kB pagetables:76340kB bounce:0kB free_pcp:64kB local_pcp:0kB free_cma:0kB Mar 20 07:00:36 s1lp14 kernel: [345216.011671] lowmem_reserve[]: 0 0 0 Mar 20 07:00:36 s1lp14 kernel: [345216.011674] Node 0 DMA: 34*4kB (UM) 55*8kB (UME) 87*16kB (UM) 51*32kB (UME) 11*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73296kB Mar 20 07:00:36 s1lp14 kernel: [345216.011686] Node 0 Normal: 1250*4kB (UME) 815*8kB (UME) 466*16kB (UME) 62*32kB (UME) 7*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 21408kB Mar 20 07:00:36 s1lp14 kernel: [345216.011696] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:00:36 s1lp14 kernel: [345216.011697] 28799 total pagecache pages Mar 20 07:00:36 s1lp14 kernel: [345216.011698] 25649 pages in swap cache Mar 20 07:00:36 s1lp14 kernel: [345216.011700] Swap cache stats: add 2376838, delete 2351040, find 12678/20881 Mar 20 07:00:36 s1lp14 kernel: [345216.011700] Free swap = 0kB Mar 20 07:00:36 s1lp14 kernel: [345216.011701] Total swap = 640412kB Mar 20 07:00:36 s1lp14 kernel: [345216.011702] 5242880 pages RAM Mar 20 07:00:36 s1lp14 kernel: [345216.011703] 0 pages HighMem/MovableOnly Mar 20 07:00:36 s1lp14 kernel: [345216.011703] 142387 pages reserved Mar 20 07:00:36 s1lp14 kernel: [345216.011704] 0 pages cma reserved Mar 20 07:00:36 s1lp14 kernel: [345216.011704] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:00:36 s1lp14 kernel: [345216.011708] [ 551] 0 551 10702 649 124928 267 0 systemd-journal Mar 20 07:00:36 s1lp14 kernel: [345216.011711] [ 635] 0 635 3774 389 86016 568 -1000 systemd-udevd Mar 20 07:00:36 s1lp14 kernel: [345216.011713] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:00:36 s1lp14 kernel: [345216.011715] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:00:36 s1lp14 kernel: [345216.011717] [ 1078] 100 1078 20782 582 100352 150 0 systemd-timesyn Mar 20 07:00:36 s1lp14 kernel: [345216.011719] [ 1132] 102 1132 2482 515 98304 181 0 systemd-resolve Mar 20 07:00:36 s1lp14 kernel: [345216.011721] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:00:36 s1lp14 kernel: [345216.011722] [ 1226] 0 1226 1547 405 79872 89 0 cron Mar 20 07:00:36 s1lp14 kernel: [345216.011724] [ 1229] 0 1229 2444 518 98304 181 0 systemd-logind Mar 20 07:00:36 s1lp14 kernel: [345216.011726] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:00:36 s1lp14 kernel: [345216.011728] [ 1255] 0 1255 58495 437 131072 218 0 accounts-daemon Mar 20 07:00:36 s1lp14 kernel: [345216.011730] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:00:36 s1lp14 kernel: [345216.011732] [ 1259] 0 1259 20060 464 83968 66 0 irqbalance Mar 20 07:00:36 s1lp14 kernel: [345216.011734] [ 1265] 0 1265 2673 1159 83968 310 0 pkcsslotd Mar 20 07:00:36 s1lp14 kernel: [345216.011736] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:00:36 s1lp14 kernel: [345216.011738] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:00:36 s1lp14 kernel: [345216.011740] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:00:36 s1lp14 kernel: [345216.011741] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:00:36 s1lp14 kernel: [345216.011744] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:00:36 s1lp14 kernel: [345216.011746] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:00:36 s1lp14 kernel: [345216.011747] [ 7772] 101 7772 2793 555 100352 213 0 systemd-network Mar 20 07:00:36 s1lp14 kernel: [345216.011749] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:00:36 s1lp14 kernel: [345216.011750] [66598] 0 66598 394264 14 253952 2474 -900 snapd Mar 20 07:00:36 s1lp14 kernel: [345216.011752] [113723] 0 113723 2359 402 88064 122 0 wpa_supplicant Mar 20 07:00:36 s1lp14 kernel: [345216.011754] [116349] 0 116349 8972 402 83968 113 0 master Mar 20 07:00:36 s1lp14 kernel: [345216.011756] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:00:36 s1lp14 kernel: [345216.011758] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:00:36 s1lp14 kernel: [345216.011760] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:00:36 s1lp14 kernel: [345216.011762] [117440] 103 117440 54882 656 98304 154 0 rsyslogd Mar 20 07:00:36 s1lp14 kernel: [345216.011764] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:00:36 s1lp14 kernel: [345216.011767] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:00:36 s1lp14 kernel: [345216.011769] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:00:36 s1lp14 kernel: [345216.011770] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:00:36 s1lp14 kernel: [345216.011772] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:00:36 s1lp14 kernel: [345216.011774] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:00:36 s1lp14 kernel: [345216.011776] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:00:36 s1lp14 kernel: [345216.011778] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:00:36 s1lp14 kernel: [345216.011780] [70732] 111 70732 9042 437 88064 107 0 pickup Mar 20 07:00:36 s1lp14 kernel: [345216.011782] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:00:36 s1lp14 kernel: [345216.011784] [190296] 0 190296 3262 449 104448 65 -1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011786] [190297] 0 190297 3262 192 102400 62 -1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011788] [190298] 0 190298 3262 290 102400 74 -1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011791] [190299] 0 190299 3262 234 102400 73 -1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011793] [190300] 0 190300 3262 309 102400 57 -1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011795] [190302] 0 190302 3262 308 102400 58 -1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011797] [190304] 0 190304 3262 305 102400 61 -1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011798] [190307] 0 190307 3262 262 102400 62 -1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011801] [190308] 0 190308 3262 268 102400 67 -1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011803] [190412] 0 190412 1073007 932864 8693760 137017 1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011804] [190418] 0 190418 596434 593250 4864000 57 1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011806] [190423] 0 190423 1331437 1328251 10760192 63 1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011808] [190424] 0 190424 332376 329196 2752512 57 1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011810] [190425] 0 190425 985774 982573 7995392 57 1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011812] [190430] 0 190430 448163 444989 3678208 51 1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011813] [190435] 0 190435 208713 205534 1746944 50 1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011815] [190439] 0 190439 74077 70886 669696 50 1000 stress-ng Mar 20 07:00:36 s1lp14 kernel: [345216.011816] Out of memory: Kill process 190423 (stress-ng) score 1245 or sacrifice child Mar 20 07:00:36 s1lp14 kernel: [345216.011827] Killed process 190423 (stress-ng) total-vm:5325748kB, anon-rss:5312764kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:00:38 s1lp14 kernel: [345217.207355] oom_reaper: reaped process 190423 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:00:38 s1lp14 kernel: [345217.509692] systemd-journal invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:00:38 s1lp14 kernel: [345217.509693] systemd-journal cpuset=/ mems_allowed=0 Mar 20 07:00:38 s1lp14 kernel: [345217.509698] CPU: 4 PID: 551 Comm: systemd-journal Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:00:38 s1lp14 kernel: [345217.509698] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:00:38 s1lp14 kernel: [345217.509699] Call Trace: Mar 20 07:00:38 s1lp14 kernel: [345217.509708] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:00:38 s1lp14 kernel: [345217.509712] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:00:38 s1lp14 kernel: [345217.509715] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:00:38 s1lp14 kernel: [345217.509716] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:00:38 s1lp14 kernel: [345217.509717] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:00:38 s1lp14 kernel: [345217.509719] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:00:38 s1lp14 kernel: [345217.509720] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:00:38 s1lp14 kernel: [345217.509724] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:00:38 s1lp14 kernel: [345217.509728] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:00:38 s1lp14 kernel: [345217.509729] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:00:38 s1lp14 kernel: [345217.509730] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:00:38 s1lp14 kernel: [345217.509734] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:00:38 s1lp14 kernel: [345217.509736] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:00:38 s1lp14 kernel: [345217.509737] Mem-Info: Mar 20 07:00:38 s1lp14 kernel: [345217.509739] active_anon:4562315 inactive_anon:351609 isolated_anon:224 Mar 20 07:00:38 s1lp14 kernel: [345217.509739] active_file:100 inactive_file:0 isolated_file:0 Mar 20 07:00:38 s1lp14 kernel: [345217.509739] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 07:00:38 s1lp14 kernel: [345217.509739] slab_reclaimable:17376 slab_unreclaimable:40961 Mar 20 07:00:38 s1lp14 kernel: [345217.509739] mapped:3044 shmem:1012 pagetables:20852 bounce:0 Mar 20 07:00:38 s1lp14 kernel: [345217.509739] free:23429 free_pcp:54 free_cma:0 Mar 20 07:00:38 s1lp14 kernel: [345217.509742] Node 0 active_anon:18249260kB inactive_anon:1406436kB active_file:400kB inactive_file:0kB unevictable:28396kB isolated(anon):896kB isolated(file):0kB mapped:12176kB dirty:0kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:00:38 s1lp14 kernel: [345217.509742] Node 0 DMA free:73728kB min:2280kB low:4344kB high:6408kB active_anon:1835100kB inactive_anon:160528kB active_file:24kB inactive_file:212kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:64kB pagetables:8028kB bounce:0kB free_pcp:128kB local_pcp:0kB free_cma:0kB Mar 20 07:00:38 s1lp14 kernel: [345217.509744] lowmem_reserve[]: 0 17889 17889 Mar 20 07:00:38 s1lp14 kernel: [345217.509746] Node 0 Normal free:19988kB min:20244kB low:38560kB high:56876kB active_anon:16415292kB inactive_anon:1243164kB active_file:656kB inactive_file:328kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8048kB pagetables:75380kB bounce:0kB free_pcp:88kB local_pcp:8kB free_cma:0kB Mar 20 07:00:38 s1lp14 kernel: [345217.509748] lowmem_reserve[]: 0 0 0 Mar 20 07:00:38 s1lp14 kernel: [345217.509749] Node 0 DMA: 240*4kB (UM) 128*8kB (UME) 33*16kB (UM) 36*32kB (UME) 27*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74384kB Mar 20 07:00:38 s1lp14 kernel: [345217.509755] Node 0 Normal: 692*4kB (UME) 726*8kB (UME) 486*16kB (UME) 74*32kB (UME) 37*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 21088kB Mar 20 07:00:38 s1lp14 kernel: [345217.509761] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:00:38 s1lp14 kernel: [345217.509761] 21961 total pagecache pages Mar 20 07:00:38 s1lp14 kernel: [345217.509762] 18857 pages in swap cache Mar 20 07:00:38 s1lp14 kernel: [345217.509762] Swap cache stats: add 2376857, delete 2357851, find 12696/20909 Mar 20 07:00:38 s1lp14 kernel: [345217.509763] Free swap = 0kB Mar 20 07:00:38 s1lp14 kernel: [345217.509763] Total swap = 640412kB Mar 20 07:00:38 s1lp14 kernel: [345217.509763] 5242880 pages RAM Mar 20 07:00:38 s1lp14 kernel: [345217.509764] 0 pages HighMem/MovableOnly Mar 20 07:00:38 s1lp14 kernel: [345217.509764] 142387 pages reserved Mar 20 07:00:38 s1lp14 kernel: [345217.509764] 0 pages cma reserved Mar 20 07:00:38 s1lp14 kernel: [345217.509765] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:00:38 s1lp14 kernel: [345217.509767] [ 551] 0 551 10702 507 124928 267 0 systemd-journal Mar 20 07:00:38 s1lp14 kernel: [345217.509768] [ 635] 0 635 3774 389 86016 568 -1000 systemd-udevd Mar 20 07:00:38 s1lp14 kernel: [345217.509769] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:00:38 s1lp14 kernel: [345217.509770] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:00:38 s1lp14 kernel: [345217.509771] [ 1078] 100 1078 20782 582 100352 150 0 systemd-timesyn Mar 20 07:00:38 s1lp14 kernel: [345217.509772] [ 1132] 102 1132 2482 515 98304 181 0 systemd-resolve Mar 20 07:00:38 s1lp14 kernel: [345217.509773] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:00:38 s1lp14 kernel: [345217.509774] [ 1226] 0 1226 1547 405 79872 91 0 cron Mar 20 07:00:38 s1lp14 kernel: [345217.509774] [ 1229] 0 1229 2444 518 98304 181 0 systemd-logind Mar 20 07:00:38 s1lp14 kernel: [345217.509775] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:00:38 s1lp14 kernel: [345217.509776] [ 1255] 0 1255 58495 349 131072 214 0 accounts-daemon Mar 20 07:00:38 s1lp14 kernel: [345217.509777] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:00:38 s1lp14 kernel: [345217.509778] [ 1259] 0 1259 20060 464 83968 66 0 irqbalance Mar 20 07:00:38 s1lp14 kernel: [345217.509778] [ 1265] 0 1265 2673 1159 83968 310 0 pkcsslotd Mar 20 07:00:38 s1lp14 kernel: [345217.509779] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:00:38 s1lp14 kernel: [345217.509780] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:00:38 s1lp14 kernel: [345217.509781] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:00:38 s1lp14 kernel: [345217.509782] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:00:38 s1lp14 kernel: [345217.509783] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:00:38 s1lp14 kernel: [345217.509784] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:00:38 s1lp14 kernel: [345217.509785] [ 7772] 101 7772 2793 555 100352 213 0 systemd-network Mar 20 07:00:38 s1lp14 kernel: [345217.509786] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:00:38 s1lp14 kernel: [345217.509787] [66598] 0 66598 394264 14 253952 2474 -900 snapd Mar 20 07:00:38 s1lp14 kernel: [345217.509787] [113723] 0 113723 2359 402 88064 122 0 wpa_supplicant Mar 20 07:00:38 s1lp14 kernel: [345217.509788] [116349] 0 116349 8972 402 83968 113 0 master Mar 20 07:00:38 s1lp14 kernel: [345217.509789] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:00:38 s1lp14 kernel: [345217.509790] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:00:38 s1lp14 kernel: [345217.509791] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:00:38 s1lp14 kernel: [345217.509792] [117440] 103 117440 54882 540 98304 154 0 rsyslogd Mar 20 07:00:38 s1lp14 kernel: [345217.509793] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:00:38 s1lp14 kernel: [345217.509794] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:00:38 s1lp14 kernel: [345217.509794] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:00:38 s1lp14 kernel: [345217.509795] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:00:38 s1lp14 kernel: [345217.509796] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:00:38 s1lp14 kernel: [345217.509797] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:00:38 s1lp14 kernel: [345217.509798] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:00:38 s1lp14 kernel: [345217.509799] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:00:38 s1lp14 kernel: [345217.509799] [70732] 111 70732 9042 437 88064 107 0 pickup Mar 20 07:00:38 s1lp14 kernel: [345217.509800] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:00:38 s1lp14 kernel: [345217.509801] [190296] 0 190296 3262 323 104448 65 -1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509802] [190297] 0 190297 3262 192 102400 62 -1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509803] [190298] 0 190298 3262 290 102400 74 -1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509804] [190299] 0 190299 3262 196 102400 63 -1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509805] [190300] 0 190300 3262 309 102400 57 -1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509806] [190302] 0 190302 3262 308 102400 58 -1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509807] [190304] 0 190304 3262 305 102400 61 -1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509808] [190307] 0 190307 3262 262 102400 62 -1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509809] [190308] 0 190308 3262 268 102400 67 -1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509809] [190412] 0 190412 1207747 1067600 9771008 137024 1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509810] [190418] 0 190418 704634 701449 5730304 57 1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509811] [190424] 0 190424 457225 454034 3751936 57 1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509812] [190425] 0 190425 1238442 1235262 10016768 57 1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509813] [190430] 0 190430 657449 654275 5353472 51 1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509814] [190435] 0 190435 445019 441840 3653632 50 1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509815] [190439] 0 190439 341312 338135 2824192 50 1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509815] [190441] 0 190441 4652 1477 114688 50 1000 stress-ng Mar 20 07:00:38 s1lp14 kernel: [345217.509816] Out of memory: Kill process 190425 (stress-ng) score 1228 or sacrifice child Mar 20 07:00:38 s1lp14 kernel: [345217.509821] Killed process 190425 (stress-ng) total-vm:4953768kB, anon-rss:4940808kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:00:38 s1lp14 stress-ng: memory (MB): total 19923.80, free 92.48, shared 3.95, buffer 0.38, swap 625.40, free swap 0.00 Mar 20 07:00:39 s1lp14 kernel: [345218.367956] oom_reaper: reaped process 190425 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:00:39 s1lp14 kernel: [345218.711467] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:00:39 s1lp14 kernel: [345218.711468] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:00:39 s1lp14 kernel: [345218.711474] CPU: 7 PID: 190439 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:00:39 s1lp14 kernel: [345218.711475] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:00:39 s1lp14 kernel: [345218.711476] Call Trace: Mar 20 07:00:39 s1lp14 kernel: [345218.711484] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:00:39 s1lp14 kernel: [345218.711488] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:00:39 s1lp14 kernel: [345218.711493] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:00:39 s1lp14 kernel: [345218.711494] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:00:39 s1lp14 kernel: [345218.711496] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:00:39 s1lp14 kernel: [345218.711499] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:00:39 s1lp14 kernel: [345218.711502] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:00:39 s1lp14 kernel: [345218.711506] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:00:39 s1lp14 kernel: [345218.711508] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:00:39 s1lp14 kernel: [345218.711510] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:00:39 s1lp14 kernel: [345218.711513] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:00:39 s1lp14 kernel: [345218.711517] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:00:39 s1lp14 kernel: [345218.711517] Mem-Info: Mar 20 07:00:39 s1lp14 kernel: [345218.711523] active_anon:4562498 inactive_anon:351622 isolated_anon:0 Mar 20 07:00:39 s1lp14 kernel: [345218.711523] active_file:129 inactive_file:89 isolated_file:0 Mar 20 07:00:39 s1lp14 kernel: [345218.711523] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 07:00:39 s1lp14 kernel: [345218.711523] slab_reclaimable:17368 slab_unreclaimable:40972 Mar 20 07:00:39 s1lp14 kernel: [345218.711523] mapped:2975 shmem:1012 pagetables:21199 bounce:0 Mar 20 07:00:39 s1lp14 kernel: [345218.711523] free:23398 free_pcp:39 free_cma:0 Mar 20 07:00:39 s1lp14 kernel: [345218.711526] Node 0 active_anon:18249992kB inactive_anon:1406488kB active_file:516kB inactive_file:356kB unevictable:28396kB isolated(anon):0kB isolated(file):0kB mapped:11900kB dirty:0kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:00:39 s1lp14 kernel: [345218.711527] Node 0 DMA free:73540kB min:2280kB low:4344kB high:6408kB active_anon:1865272kB inactive_anon:130684kB active_file:0kB inactive_file:372kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:8236kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:00:39 s1lp14 kernel: [345218.711533] lowmem_reserve[]: 0 17889 17889 Mar 20 07:00:39 s1lp14 kernel: [345218.711536] Node 0 Normal free:20052kB min:20244kB low:38560kB high:56876kB active_anon:16384160kB inactive_anon:1274500kB active_file:200kB inactive_file:228kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8048kB pagetables:76560kB bounce:0kB free_pcp:168kB local_pcp:0kB free_cma:0kB Mar 20 07:00:39 s1lp14 kernel: [345218.711540] lowmem_reserve[]: 0 0 0 Mar 20 07:00:39 s1lp14 kernel: [345218.711542] Node 0 DMA: 127*4kB (UM) 127*8kB (UME) 48*16kB (UM) 35*32kB (UME) 19*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73620kB Mar 20 07:00:39 s1lp14 kernel: [345218.711554] Node 0 Normal: 737*4kB (UME) 763*8kB (UME) 413*16kB (UME) 69*32kB (UM) 26*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 19532kB Mar 20 07:00:39 s1lp14 kernel: [345218.711564] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:00:39 s1lp14 kernel: [345218.711565] 3449 total pagecache pages Mar 20 07:00:39 s1lp14 kernel: [345218.711566] 144 pages in swap cache Mar 20 07:00:39 s1lp14 kernel: [345218.711567] Swap cache stats: add 2376859, delete 2376566, find 12704/20918 Mar 20 07:00:39 s1lp14 kernel: [345218.711567] Free swap = 0kB Mar 20 07:00:39 s1lp14 kernel: [345218.711568] Total swap = 640412kB Mar 20 07:00:39 s1lp14 kernel: [345218.711569] 5242880 pages RAM Mar 20 07:00:39 s1lp14 kernel: [345218.711569] 0 pages HighMem/MovableOnly Mar 20 07:00:39 s1lp14 kernel: [345218.711570] 142387 pages reserved Mar 20 07:00:39 s1lp14 kernel: [345218.711570] 0 pages cma reserved Mar 20 07:00:39 s1lp14 kernel: [345218.711571] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:00:39 s1lp14 kernel: [345218.711575] [ 551] 0 551 10702 338 124928 266 0 systemd-journal Mar 20 07:00:39 s1lp14 kernel: [345218.711577] [ 635] 0 635 3774 389 86016 568 -1000 systemd-udevd Mar 20 07:00:39 s1lp14 kernel: [345218.711579] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:00:39 s1lp14 kernel: [345218.711581] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:00:39 s1lp14 kernel: [345218.711583] [ 1078] 100 1078 20782 582 100352 150 0 systemd-timesyn Mar 20 07:00:39 s1lp14 kernel: [345218.711585] [ 1132] 102 1132 2482 515 98304 181 0 systemd-resolve Mar 20 07:00:39 s1lp14 kernel: [345218.711587] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:00:39 s1lp14 kernel: [345218.711589] [ 1226] 0 1226 1547 405 79872 91 0 cron Mar 20 07:00:39 s1lp14 kernel: [345218.711591] [ 1229] 0 1229 2444 518 98304 181 0 systemd-logind Mar 20 07:00:39 s1lp14 kernel: [345218.711593] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:00:39 s1lp14 kernel: [345218.711594] [ 1255] 0 1255 58495 487 131072 214 0 accounts-daemon Mar 20 07:00:39 s1lp14 kernel: [345218.711596] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:00:39 s1lp14 kernel: [345218.711598] [ 1259] 0 1259 20060 464 83968 66 0 irqbalance Mar 20 07:00:39 s1lp14 kernel: [345218.711599] [ 1265] 0 1265 2673 1159 83968 310 0 pkcsslotd Mar 20 07:00:39 s1lp14 kernel: [345218.711601] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:00:39 s1lp14 kernel: [345218.711603] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:00:39 s1lp14 kernel: [345218.711605] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:00:39 s1lp14 kernel: [345218.711607] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:00:39 s1lp14 kernel: [345218.711609] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:00:39 s1lp14 kernel: [345218.711611] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:00:39 s1lp14 kernel: [345218.711613] [ 7772] 101 7772 2793 555 100352 213 0 systemd-network Mar 20 07:00:39 s1lp14 kernel: [345218.711615] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:00:39 s1lp14 kernel: [345218.711617] [66598] 0 66598 394264 14 253952 2474 -900 snapd Mar 20 07:00:39 s1lp14 kernel: [345218.711619] [113723] 0 113723 2359 402 88064 122 0 wpa_supplicant Mar 20 07:00:39 s1lp14 kernel: [345218.711621] [116349] 0 116349 8972 402 83968 113 0 master Mar 20 07:00:39 s1lp14 kernel: [345218.711622] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:00:39 s1lp14 kernel: [345218.711624] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:00:39 s1lp14 kernel: [345218.711626] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:00:39 s1lp14 kernel: [345218.711628] [117440] 103 117440 54882 479 98304 139 0 rsyslogd Mar 20 07:00:39 s1lp14 kernel: [345218.711630] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:00:39 s1lp14 kernel: [345218.711632] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:00:39 s1lp14 kernel: [345218.711633] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:00:39 s1lp14 kernel: [345218.711636] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:00:39 s1lp14 kernel: [345218.711637] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:00:39 s1lp14 kernel: [345218.711639] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:00:39 s1lp14 kernel: [345218.711641] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:00:39 s1lp14 kernel: [345218.711643] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:00:39 s1lp14 kernel: [345218.711646] [70732] 111 70732 9042 437 88064 107 0 pickup Mar 20 07:00:39 s1lp14 kernel: [345218.711647] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:00:39 s1lp14 kernel: [345218.711649] [190296] 0 190296 3262 420 104448 65 -1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711651] [190297] 0 190297 3262 192 102400 62 -1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711653] [190298] 0 190298 3262 290 102400 74 -1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711655] [190299] 0 190299 3262 196 102400 63 -1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711657] [190300] 0 190300 3262 309 102400 57 -1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711659] [190302] 0 190302 3262 308 102400 58 -1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711661] [190304] 0 190304 3262 258 102400 61 -1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711663] [190307] 0 190307 3262 262 102400 62 -1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711664] [190308] 0 190308 3262 268 102400 67 -1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711666] [190412] 0 190412 1329054 1188843 10741760 137025 1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711668] [190418] 0 190418 786838 783657 6387712 57 1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711670] [190424] 0 190424 634209 631082 5167104 57 1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711672] [190430] 0 190430 657449 654275 5353472 51 1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711674] [190435] 0 190435 679329 676204 5527552 50 1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711676] [190439] 0 190439 647527 644395 5273600 50 1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711678] [190441] 0 190441 333490 330316 2760704 50 1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711679] [190442] 0 190442 7665 4534 137216 50 1000 stress-ng Mar 20 07:00:39 s1lp14 kernel: [345218.711680] Out of memory: Kill process 190412 (stress-ng) score 1244 or sacrifice child Mar 20 07:00:39 s1lp14 kernel: [345218.711687] Killed process 190412 (stress-ng) total-vm:5316216kB, anon-rss:4755368kB, file-rss:0kB, shmem-rss:4kB Mar 20 07:00:39 s1lp14 stress-ng: memory (MB): total 19923.80, free 99.54, shared 3.95, buffer 0.36, swap 625.40, free swap 0.00 Mar 20 07:00:40 s1lp14 kernel: [345219.752659] oom_reaper: reaped process 190412 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:00:40 s1lp14 stress-ng: memory (MB): total 19923.80, free 99.22, shared 3.95, buffer 0.61, swap 625.40, free swap 406.21 Mar 20 07:00:54 s1lp14 kernel: [345233.448576] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:00:54 s1lp14 kernel: [345233.448578] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:00:54 s1lp14 kernel: [345233.448585] CPU: 3 PID: 190430 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:00:54 s1lp14 kernel: [345233.448586] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:00:54 s1lp14 kernel: [345233.448587] Call Trace: Mar 20 07:00:54 s1lp14 kernel: [345233.448596] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:00:54 s1lp14 kernel: [345233.448601] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:00:54 s1lp14 kernel: [345233.448605] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:00:54 s1lp14 kernel: [345233.448607] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:00:54 s1lp14 kernel: [345233.448608] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:00:54 s1lp14 kernel: [345233.448611] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:00:54 s1lp14 kernel: [345233.448615] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:00:54 s1lp14 kernel: [345233.448619] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:00:54 s1lp14 kernel: [345233.448620] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:00:54 s1lp14 kernel: [345233.448622] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:00:54 s1lp14 kernel: [345233.448625] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:00:54 s1lp14 kernel: [345233.448628] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:00:54 s1lp14 kernel: [345233.448629] Mem-Info: Mar 20 07:00:54 s1lp14 kernel: [345233.448634] active_anon:4562286 inactive_anon:351661 isolated_anon:294 Mar 20 07:00:54 s1lp14 kernel: [345233.448634] active_file:260 inactive_file:275 isolated_file:0 Mar 20 07:00:54 s1lp14 kernel: [345233.448634] unevictable:7099 dirty:0 writeback:962 unstable:0 Mar 20 07:00:54 s1lp14 kernel: [345233.448634] slab_reclaimable:17360 slab_unreclaimable:40913 Mar 20 07:00:54 s1lp14 kernel: [345233.448634] mapped:2923 shmem:815 pagetables:21072 bounce:0 Mar 20 07:00:54 s1lp14 kernel: [345233.448634] free:23326 free_pcp:0 free_cma:0 Mar 20 07:00:54 s1lp14 kernel: [345233.448638] Node 0 active_anon:18249144kB inactive_anon:1406644kB active_file:1040kB inactive_file:1100kB unevictable:28396kB isolated(anon):1176kB isolated(file):0kB mapped:11692kB dirty:0kB writeback:3848kB shmem:3260kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:00:54 s1lp14 kernel: [345233.448640] Node 0 DMA free:73664kB min:2280kB low:4344kB high:6408kB active_anon:1887432kB inactive_anon:108876kB active_file:24kB inactive_file:32kB unevictable:0kB writepending:224kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:96kB pagetables:8208kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:00:54 s1lp14 kernel: [345233.448645] lowmem_reserve[]: 0 17889 17889 Mar 20 07:00:54 s1lp14 kernel: [345233.448648] Node 0 Normal free:19640kB min:20244kB low:38560kB high:56876kB active_anon:16361232kB inactive_anon:1297768kB active_file:1424kB inactive_file:1080kB unevictable:28396kB writepending:3624kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8032kB pagetables:76080kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:00:54 s1lp14 kernel: [345233.448653] lowmem_reserve[]: 0 0 0 Mar 20 07:00:54 s1lp14 kernel: [345233.448655] Node 0 DMA: 160*4kB (UM) 131*8kB (UME) 30*16kB (UM) 35*32kB (UME) 22*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73688kB Mar 20 07:00:54 s1lp14 kernel: [345233.448668] Node 0 Normal: 643*4kB (UME) 691*8kB (UME) 411*16kB (UME) 134*32kB (UME) 25*64kB (ME) 0*128kB 0*256kB 0*512kB 0*1024kB = 20564kB Mar 20 07:00:54 s1lp14 kernel: [345233.448681] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:00:54 s1lp14 kernel: [345233.448682] 23018 total pagecache pages Mar 20 07:00:54 s1lp14 kernel: [345233.448683] 19960 pages in swap cache Mar 20 07:00:54 s1lp14 kernel: [345233.448684] Swap cache stats: add 2519136, delete 2499023, find 12886/21252 Mar 20 07:00:54 s1lp14 kernel: [345233.448685] Free swap = 0kB Mar 20 07:00:54 s1lp14 kernel: [345233.448685] Total swap = 640412kB Mar 20 07:00:54 s1lp14 kernel: [345233.448687] 5242880 pages RAM Mar 20 07:00:54 s1lp14 kernel: [345233.448687] 0 pages HighMem/MovableOnly Mar 20 07:00:54 s1lp14 kernel: [345233.448688] 142387 pages reserved Mar 20 07:00:54 s1lp14 kernel: [345233.448689] 0 pages cma reserved Mar 20 07:00:54 s1lp14 kernel: [345233.448689] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:00:54 s1lp14 kernel: [345233.448693] [ 551] 0 551 10702 681 124928 266 0 systemd-journal Mar 20 07:00:54 s1lp14 kernel: [345233.448695] [ 635] 0 635 3774 389 86016 568 -1000 systemd-udevd Mar 20 07:00:54 s1lp14 kernel: [345233.448698] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:00:54 s1lp14 kernel: [345233.448699] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:00:54 s1lp14 kernel: [345233.448701] [ 1078] 100 1078 20782 582 100352 150 0 systemd-timesyn Mar 20 07:00:54 s1lp14 kernel: [345233.448703] [ 1132] 102 1132 2482 514 98304 182 0 systemd-resolve Mar 20 07:00:54 s1lp14 kernel: [345233.448705] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:00:54 s1lp14 kernel: [345233.448706] [ 1226] 0 1226 1547 405 79872 91 0 cron Mar 20 07:00:54 s1lp14 kernel: [345233.448708] [ 1229] 0 1229 2444 518 98304 181 0 systemd-logind Mar 20 07:00:54 s1lp14 kernel: [345233.448710] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:00:54 s1lp14 kernel: [345233.448712] [ 1255] 0 1255 58495 611 131072 214 0 accounts-daemon Mar 20 07:00:54 s1lp14 kernel: [345233.448714] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:00:54 s1lp14 kernel: [345233.448715] [ 1259] 0 1259 20060 520 83968 59 0 irqbalance Mar 20 07:00:54 s1lp14 kernel: [345233.448717] [ 1265] 0 1265 2673 969 83968 310 0 pkcsslotd Mar 20 07:00:54 s1lp14 kernel: [345233.448719] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:00:54 s1lp14 kernel: [345233.448720] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:00:54 s1lp14 kernel: [345233.448722] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:00:54 s1lp14 kernel: [345233.448723] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:00:54 s1lp14 kernel: [345233.448725] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:00:54 s1lp14 kernel: [345233.448727] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:00:54 s1lp14 kernel: [345233.448728] [ 7772] 101 7772 2793 555 100352 213 0 systemd-network Mar 20 07:00:54 s1lp14 kernel: [345233.448730] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:00:54 s1lp14 kernel: [345233.448732] [66598] 0 66598 394264 0 253952 2474 -900 snapd Mar 20 07:00:54 s1lp14 kernel: [345233.448734] [113723] 0 113723 2359 502 88064 115 0 wpa_supplicant Mar 20 07:00:54 s1lp14 kernel: [345233.448736] [116349] 0 116349 8972 402 83968 113 0 master Mar 20 07:00:54 s1lp14 kernel: [345233.448737] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:00:54 s1lp14 kernel: [345233.448739] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:00:54 s1lp14 kernel: [345233.448741] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:00:54 s1lp14 kernel: [345233.448743] [117440] 103 117440 54882 573 98304 139 0 rsyslogd Mar 20 07:00:54 s1lp14 kernel: [345233.448744] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:00:54 s1lp14 kernel: [345233.448746] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:00:54 s1lp14 kernel: [345233.448748] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:00:54 s1lp14 kernel: [345233.448749] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:00:54 s1lp14 kernel: [345233.448751] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:00:54 s1lp14 kernel: [345233.448753] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:00:54 s1lp14 kernel: [345233.448755] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:00:54 s1lp14 kernel: [345233.448757] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:00:54 s1lp14 kernel: [345233.448758] [70732] 111 70732 9042 437 88064 107 0 pickup Mar 20 07:00:54 s1lp14 kernel: [345233.448760] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:00:54 s1lp14 kernel: [345233.448762] [190296] 0 190296 3262 386 104448 65 -1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448763] [190297] 0 190297 3262 185 102400 69 -1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448765] [190298] 0 190298 3262 324 102400 53 -1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448767] [190299] 0 190299 3262 194 102400 65 -1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448768] [190300] 0 190300 3262 309 102400 57 -1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448770] [190302] 0 190302 3262 302 102400 64 -1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448772] [190304] 0 190304 3262 258 102400 61 -1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448774] [190307] 0 190307 3262 261 102400 63 -1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448776] [190308] 0 190308 3262 268 102400 67 -1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448778] [190418] 0 190418 876998 737093 7124992 136788 1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448780] [190424] 0 190424 751164 747977 6103040 65 1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448781] [190430] 0 190430 740613 737442 6019072 51 1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448783] [190435] 0 190435 970222 967050 7870464 50 1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448784] [190439] 0 190439 1019260 1016092 8263680 50 1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448786] [190441] 0 190441 489122 485954 4005888 50 1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448788] [190442] 0 190442 193197 190029 1622016 50 1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448789] [190443] 0 190443 15172 12006 198656 50 1000 stress-ng Mar 20 07:00:54 s1lp14 kernel: [345233.448791] Out of memory: Kill process 190439 (stress-ng) score 1187 or sacrifice child Mar 20 07:00:54 s1lp14 kernel: [345233.448799] Killed process 190439 (stress-ng) total-vm:4077040kB, anon-rss:4064100kB, file-rss:264kB, shmem-rss:4kB Mar 20 07:00:54 s1lp14 kernel: [345233.914938] oom_reaper: reaped process 190439 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:00:54 s1lp14 stress-ng: memory (MB): total 19923.80, free 675.08, shared 3.95, buffer 0.29, swap 625.40, free swap 0.00 Mar 20 07:00:55 s1lp14 kernel: [345234.076547] gmain invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:00:55 s1lp14 kernel: [345234.076549] gmain cpuset=/ mems_allowed=0 Mar 20 07:00:55 s1lp14 kernel: [345234.076556] CPU: 4 PID: 1266 Comm: gmain Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:00:55 s1lp14 kernel: [345234.076557] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:00:55 s1lp14 kernel: [345234.076558] Call Trace: Mar 20 07:00:55 s1lp14 kernel: [345234.076568] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:00:55 s1lp14 kernel: [345234.076572] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:00:55 s1lp14 kernel: [345234.076576] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:00:55 s1lp14 kernel: [345234.076578] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:00:55 s1lp14 kernel: [345234.076579] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:00:55 s1lp14 kernel: [345234.076582] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:00:55 s1lp14 kernel: [345234.076584] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:00:55 s1lp14 kernel: [345234.076588] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:00:55 s1lp14 kernel: [345234.076592] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:00:55 s1lp14 kernel: [345234.076595] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:00:55 s1lp14 kernel: [345234.076597] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:00:55 s1lp14 kernel: [345234.076601] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:00:55 s1lp14 kernel: [345234.076604] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:00:55 s1lp14 kernel: [345234.076605] Mem-Info: Mar 20 07:00:55 s1lp14 kernel: [345234.076610] active_anon:4561885 inactive_anon:351925 isolated_anon:32 Mar 20 07:00:55 s1lp14 kernel: [345234.076610] active_file:123 inactive_file:0 isolated_file:0 Mar 20 07:00:55 s1lp14 kernel: [345234.076610] unevictable:7099 dirty:67 writeback:144 unstable:0 Mar 20 07:00:55 s1lp14 kernel: [345234.076610] slab_reclaimable:17360 slab_unreclaimable:40986 Mar 20 07:00:55 s1lp14 kernel: [345234.076610] mapped:3158 shmem:1012 pagetables:21107 bounce:0 Mar 20 07:00:55 s1lp14 kernel: [345234.076610] free:23399 free_pcp:0 free_cma:0 Mar 20 07:00:55 s1lp14 kernel: [345234.076614] Node 0 active_anon:18247540kB inactive_anon:1407700kB active_file:492kB inactive_file:0kB unevictable:28396kB isolated(anon):128kB isolated(file):0kB mapped:12632kB dirty:268kB writeback:576kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:00:55 s1lp14 kernel: [345234.076615] Node 0 DMA free:73584kB min:2280kB low:4344kB high:6408kB active_anon:1886872kB inactive_anon:108404kB active_file:24kB inactive_file:8kB unevictable:0kB writepending:60kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:96kB pagetables:8668kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:00:55 s1lp14 kernel: [345234.076620] lowmem_reserve[]: 0 17889 17889 Mar 20 07:00:55 s1lp14 kernel: [345234.076623] Node 0 Normal free:20012kB min:20244kB low:38560kB high:56876kB active_anon:16360532kB inactive_anon:1298104kB active_file:824kB inactive_file:0kB unevictable:28396kB writepending:484kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8032kB pagetables:75760kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:00:55 s1lp14 kernel: [345234.076627] lowmem_reserve[]: 0 0 0 Mar 20 07:00:55 s1lp14 kernel: [345234.076630] Node 0 DMA: 113*4kB (UM) 120*8kB (UME) 50*16kB (UM) 31*32kB (UME) 24*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73732kB Mar 20 07:00:55 s1lp14 kernel: [345234.076641] Node 0 Normal: 907*4kB (UME) 682*8kB (UME) 380*16kB (UME) 195*32kB (UME) 13*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 22236kB Mar 20 07:00:55 s1lp14 kernel: [345234.076652] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:00:55 s1lp14 kernel: [345234.076653] 22169 total pagecache pages Mar 20 07:00:55 s1lp14 kernel: [345234.076654] 18994 pages in swap cache Mar 20 07:00:55 s1lp14 kernel: [345234.076655] Swap cache stats: add 2521070, delete 2501923, find 13707/22815 Mar 20 07:00:55 s1lp14 kernel: [345234.076656] Free swap = 0kB Mar 20 07:00:55 s1lp14 kernel: [345234.076656] Total swap = 640412kB Mar 20 07:00:55 s1lp14 kernel: [345234.076657] 5242880 pages RAM Mar 20 07:00:55 s1lp14 kernel: [345234.076657] 0 pages HighMem/MovableOnly Mar 20 07:00:55 s1lp14 kernel: [345234.076658] 142387 pages reserved Mar 20 07:00:55 s1lp14 kernel: [345234.076659] 0 pages cma reserved Mar 20 07:00:55 s1lp14 kernel: [345234.076659] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:00:55 s1lp14 kernel: [345234.076663] [ 551] 0 551 10702 453 124928 266 0 systemd-journal Mar 20 07:00:55 s1lp14 kernel: [345234.076665] [ 635] 0 635 3774 389 86016 568 -1000 systemd-udevd Mar 20 07:00:55 s1lp14 kernel: [345234.076668] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:00:55 s1lp14 kernel: [345234.076670] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:00:55 s1lp14 kernel: [345234.076672] [ 1078] 100 1078 20782 582 100352 150 0 systemd-timesyn Mar 20 07:00:55 s1lp14 kernel: [345234.076673] [ 1132] 102 1132 2482 514 98304 182 0 systemd-resolve Mar 20 07:00:55 s1lp14 kernel: [345234.076675] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:00:55 s1lp14 kernel: [345234.076676] [ 1226] 0 1226 1547 405 79872 91 0 cron Mar 20 07:00:55 s1lp14 kernel: [345234.076678] [ 1229] 0 1229 2444 518 98304 181 0 systemd-logind Mar 20 07:00:55 s1lp14 kernel: [345234.076680] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:00:55 s1lp14 kernel: [345234.076682] [ 1255] 0 1255 58495 441 131072 214 0 accounts-daemon Mar 20 07:00:55 s1lp14 kernel: [345234.076684] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:00:55 s1lp14 kernel: [345234.076686] [ 1259] 0 1259 20060 507 83968 59 0 irqbalance Mar 20 07:00:55 s1lp14 kernel: [345234.076687] [ 1265] 0 1265 2673 1213 83968 310 0 pkcsslotd Mar 20 07:00:55 s1lp14 kernel: [345234.076689] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:00:55 s1lp14 kernel: [345234.076691] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:00:55 s1lp14 kernel: [345234.076693] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:00:55 s1lp14 kernel: [345234.076695] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:00:55 s1lp14 kernel: [345234.076697] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:00:55 s1lp14 kernel: [345234.076698] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:00:55 s1lp14 kernel: [345234.076700] [ 7772] 101 7772 2793 555 100352 213 0 systemd-network Mar 20 07:00:55 s1lp14 kernel: [345234.076702] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:00:55 s1lp14 kernel: [345234.076704] [66598] 0 66598 394264 476 253952 1791 -900 snapd Mar 20 07:00:55 s1lp14 kernel: [345234.076706] [113723] 0 113723 2359 492 88064 115 0 wpa_supplicant Mar 20 07:00:55 s1lp14 kernel: [345234.076708] [116349] 0 116349 8972 402 83968 113 0 master Mar 20 07:00:55 s1lp14 kernel: [345234.076710] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:00:55 s1lp14 kernel: [345234.076712] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:00:55 s1lp14 kernel: [345234.076713] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:00:55 s1lp14 kernel: [345234.076715] [117440] 103 117440 54882 411 98304 139 0 rsyslogd Mar 20 07:00:55 s1lp14 kernel: [345234.076717] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:00:55 s1lp14 kernel: [345234.076718] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:00:55 s1lp14 kernel: [345234.076720] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:00:55 s1lp14 kernel: [345234.076722] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:00:55 s1lp14 kernel: [345234.076724] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:00:55 s1lp14 kernel: [345234.076725] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:00:55 s1lp14 kernel: [345234.076728] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:00:55 s1lp14 kernel: [345234.076730] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:00:55 s1lp14 kernel: [345234.076731] [70732] 111 70732 9042 437 88064 107 0 pickup Mar 20 07:00:55 s1lp14 kernel: [345234.076733] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:00:55 s1lp14 kernel: [345234.076735] [190296] 0 190296 3262 449 104448 65 -1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076737] [190297] 0 190297 3262 185 102400 69 -1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076739] [190298] 0 190298 3262 313 102400 53 -1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076740] [190299] 0 190299 3262 194 102400 65 -1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076742] [190300] 0 190300 3262 235 102400 57 -1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076744] [190302] 0 190302 3262 302 102400 64 -1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076746] [190304] 0 190304 3262 258 102400 61 -1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076748] [190307] 0 190307 3262 261 102400 63 -1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076749] [190308] 0 190308 3262 268 102400 67 -1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076751] [190418] 0 190418 1030464 889626 8353792 137693 1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076753] [190424] 0 190424 879979 876791 7149568 65 1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076755] [190430] 0 190430 856490 853313 6961152 51 1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076757] [190435] 0 190435 1085832 1082639 8796160 50 1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076759] [190441] 0 190441 633973 630798 5165056 50 1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076760] [190442] 0 190442 344228 341052 2846720 50 1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076762] [190443] 0 190443 186644 183470 1570816 50 1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076763] [190445] 0 190445 38743 35567 387072 50 1000 stress-ng Mar 20 07:00:55 s1lp14 kernel: [345234.076764] Out of memory: Kill process 190435 (stress-ng) score 1199 or sacrifice child Mar 20 07:00:55 s1lp14 kernel: [345234.076774] Killed process 190435 (stress-ng) total-vm:4343328kB, anon-rss:4330380kB, file-rss:172kB, shmem-rss:4kB Mar 20 07:00:56 s1lp14 kernel: [345235.386139] oom_reaper: reaped process 190435 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:4kB Mar 20 07:00:56 s1lp14 kernel: [345235.392030] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:00:56 s1lp14 kernel: [345235.392031] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:00:56 s1lp14 kernel: [345235.392036] CPU: 6 PID: 190445 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:00:56 s1lp14 kernel: [345235.392036] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:00:56 s1lp14 kernel: [345235.392037] Call Trace: Mar 20 07:00:56 s1lp14 kernel: [345235.392045] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:00:56 s1lp14 kernel: [345235.392049] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:00:56 s1lp14 kernel: [345235.392053] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:00:56 s1lp14 kernel: [345235.392054] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:00:56 s1lp14 kernel: [345235.392054] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:00:56 s1lp14 kernel: [345235.392057] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:00:56 s1lp14 kernel: [345235.392059] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:00:56 s1lp14 kernel: [345235.392062] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:00:56 s1lp14 kernel: [345235.392064] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:00:56 s1lp14 kernel: [345235.392064] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:00:56 s1lp14 kernel: [345235.392067] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:00:56 s1lp14 kernel: [345235.392070] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:00:56 s1lp14 kernel: [345235.392070] Mem-Info: Mar 20 07:00:56 s1lp14 kernel: [345235.392073] active_anon:4557980 inactive_anon:351995 isolated_anon:128 Mar 20 07:00:56 s1lp14 kernel: [345235.392073] active_file:47 inactive_file:84 isolated_file:0 Mar 20 07:00:56 s1lp14 kernel: [345235.392073] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 07:00:56 s1lp14 kernel: [345235.392073] slab_reclaimable:17360 slab_unreclaimable:40902 Mar 20 07:00:56 s1lp14 kernel: [345235.392073] mapped:2354 shmem:1004 pagetables:24987 bounce:0 Mar 20 07:00:56 s1lp14 kernel: [345235.392073] free:23228 free_pcp:243 free_cma:0 Mar 20 07:00:56 s1lp14 kernel: [345235.392076] Node 0 active_anon:18231920kB inactive_anon:1407980kB active_file:188kB inactive_file:336kB unevictable:28396kB isolated(anon):512kB isolated(file):0kB mapped:9416kB dirty:0kB writeback:0kB shmem:4016kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:00:56 s1lp14 kernel: [345235.392076] Node 0 DMA free:73568kB min:2280kB low:4344kB high:6408kB active_anon:1906368kB inactive_anon:88196kB active_file:16kB inactive_file:188kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:96kB pagetables:9088kB bounce:0kB free_pcp:476kB local_pcp:44kB free_cma:0kB Mar 20 07:00:56 s1lp14 kernel: [345235.392079] lowmem_reserve[]: 0 17889 17889 Mar 20 07:00:56 s1lp14 kernel: [345235.392080] Node 0 Normal free:19344kB min:20244kB low:38560kB high:56876kB active_anon:16325056kB inactive_anon:1319380kB active_file:328kB inactive_file:1892kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8064kB pagetables:90860kB bounce:0kB free_pcp:496kB local_pcp:84kB free_cma:0kB Mar 20 07:00:56 s1lp14 kernel: [345235.392083] lowmem_reserve[]: 0 0 0 Mar 20 07:00:56 s1lp14 kernel: [345235.392084] Node 0 DMA: 3*4kB (U) 13*8kB (UME) 44*16kB (U) 42*32kB (UME) 33*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73268kB Mar 20 07:00:56 s1lp14 kernel: [345235.392090] Node 0 Normal: 9*4kB (UE) 307*8kB (UME) 231*16kB (UME) 420*32kB (UM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB = 19628kB Mar 20 07:00:56 s1lp14 kernel: [345235.392096] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:00:56 s1lp14 kernel: [345235.392096] 22151 total pagecache pages Mar 20 07:00:56 s1lp14 kernel: [345235.392097] 18857 pages in swap cache Mar 20 07:00:56 s1lp14 kernel: [345235.392098] Swap cache stats: add 2521381, delete 2502371, find 13840/23027 Mar 20 07:00:56 s1lp14 kernel: [345235.392098] Free swap = 0kB Mar 20 07:00:56 s1lp14 kernel: [345235.392098] Total swap = 640412kB Mar 20 07:00:56 s1lp14 kernel: [345235.392099] 5242880 pages RAM Mar 20 07:00:56 s1lp14 kernel: [345235.392099] 0 pages HighMem/MovableOnly Mar 20 07:00:56 s1lp14 kernel: [345235.392099] 142387 pages reserved Mar 20 07:00:56 s1lp14 kernel: [345235.392100] 0 pages cma reserved Mar 20 07:00:56 s1lp14 kernel: [345235.392100] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:00:56 s1lp14 kernel: [345235.392103] [ 551] 0 551 10702 616 124928 266 0 systemd-journal Mar 20 07:00:56 s1lp14 kernel: [345235.392104] [ 635] 0 635 3774 389 86016 569 -1000 systemd-udevd Mar 20 07:00:56 s1lp14 kernel: [345235.392105] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:00:56 s1lp14 kernel: [345235.392106] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:00:56 s1lp14 kernel: [345235.392107] [ 1078] 100 1078 20782 581 100352 151 0 systemd-timesyn Mar 20 07:00:56 s1lp14 kernel: [345235.392108] [ 1132] 102 1132 2482 514 98304 182 0 systemd-resolve Mar 20 07:00:56 s1lp14 kernel: [345235.392109] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:00:56 s1lp14 kernel: [345235.392110] [ 1226] 0 1226 1547 405 79872 91 0 cron Mar 20 07:00:56 s1lp14 kernel: [345235.392111] [ 1229] 0 1229 2444 517 98304 182 0 systemd-logind Mar 20 07:00:56 s1lp14 kernel: [345235.392112] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:00:56 s1lp14 kernel: [345235.392113] [ 1255] 0 1255 58495 422 131072 214 0 accounts-daemon Mar 20 07:00:56 s1lp14 kernel: [345235.392114] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:00:56 s1lp14 kernel: [345235.392115] [ 1259] 0 1259 20060 506 83968 60 0 irqbalance Mar 20 07:00:56 s1lp14 kernel: [345235.392115] [ 1265] 0 1265 2673 551 83968 310 0 pkcsslotd Mar 20 07:00:56 s1lp14 kernel: [345235.392116] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:00:56 s1lp14 kernel: [345235.392117] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:00:56 s1lp14 kernel: [345235.392118] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:00:56 s1lp14 kernel: [345235.392119] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:00:56 s1lp14 kernel: [345235.392120] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:00:56 s1lp14 kernel: [345235.392121] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:00:56 s1lp14 kernel: [345235.392122] [ 7772] 101 7772 2793 555 100352 213 0 systemd-network Mar 20 07:00:56 s1lp14 kernel: [345235.392123] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:00:56 s1lp14 kernel: [345235.392124] [66598] 0 66598 394264 630 253952 1664 -900 snapd Mar 20 07:00:56 s1lp14 kernel: [345235.392125] [113723] 0 113723 2359 429 88064 117 0 wpa_supplicant Mar 20 07:00:56 s1lp14 kernel: [345235.392126] [116349] 0 116349 8972 396 83968 119 0 master Mar 20 07:00:56 s1lp14 kernel: [345235.392126] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:00:56 s1lp14 kernel: [345235.392127] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:00:56 s1lp14 kernel: [345235.392128] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:00:56 s1lp14 kernel: [345235.392129] [117440] 103 117440 54882 262 98304 140 0 rsyslogd Mar 20 07:00:56 s1lp14 kernel: [345235.392130] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:00:56 s1lp14 kernel: [345235.392131] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:00:56 s1lp14 kernel: [345235.392132] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:00:56 s1lp14 kernel: [345235.392133] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:00:56 s1lp14 kernel: [345235.392134] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:00:56 s1lp14 kernel: [345235.392135] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:00:56 s1lp14 kernel: [345235.392136] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:00:56 s1lp14 kernel: [345235.392137] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:00:56 s1lp14 kernel: [345235.392138] [70732] 111 70732 9042 437 88064 107 0 pickup Mar 20 07:00:56 s1lp14 kernel: [345235.392139] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:00:56 s1lp14 kernel: [345235.392140] [190296] 0 190296 3262 454 104448 65 -1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392141] [190297] 0 190297 3262 185 102400 69 -1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392142] [190298] 0 190298 3262 313 102400 53 -1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392143] [190299] 0 190299 3262 194 102400 65 -1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392144] [190300] 0 190300 3262 235 102400 57 -1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392144] [190302] 0 190302 3262 302 102400 64 -1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392145] [190304] 0 190304 3262 258 102400 61 -1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392147] [190307] 0 190307 3262 261 102400 63 -1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392148] [190308] 0 190308 3262 268 102400 67 -1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392149] [190418] 0 190418 1224079 1083163 9902080 137794 1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392150] [190424] 0 190424 979346 976157 7944192 66 1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392151] [190430] 0 190430 945107 941935 7669760 51 1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392152] [190441] 0 190441 797207 794033 6471680 50 1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392153] [190442] 0 190442 478868 475694 3923968 50 1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392154] [190443] 0 190443 378541 375370 3121152 50 1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392155] [190445] 0 190445 246380 243203 2048000 50 1000 stress-ng Mar 20 07:00:56 s1lp14 kernel: [345235.392156] Out of memory: Kill process 190418 (stress-ng) score 1225 or sacrifice child Mar 20 07:00:56 s1lp14 kernel: [345235.392163] Killed process 190418 (stress-ng) total-vm:4896316kB, anon-rss:4332404kB, file-rss:244kB, shmem-rss:4kB Mar 20 07:00:56 s1lp14 stress-ng: memory (MB): total 19923.80, free 824.84, shared 1.77, buffer 0.28, swap 625.40, free swap 521.52 Mar 20 07:00:57 s1lp14 stress-ng: memory (MB): total 19923.80, free 254.72, shared 1.82, buffer 0.28, swap 625.40, free swap 521.52 Mar 20 07:00:57 s1lp14 kernel: [345236.447943] oom_reaper: reaped process 190418 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:01:09 s1lp14 kernel: [345248.689023] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:01:09 s1lp14 kernel: [345248.689024] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:01:09 s1lp14 kernel: [345248.689028] CPU: 6 PID: 190445 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:01:09 s1lp14 kernel: [345248.689029] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:01:09 s1lp14 kernel: [345248.689029] Call Trace: Mar 20 07:01:09 s1lp14 kernel: [345248.689037] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:01:09 s1lp14 kernel: [345248.689040] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:01:09 s1lp14 kernel: [345248.689044] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:01:09 s1lp14 kernel: [345248.689045] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:01:09 s1lp14 kernel: [345248.689046] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:01:09 s1lp14 kernel: [345248.689048] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:01:09 s1lp14 kernel: [345248.689051] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:01:09 s1lp14 kernel: [345248.689054] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:01:09 s1lp14 kernel: [345248.689055] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:01:09 s1lp14 kernel: [345248.689056] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:01:09 s1lp14 kernel: [345248.689059] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:01:09 s1lp14 kernel: [345248.689061] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:01:09 s1lp14 kernel: [345248.689062] Mem-Info: Mar 20 07:01:09 s1lp14 kernel: [345248.689065] active_anon:4562696 inactive_anon:351415 isolated_anon:102 Mar 20 07:01:09 s1lp14 kernel: [345248.689065] active_file:61 inactive_file:0 isolated_file:0 Mar 20 07:01:09 s1lp14 kernel: [345248.689065] unevictable:7099 dirty:0 writeback:276 unstable:0 Mar 20 07:01:09 s1lp14 kernel: [345248.689065] slab_reclaimable:17334 slab_unreclaimable:40888 Mar 20 07:01:09 s1lp14 kernel: [345248.689065] mapped:2134 shmem:320 pagetables:21092 bounce:0 Mar 20 07:01:09 s1lp14 kernel: [345248.689065] free:23405 free_pcp:100 free_cma:0 Mar 20 07:01:09 s1lp14 kernel: [345248.689067] Node 0 active_anon:18250784kB inactive_anon:1405660kB active_file:244kB inactive_file:0kB unevictable:28396kB isolated(anon):408kB isolated(file):0kB mapped:8536kB dirty:0kB writeback:1104kB shmem:1280kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:01:09 s1lp14 kernel: [345248.689067] Node 0 DMA free:73780kB min:2280kB low:4344kB high:6408kB active_anon:1891796kB inactive_anon:104716kB active_file:36kB inactive_file:0kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:64kB pagetables:8024kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:01:09 s1lp14 kernel: [345248.689069] lowmem_reserve[]: 0 17889 17889 Mar 20 07:01:09 s1lp14 kernel: [345248.689071] Node 0 Normal free:19840kB min:20244kB low:38560kB high:56876kB active_anon:16358448kB inactive_anon:1301112kB active_file:468kB inactive_file:188kB unevictable:28396kB writepending:1936kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8064kB pagetables:76344kB bounce:0kB free_pcp:400kB local_pcp:140kB free_cma:0kB Mar 20 07:01:09 s1lp14 kernel: [345248.689073] lowmem_reserve[]: 0 0 0 Mar 20 07:01:09 s1lp14 kernel: [345248.689074] Node 0 DMA: 169*4kB (UM) 117*8kB (UME) 67*16kB (UM) 32*32kB (UME) 17*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73788kB Mar 20 07:01:09 s1lp14 kernel: [345248.689080] Node 0 Normal: 598*4kB (UM) 693*8kB (UME) 354*16kB (UME) 192*32kB (UME) 13*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 20576kB Mar 20 07:01:09 s1lp14 kernel: [345248.689086] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:01:09 s1lp14 kernel: [345248.689086] 16658 total pagecache pages Mar 20 07:01:09 s1lp14 kernel: [345248.689087] 14276 pages in swap cache Mar 20 07:01:09 s1lp14 kernel: [345248.689088] Swap cache stats: add 2659587, delete 2645154, find 14067/23332 Mar 20 07:01:09 s1lp14 kernel: [345248.689088] Free swap = 0kB Mar 20 07:01:09 s1lp14 kernel: [345248.689088] Total swap = 640412kB Mar 20 07:01:09 s1lp14 kernel: [345248.689089] 5242880 pages RAM Mar 20 07:01:09 s1lp14 kernel: [345248.689089] 0 pages HighMem/MovableOnly Mar 20 07:01:09 s1lp14 kernel: [345248.689089] 142387 pages reserved Mar 20 07:01:09 s1lp14 kernel: [345248.689090] 0 pages cma reserved Mar 20 07:01:09 s1lp14 kernel: [345248.689090] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:01:09 s1lp14 kernel: [345248.689092] [ 551] 0 551 10702 664 124928 268 0 systemd-journal Mar 20 07:01:09 s1lp14 kernel: [345248.689093] [ 635] 0 635 3774 389 86016 582 -1000 systemd-udevd Mar 20 07:01:09 s1lp14 kernel: [345248.689094] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:01:09 s1lp14 kernel: [345248.689095] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:01:09 s1lp14 kernel: [345248.689096] [ 1078] 100 1078 20782 580 100352 167 0 systemd-timesyn Mar 20 07:01:09 s1lp14 kernel: [345248.689097] [ 1132] 102 1132 2482 512 98304 194 0 systemd-resolve Mar 20 07:01:09 s1lp14 kernel: [345248.689098] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:01:09 s1lp14 kernel: [345248.689099] [ 1226] 0 1226 1547 422 79872 65 0 cron Mar 20 07:01:09 s1lp14 kernel: [345248.689100] [ 1229] 0 1229 2444 507 98304 192 0 systemd-logind Mar 20 07:01:09 s1lp14 kernel: [345248.689101] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:01:09 s1lp14 kernel: [345248.689102] [ 1255] 0 1255 58495 596 131072 219 0 accounts-daemon Mar 20 07:01:09 s1lp14 kernel: [345248.689102] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:01:09 s1lp14 kernel: [345248.689103] [ 1259] 0 1259 20060 532 83968 58 0 irqbalance Mar 20 07:01:09 s1lp14 kernel: [345248.689104] [ 1265] 0 1265 2673 297 83968 310 0 pkcsslotd Mar 20 07:01:09 s1lp14 kernel: [345248.689105] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:01:09 s1lp14 kernel: [345248.689106] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:01:09 s1lp14 kernel: [345248.689107] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:01:09 s1lp14 kernel: [345248.689107] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:01:09 s1lp14 kernel: [345248.689108] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:01:09 s1lp14 kernel: [345248.689109] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:01:09 s1lp14 kernel: [345248.689110] [ 7772] 101 7772 2793 555 100352 213 0 systemd-network Mar 20 07:01:09 s1lp14 kernel: [345248.689111] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:01:09 s1lp14 kernel: [345248.689112] [66598] 0 66598 394264 78 253952 2285 -900 snapd Mar 20 07:01:09 s1lp14 kernel: [345248.689113] [113723] 0 113723 2359 372 88064 122 0 wpa_supplicant Mar 20 07:01:09 s1lp14 kernel: [345248.689114] [116349] 0 116349 8972 388 83968 129 0 master Mar 20 07:01:09 s1lp14 kernel: [345248.689115] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:01:09 s1lp14 kernel: [345248.689115] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:01:09 s1lp14 kernel: [345248.689116] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:01:09 s1lp14 kernel: [345248.689117] [117440] 103 117440 54882 685 98304 158 0 rsyslogd Mar 20 07:01:09 s1lp14 kernel: [345248.689118] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:01:09 s1lp14 kernel: [345248.689119] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:01:09 s1lp14 kernel: [345248.689120] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:01:09 s1lp14 kernel: [345248.689121] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:01:09 s1lp14 kernel: [345248.689121] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:01:09 s1lp14 kernel: [345248.689122] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:01:09 s1lp14 kernel: [345248.689123] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:01:09 s1lp14 kernel: [345248.689124] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:01:09 s1lp14 kernel: [345248.689125] [70732] 111 70732 9042 420 88064 125 0 pickup Mar 20 07:01:09 s1lp14 kernel: [345248.689126] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:01:09 s1lp14 kernel: [345248.689127] [190296] 0 190296 3262 449 104448 65 -1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689128] [190297] 0 190297 3262 182 102400 72 -1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689129] [190298] 0 190298 3262 313 102400 53 -1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689129] [190299] 0 190299 3262 189 102400 70 -1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689130] [190300] 0 190300 3262 235 102400 57 -1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689131] [190302] 0 190302 3262 228 102400 64 -1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689132] [190304] 0 190304 3262 246 102400 73 -1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689133] [190307] 0 190307 3262 299 102400 51 -1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689134] [190308] 0 190308 3262 268 102400 67 -1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689135] [190424] 0 190424 1083037 943469 8773632 136421 1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689136] [190430] 0 190430 1034175 1031001 8382464 51 1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689137] [190441] 0 190441 1047429 1044248 8488960 55 1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689137] [190442] 0 190442 681916 678730 5548032 61 1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689138] [190443] 0 190443 622592 619416 5072896 50 1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689139] [190445] 0 190445 502760 499583 4114432 50 1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689140] [190448] 0 190448 78884 75705 708608 50 1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689141] [190450] 0 190450 10498 7322 159744 50 1000 stress-ng Mar 20 07:01:09 s1lp14 kernel: [345248.689141] Out of memory: Kill process 190424 (stress-ng) score 1199 or sacrifice child Mar 20 07:01:09 s1lp14 kernel: [345248.689147] Killed process 190424 (stress-ng) total-vm:4332148kB, anon-rss:3773724kB, file-rss:148kB, shmem-rss:4kB Mar 20 07:01:10 s1lp14 stress-ng: memory (MB): total 19923.80, free 310.15, shared 3.37, buffer 0.43, swap 625.40, free swap 526.21 Mar 20 07:01:10 s1lp14 kernel: [345249.277641] oom_reaper: reaped process 190424 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:01:24 s1lp14 kernel: [345263.360063] pkcsslotd invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:01:24 s1lp14 kernel: [345263.360065] pkcsslotd cpuset=/ mems_allowed=0 Mar 20 07:01:24 s1lp14 kernel: [345263.360072] CPU: 4 PID: 1265 Comm: pkcsslotd Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:01:24 s1lp14 kernel: [345263.360073] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:01:24 s1lp14 kernel: [345263.360075] Call Trace: Mar 20 07:01:24 s1lp14 kernel: [345263.360083] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:01:24 s1lp14 kernel: [345263.360088] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:01:24 s1lp14 kernel: [345263.360093] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:01:24 s1lp14 kernel: [345263.360094] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:01:24 s1lp14 kernel: [345263.360096] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:01:24 s1lp14 kernel: [345263.360099] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:01:24 s1lp14 kernel: [345263.360103] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:01:24 s1lp14 kernel: [345263.360106] [<0000000000325bd8>] __read_swap_cache_async+0x180/0x270 Mar 20 07:01:24 s1lp14 kernel: [345263.360107] [<0000000000325eac>] swapin_readahead+0x184/0x290 Mar 20 07:01:24 s1lp14 kernel: [345263.360111] [<00000000002e5932>] shmem_swapin+0x72/0xb8 Mar 20 07:01:24 s1lp14 kernel: [345263.360114] [<00000000002e74ca>] shmem_getpage_gfp+0x682/0xeb0 Mar 20 07:01:24 s1lp14 kernel: [345263.360115] [<00000000002e7fca>] shmem_fault+0x9a/0x230 Mar 20 07:01:24 s1lp14 kernel: [345263.360119] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:01:24 s1lp14 kernel: [345263.360122] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:01:24 s1lp14 kernel: [345263.360124] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:01:24 s1lp14 kernel: [345263.360128] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:01:24 s1lp14 kernel: [345263.360131] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:01:24 s1lp14 kernel: [345263.360132] Mem-Info: Mar 20 07:01:24 s1lp14 kernel: [345263.360137] active_anon:4562402 inactive_anon:351747 isolated_anon:32 Mar 20 07:01:24 s1lp14 kernel: [345263.360137] active_file:51 inactive_file:178 isolated_file:0 Mar 20 07:01:24 s1lp14 kernel: [345263.360137] unevictable:7099 dirty:0 writeback:95 unstable:0 Mar 20 07:01:24 s1lp14 kernel: [345263.360137] slab_reclaimable:17334 slab_unreclaimable:40837 Mar 20 07:01:24 s1lp14 kernel: [345263.360137] mapped:2714 shmem:915 pagetables:21076 bounce:0 Mar 20 07:01:24 s1lp14 kernel: [345263.360137] free:23376 free_pcp:358 free_cma:0 Mar 20 07:01:24 s1lp14 kernel: [345263.360141] Node 0 active_anon:18249608kB inactive_anon:1406988kB active_file:204kB inactive_file:712kB unevictable:28396kB isolated(anon):128kB isolated(file):0kB mapped:10856kB dirty:0kB writeback:380kB shmem:3660kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:01:24 s1lp14 kernel: [345263.360142] Node 0 DMA free:73476kB min:2280kB low:4344kB high:6408kB active_anon:1838188kB inactive_anon:157912kB active_file:4kB inactive_file:12kB unevictable:0kB writepending:68kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:64kB pagetables:8080kB bounce:0kB free_pcp:708kB local_pcp:232kB free_cma:0kB Mar 20 07:01:24 s1lp14 kernel: [345263.360147] lowmem_reserve[]: 0 17889 17889 Mar 20 07:01:24 s1lp14 kernel: [345263.360151] Node 0 Normal free:20028kB min:20244kB low:38560kB high:56876kB active_anon:16410840kB inactive_anon:1249228kB active_file:200kB inactive_file:704kB unevictable:28396kB writepending:24kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8000kB pagetables:76224kB bounce:0kB free_pcp:724kB local_pcp:148kB free_cma:0kB Mar 20 07:01:24 s1lp14 kernel: [345263.360155] lowmem_reserve[]: 0 0 0 Mar 20 07:01:24 s1lp14 kernel: [345263.360158] Node 0 DMA: 113*4kB (UM) 87*8kB (UE) 59*16kB (UM) 33*32kB (UME) 14*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73036kB Mar 20 07:01:24 s1lp14 kernel: [345263.360171] Node 0 Normal: 511*4kB (UME) 565*8kB (UE) 349*16kB (UME) 229*32kB (UM) 5*64kB (ME) 0*128kB 0*256kB 0*512kB 0*1024kB = 19796kB Mar 20 07:01:24 s1lp14 kernel: [345263.360183] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:01:24 s1lp14 kernel: [345263.360184] 22970 total pagecache pages Mar 20 07:01:24 s1lp14 kernel: [345263.360185] 19775 pages in swap cache Mar 20 07:01:24 s1lp14 kernel: [345263.360187] Swap cache stats: add 2797884, delete 2777951, find 14690/24137 Mar 20 07:01:24 s1lp14 kernel: [345263.360188] Free swap = 0kB Mar 20 07:01:24 s1lp14 kernel: [345263.360188] Total swap = 640412kB Mar 20 07:01:24 s1lp14 kernel: [345263.360189] 5242880 pages RAM Mar 20 07:01:24 s1lp14 kernel: [345263.360190] 0 pages HighMem/MovableOnly Mar 20 07:01:24 s1lp14 kernel: [345263.360190] 142387 pages reserved Mar 20 07:01:24 s1lp14 kernel: [345263.360191] 0 pages cma reserved Mar 20 07:01:24 s1lp14 kernel: [345263.360192] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:01:24 s1lp14 kernel: [345263.360195] [ 551] 0 551 12750 634 135168 267 0 systemd-journal Mar 20 07:01:24 s1lp14 kernel: [345263.360197] [ 635] 0 635 3774 389 86016 582 -1000 systemd-udevd Mar 20 07:01:24 s1lp14 kernel: [345263.360200] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:01:24 s1lp14 kernel: [345263.360201] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:01:24 s1lp14 kernel: [345263.360203] [ 1078] 100 1078 20782 580 100352 167 0 systemd-timesyn Mar 20 07:01:24 s1lp14 kernel: [345263.360205] [ 1132] 102 1132 2482 512 98304 194 0 systemd-resolve Mar 20 07:01:24 s1lp14 kernel: [345263.360207] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:01:24 s1lp14 kernel: [345263.360209] [ 1226] 0 1226 1547 422 79872 65 0 cron Mar 20 07:01:24 s1lp14 kernel: [345263.360210] [ 1229] 0 1229 2444 507 98304 192 0 systemd-logind Mar 20 07:01:24 s1lp14 kernel: [345263.360212] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:01:24 s1lp14 kernel: [345263.360214] [ 1255] 0 1255 58495 598 131072 217 0 accounts-daemon Mar 20 07:01:24 s1lp14 kernel: [345263.360216] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:01:24 s1lp14 kernel: [345263.360218] [ 1259] 0 1259 20060 508 83968 58 0 irqbalance Mar 20 07:01:24 s1lp14 kernel: [345263.360220] [ 1265] 0 1265 2673 1021 83968 308 0 pkcsslotd Mar 20 07:01:24 s1lp14 kernel: [345263.360221] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:01:24 s1lp14 kernel: [345263.360223] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:01:24 s1lp14 kernel: [345263.360225] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:01:24 s1lp14 kernel: [345263.360226] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:01:24 s1lp14 kernel: [345263.360229] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:01:24 s1lp14 kernel: [345263.360230] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:01:24 s1lp14 kernel: [345263.360232] [ 7772] 101 7772 2793 555 100352 213 0 systemd-network Mar 20 07:01:24 s1lp14 kernel: [345263.360234] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:01:24 s1lp14 kernel: [345263.360236] [66598] 0 66598 394264 78 253952 2403 -900 snapd Mar 20 07:01:24 s1lp14 kernel: [345263.360238] [113723] 0 113723 2359 491 88064 115 0 wpa_supplicant Mar 20 07:01:24 s1lp14 kernel: [345263.360240] [116349] 0 116349 8972 388 83968 130 0 master Mar 20 07:01:24 s1lp14 kernel: [345263.360241] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:01:24 s1lp14 kernel: [345263.360244] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:01:24 s1lp14 kernel: [345263.360246] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:01:24 s1lp14 kernel: [345263.360247] [117440] 103 117440 54882 695 98304 140 0 rsyslogd Mar 20 07:01:24 s1lp14 kernel: [345263.360249] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:01:24 s1lp14 kernel: [345263.360251] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:01:24 s1lp14 kernel: [345263.360253] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:01:24 s1lp14 kernel: [345263.360255] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:01:24 s1lp14 kernel: [345263.360257] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:01:24 s1lp14 kernel: [345263.360259] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:01:24 s1lp14 kernel: [345263.360260] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:01:24 s1lp14 kernel: [345263.360262] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:01:24 s1lp14 kernel: [345263.360264] [70732] 111 70732 9042 420 88064 125 0 pickup Mar 20 07:01:24 s1lp14 kernel: [345263.360266] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:01:24 s1lp14 kernel: [345263.360268] [190296] 0 190296 3262 377 104448 65 -1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360270] [190297] 0 190297 3262 226 102400 67 -1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360272] [190298] 0 190298 3262 308 102400 58 -1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360274] [190299] 0 190299 3262 184 102400 75 -1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360276] [190300] 0 190300 3262 230 102400 62 -1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360278] [190302] 0 190302 3262 223 102400 69 -1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360280] [190304] 0 190304 3262 241 102400 78 -1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360282] [190307] 0 190307 3262 294 102400 56 -1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360284] [190308] 0 190308 3262 255 102400 87 -1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360286] [190430] 0 190430 1100538 960490 8912896 136879 1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360288] [190441] 0 190441 1212990 1209844 9814016 60 1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360290] [190442] 0 190442 834425 831189 6785024 66 1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360291] [190443] 0 190443 827359 824225 6727680 55 1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360294] [190445] 0 190445 804010 800889 6524928 55 1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360295] [190448] 0 190448 155075 151846 1316864 55 1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360297] [190450] 0 190450 84273 81041 751616 55 1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360299] [190451] 0 190451 37157 33937 374784 51 1000 stress-ng Mar 20 07:01:24 s1lp14 kernel: [345263.360301] Out of memory: Kill process 190441 (stress-ng) score 1223 or sacrifice child Mar 20 07:01:24 s1lp14 kernel: [345263.360309] Killed process 190441 (stress-ng) total-vm:4851960kB, anon-rss:4838988kB, file-rss:384kB, shmem-rss:4kB Mar 20 07:01:25 s1lp14 kernel: [345264.790935] oom_reaper: reaped process 190441 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:01:25 s1lp14 stress-ng: memory (MB): total 19923.80, free 96.33, shared 3.95, buffer 0.39, swap 625.40, free swap 0.00 Mar 20 07:01:28 s1lp14 kernel: [345267.976842] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:01:28 s1lp14 kernel: [345267.976845] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:01:28 s1lp14 kernel: [345267.976851] CPU: 4 PID: 190451 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:01:28 s1lp14 kernel: [345267.976852] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:01:28 s1lp14 kernel: [345267.976853] Call Trace: Mar 20 07:01:28 s1lp14 kernel: [345267.976861] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:01:28 s1lp14 kernel: [345267.976865] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:01:28 s1lp14 kernel: [345267.976869] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:01:28 s1lp14 kernel: [345267.976871] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:01:28 s1lp14 kernel: [345267.976872] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:01:28 s1lp14 kernel: [345267.976874] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:01:28 s1lp14 kernel: [345267.976877] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:01:28 s1lp14 kernel: [345267.976881] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:01:28 s1lp14 kernel: [345267.976882] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:01:28 s1lp14 kernel: [345267.976884] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:01:28 s1lp14 kernel: [345267.976886] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:01:28 s1lp14 kernel: [345267.976889] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:01:28 s1lp14 kernel: [345267.976890] Mem-Info: Mar 20 07:01:28 s1lp14 kernel: [345267.976894] active_anon:4562564 inactive_anon:351509 isolated_anon:160 Mar 20 07:01:28 s1lp14 kernel: [345267.976894] active_file:100 inactive_file:18 isolated_file:1 Mar 20 07:01:28 s1lp14 kernel: [345267.976894] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 07:01:28 s1lp14 kernel: [345267.976894] slab_reclaimable:17310 slab_unreclaimable:40845 Mar 20 07:01:28 s1lp14 kernel: [345267.976894] mapped:1867 shmem:1012 pagetables:21157 bounce:0 Mar 20 07:01:28 s1lp14 kernel: [345267.976894] free:23371 free_pcp:0 free_cma:0 Mar 20 07:01:28 s1lp14 kernel: [345267.976897] Node 0 active_anon:18250256kB inactive_anon:1406036kB active_file:400kB inactive_file:72kB unevictable:28396kB isolated(anon):640kB isolated(file):4kB mapped:7468kB dirty:0kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:01:28 s1lp14 kernel: [345267.976898] Node 0 DMA free:73828kB min:2280kB low:4344kB high:6408kB active_anon:1872364kB inactive_anon:123500kB active_file:20kB inactive_file:0kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:8188kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:01:28 s1lp14 kernel: [345267.976901] lowmem_reserve[]: 0 17889 17889 Mar 20 07:01:28 s1lp14 kernel: [345267.976904] Node 0 Normal free:19656kB min:20244kB low:38560kB high:56876kB active_anon:16378360kB inactive_anon:1282640kB active_file:380kB inactive_file:0kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7984kB pagetables:76440kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:01:28 s1lp14 kernel: [345267.976907] lowmem_reserve[]: 0 0 0 Mar 20 07:01:28 s1lp14 kernel: [345267.976908] Node 0 DMA: 172*4kB (UM) 97*8kB (UME) 35*16kB (U) 44*32kB (UME) 22*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73832kB Mar 20 07:01:28 s1lp14 kernel: [345267.976917] Node 0 Normal: 754*4kB (UM) 683*8kB (UME) 413*16kB (UME) 144*32kB (UME) 14*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 20592kB Mar 20 07:01:28 s1lp14 kernel: [345267.976926] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:01:28 s1lp14 kernel: [345267.976926] 3081 total pagecache pages Mar 20 07:01:28 s1lp14 kernel: [345267.976927] 2 pages in swap cache Mar 20 07:01:28 s1lp14 kernel: [345267.976928] Swap cache stats: add 2798258, delete 2798098, find 14851/24376 Mar 20 07:01:28 s1lp14 kernel: [345267.976929] Free swap = 0kB Mar 20 07:01:28 s1lp14 kernel: [345267.976929] Total swap = 640412kB Mar 20 07:01:28 s1lp14 kernel: [345267.976929] 5242880 pages RAM Mar 20 07:01:28 s1lp14 kernel: [345267.976930] 0 pages HighMem/MovableOnly Mar 20 07:01:28 s1lp14 kernel: [345267.976930] 142387 pages reserved Mar 20 07:01:28 s1lp14 kernel: [345267.976931] 0 pages cma reserved Mar 20 07:01:28 s1lp14 kernel: [345267.976932] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:01:28 s1lp14 kernel: [345267.976935] [ 551] 0 551 12750 422 135168 267 0 systemd-journal Mar 20 07:01:28 s1lp14 kernel: [345267.976937] [ 635] 0 635 3774 389 86016 582 -1000 systemd-udevd Mar 20 07:01:28 s1lp14 kernel: [345267.976938] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:01:28 s1lp14 kernel: [345267.976940] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:01:28 s1lp14 kernel: [345267.976941] [ 1078] 100 1078 20782 580 100352 167 0 systemd-timesyn Mar 20 07:01:28 s1lp14 kernel: [345267.976942] [ 1132] 102 1132 2482 512 98304 194 0 systemd-resolve Mar 20 07:01:28 s1lp14 kernel: [345267.976943] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:01:28 s1lp14 kernel: [345267.976944] [ 1226] 0 1226 1547 422 79872 65 0 cron Mar 20 07:01:28 s1lp14 kernel: [345267.976946] [ 1229] 0 1229 2444 507 98304 192 0 systemd-logind Mar 20 07:01:28 s1lp14 kernel: [345267.976947] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:01:28 s1lp14 kernel: [345267.976949] [ 1255] 0 1255 58495 600 131072 215 0 accounts-daemon Mar 20 07:01:28 s1lp14 kernel: [345267.976950] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:01:28 s1lp14 kernel: [345267.976951] [ 1259] 0 1259 20060 508 83968 58 0 irqbalance Mar 20 07:01:28 s1lp14 kernel: [345267.976953] [ 1265] 0 1265 2673 215 83968 308 0 pkcsslotd Mar 20 07:01:28 s1lp14 kernel: [345267.976954] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:01:28 s1lp14 kernel: [345267.976956] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:01:28 s1lp14 kernel: [345267.976957] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:01:28 s1lp14 kernel: [345267.976958] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:01:28 s1lp14 kernel: [345267.976959] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:01:28 s1lp14 kernel: [345267.976961] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:01:28 s1lp14 kernel: [345267.976962] [ 7772] 101 7772 2793 497 100352 213 0 systemd-network Mar 20 07:01:28 s1lp14 kernel: [345267.976963] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:01:28 s1lp14 kernel: [345267.976964] [66598] 0 66598 394264 78 253952 2410 -900 snapd Mar 20 07:01:28 s1lp14 kernel: [345267.976966] [113723] 0 113723 2359 491 88064 115 0 wpa_supplicant Mar 20 07:01:28 s1lp14 kernel: [345267.976967] [116349] 0 116349 8972 388 83968 130 0 master Mar 20 07:01:28 s1lp14 kernel: [345267.976968] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:01:28 s1lp14 kernel: [345267.976970] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:01:28 s1lp14 kernel: [345267.976971] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:01:28 s1lp14 kernel: [345267.976973] [117440] 103 117440 54882 473 98304 140 0 rsyslogd Mar 20 07:01:28 s1lp14 kernel: [345267.976974] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:01:28 s1lp14 kernel: [345267.976975] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:01:28 s1lp14 kernel: [345267.976977] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:01:28 s1lp14 kernel: [345267.976978] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:01:28 s1lp14 kernel: [345267.976979] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:01:28 s1lp14 kernel: [345267.976980] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:01:28 s1lp14 kernel: [345267.976982] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:01:28 s1lp14 kernel: [345267.976983] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:01:28 s1lp14 kernel: [345267.976984] [70732] 111 70732 9042 420 88064 125 0 pickup Mar 20 07:01:28 s1lp14 kernel: [345267.976986] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:01:28 s1lp14 kernel: [345267.976987] [190296] 0 190296 3262 444 104448 65 -1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.976988] [190297] 0 190297 3262 218 102400 74 -1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.976990] [190298] 0 190298 3262 305 102400 60 -1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.976991] [190299] 0 190299 3262 259 102400 64 -1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.976993] [190300] 0 190300 3262 227 102400 64 -1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.976994] [190302] 0 190302 3262 220 102400 71 -1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.976995] [190304] 0 190304 3262 238 102400 80 -1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.976996] [190307] 0 190307 3262 291 102400 58 -1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.976998] [190308] 0 190308 3262 254 102400 89 -1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.976999] [190430] 0 190430 1101314 961156 8919040 137032 1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.977001] [190442] 0 190442 887662 884466 7211008 68 1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.977002] [190443] 0 190443 1105438 1102221 8953856 58 1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.977003] [190445] 0 190445 1102739 1099549 8931328 60 1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.977004] [190448] 0 190448 332643 329461 2754560 57 1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.977005] [190450] 0 190450 226201 223019 1886208 57 1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.977007] [190451] 0 190451 315016 311835 2613248 57 1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.977008] [190456] 0 190456 4741 1560 114688 57 1000 stress-ng Mar 20 07:01:28 s1lp14 kernel: [345267.977009] Out of memory: Kill process 190443 (stress-ng) score 1203 or sacrifice child Mar 20 07:01:28 s1lp14 kernel: [345267.977018] Killed process 190443 (stress-ng) total-vm:4421752kB, anon-rss:4408776kB, file-rss:108kB, shmem-rss:0kB Mar 20 07:01:29 s1lp14 kernel: [345268.508185] oom_reaper: reaped process 190443 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:01:29 s1lp14 stress-ng: memory (MB): total 19923.80, free 1860.24, shared 3.95, buffer 0.39, swap 625.40, free swap 0.00 Mar 20 07:01:29 s1lp14 kernel: [345268.860006] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:01:29 s1lp14 kernel: [345268.860008] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:01:29 s1lp14 kernel: [345268.860015] CPU: 2 PID: 190457 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:01:29 s1lp14 kernel: [345268.860016] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:01:29 s1lp14 kernel: [345268.860017] Call Trace: Mar 20 07:01:29 s1lp14 kernel: [345268.860026] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:01:29 s1lp14 kernel: [345268.860030] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:01:29 s1lp14 kernel: [345268.860035] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:01:29 s1lp14 kernel: [345268.860037] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:01:29 s1lp14 kernel: [345268.860038] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:01:29 s1lp14 kernel: [345268.860041] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:01:29 s1lp14 kernel: [345268.860045] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:01:29 s1lp14 kernel: [345268.860048] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:01:29 s1lp14 kernel: [345268.860050] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:01:29 s1lp14 kernel: [345268.860052] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:01:29 s1lp14 kernel: [345268.860055] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:01:29 s1lp14 kernel: [345268.860058] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:01:29 s1lp14 kernel: [345268.860059] Mem-Info: Mar 20 07:01:29 s1lp14 kernel: [345268.860063] active_anon:4632807 inactive_anon:281199 isolated_anon:128 Mar 20 07:01:29 s1lp14 kernel: [345268.860063] active_file:203 inactive_file:57 isolated_file:0 Mar 20 07:01:29 s1lp14 kernel: [345268.860063] unevictable:7099 dirty:0 writeback:137 unstable:0 Mar 20 07:01:29 s1lp14 kernel: [345268.860063] slab_reclaimable:17310 slab_unreclaimable:40923 Mar 20 07:01:29 s1lp14 kernel: [345268.860063] mapped:2052 shmem:1012 pagetables:21079 bounce:0 Mar 20 07:01:29 s1lp14 kernel: [345268.860063] free:23487 free_pcp:2 free_cma:0 Mar 20 07:01:29 s1lp14 kernel: [345268.860067] Node 0 active_anon:18531228kB inactive_anon:1124796kB active_file:812kB inactive_file:228kB unevictable:28396kB isolated(anon):512kB isolated(file):0kB mapped:8208kB dirty:0kB writeback:548kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:01:29 s1lp14 kernel: [345268.860068] Node 0 DMA free:73828kB min:2280kB low:4344kB high:6408kB active_anon:1840000kB inactive_anon:155652kB active_file:12kB inactive_file:4kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:64kB pagetables:7908kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:01:29 s1lp14 kernel: [345268.860072] lowmem_reserve[]: 0 17889 17889 Mar 20 07:01:29 s1lp14 kernel: [345268.860075] Node 0 Normal free:20120kB min:20244kB low:38560kB high:56876kB active_anon:16692164kB inactive_anon:968872kB active_file:1352kB inactive_file:532kB unevictable:28396kB writepending:840kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8000kB pagetables:76408kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB Mar 20 07:01:29 s1lp14 kernel: [345268.860079] lowmem_reserve[]: 0 0 0 Mar 20 07:01:29 s1lp14 kernel: [345268.860081] Node 0 DMA: 50*4kB (UM) 121*8kB (UE) 70*16kB (UM) 38*32kB (UME) 25*64kB (UM) 7*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74096kB Mar 20 07:01:29 s1lp14 kernel: [345268.860093] Node 0 Normal: 598*4kB (UME) 689*8kB (UME) 326*16kB (UME) 222*32kB (UME) 10*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 20864kB Mar 20 07:01:29 s1lp14 kernel: [345268.860103] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:01:29 s1lp14 kernel: [345268.860104] 3267 total pagecache pages Mar 20 07:01:29 s1lp14 kernel: [345268.860105] 19 pages in swap cache Mar 20 07:01:29 s1lp14 kernel: [345268.860106] Swap cache stats: add 2798316, delete 2798139, find 14886/24447 Mar 20 07:01:29 s1lp14 kernel: [345268.860107] Free swap = 0kB Mar 20 07:01:29 s1lp14 kernel: [345268.860107] Total swap = 640412kB Mar 20 07:01:29 s1lp14 kernel: [345268.860108] 5242880 pages RAM Mar 20 07:01:29 s1lp14 kernel: [345268.860109] 0 pages HighMem/MovableOnly Mar 20 07:01:29 s1lp14 kernel: [345268.860109] 142387 pages reserved Mar 20 07:01:29 s1lp14 kernel: [345268.860110] 0 pages cma reserved Mar 20 07:01:29 s1lp14 kernel: [345268.860110] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:01:29 s1lp14 kernel: [345268.860114] [ 551] 0 551 12750 628 135168 267 0 systemd-journal Mar 20 07:01:29 s1lp14 kernel: [345268.860117] [ 635] 0 635 3774 389 86016 582 -1000 systemd-udevd Mar 20 07:01:29 s1lp14 kernel: [345268.860119] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:01:29 s1lp14 kernel: [345268.860121] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:01:29 s1lp14 kernel: [345268.860123] [ 1078] 100 1078 20782 580 100352 167 0 systemd-timesyn Mar 20 07:01:29 s1lp14 kernel: [345268.860125] [ 1132] 102 1132 2482 512 98304 194 0 systemd-resolve Mar 20 07:01:29 s1lp14 kernel: [345268.860127] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:01:29 s1lp14 kernel: [345268.860128] [ 1226] 0 1226 1547 422 79872 65 0 cron Mar 20 07:01:29 s1lp14 kernel: [345268.860130] [ 1229] 0 1229 2444 507 98304 192 0 systemd-logind Mar 20 07:01:29 s1lp14 kernel: [345268.860132] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:01:29 s1lp14 kernel: [345268.860134] [ 1255] 0 1255 58495 510 131072 215 0 accounts-daemon Mar 20 07:01:29 s1lp14 kernel: [345268.860135] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:01:29 s1lp14 kernel: [345268.860137] [ 1259] 0 1259 20060 508 83968 58 0 irqbalance Mar 20 07:01:29 s1lp14 kernel: [345268.860139] [ 1265] 0 1265 2673 215 83968 308 0 pkcsslotd Mar 20 07:01:29 s1lp14 kernel: [345268.860140] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:01:29 s1lp14 kernel: [345268.860142] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:01:29 s1lp14 kernel: [345268.860144] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:01:29 s1lp14 kernel: [345268.860146] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:01:29 s1lp14 kernel: [345268.860148] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:01:29 s1lp14 kernel: [345268.860150] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:01:29 s1lp14 kernel: [345268.860152] [ 7772] 101 7772 2793 492 100352 200 0 systemd-network Mar 20 07:01:29 s1lp14 kernel: [345268.860154] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:01:29 s1lp14 kernel: [345268.860156] [66598] 0 66598 394264 78 253952 2410 -900 snapd Mar 20 07:01:29 s1lp14 kernel: [345268.860158] [113723] 0 113723 2359 439 88064 115 0 wpa_supplicant Mar 20 07:01:29 s1lp14 kernel: [345268.860160] [116349] 0 116349 8972 388 83968 130 0 master Mar 20 07:01:29 s1lp14 kernel: [345268.860161] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:01:29 s1lp14 kernel: [345268.860163] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:01:29 s1lp14 kernel: [345268.860165] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:01:29 s1lp14 kernel: [345268.860167] [117440] 103 117440 54882 584 98304 140 0 rsyslogd Mar 20 07:01:29 s1lp14 kernel: [345268.860169] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:01:29 s1lp14 kernel: [345268.860171] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:01:29 s1lp14 kernel: [345268.860172] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:01:29 s1lp14 kernel: [345268.860174] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:01:29 s1lp14 kernel: [345268.860176] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:01:29 s1lp14 kernel: [345268.860178] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:01:29 s1lp14 kernel: [345268.860179] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:01:29 s1lp14 kernel: [345268.860181] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:01:29 s1lp14 kernel: [345268.860183] [70732] 111 70732 9042 420 88064 125 0 pickup Mar 20 07:01:29 s1lp14 kernel: [345268.860185] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:01:29 s1lp14 kernel: [345268.860187] [190296] 0 190296 3262 444 104448 65 -1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860189] [190297] 0 190297 3262 218 102400 74 -1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860191] [190298] 0 190298 3262 232 102400 59 -1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860193] [190299] 0 190299 3262 259 102400 64 -1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860195] [190300] 0 190300 3262 227 102400 64 -1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860197] [190302] 0 190302 3262 220 102400 71 -1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860199] [190304] 0 190304 3262 238 102400 80 -1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860201] [190307] 0 190307 3262 291 102400 58 -1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860202] [190308] 0 190308 3262 254 102400 89 -1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860204] [190430] 0 190430 1101828 961667 8923136 137033 1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860206] [190442] 0 190442 987684 984471 8011776 71 1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860208] [190445] 0 190445 1314836 1311623 10629120 71 1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860210] [190448] 0 190448 504533 501346 4128768 58 1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860212] [190450] 0 190450 226201 223015 1886208 61 1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860214] [190451] 0 190451 638542 635362 5201920 57 1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860215] [190456] 0 190456 196933 193753 1652736 57 1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860217] [190457] 0 190457 105045 101870 917504 51 1000 stress-ng Mar 20 07:01:29 s1lp14 kernel: [345268.860219] Out of memory: Kill process 190445 (stress-ng) score 1242 or sacrifice child Mar 20 07:01:29 s1lp14 kernel: [345268.860228] Killed process 190445 (stress-ng) total-vm:5259344kB, anon-rss:5246316kB, file-rss:172kB, shmem-rss:4kB Mar 20 07:01:30 s1lp14 stress-ng: memory (MB): total 19923.80, free 1067.07, shared 3.95, buffer 0.38, swap 625.40, free swap 0.05 Mar 20 07:01:30 s1lp14 kernel: [345269.515864] oom_reaper: reaped process 190445 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:01:31 s1lp14 kernel: [345269.889337] gmain invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:01:31 s1lp14 kernel: [345269.889339] gmain cpuset=/ mems_allowed=0 Mar 20 07:01:31 s1lp14 kernel: [345269.889345] CPU: 7 PID: 1266 Comm: gmain Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:01:31 s1lp14 kernel: [345269.889346] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:01:31 s1lp14 kernel: [345269.889347] Call Trace: Mar 20 07:01:31 s1lp14 kernel: [345269.889356] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:01:31 s1lp14 kernel: [345269.889361] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:01:31 s1lp14 kernel: [345269.889365] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:01:31 s1lp14 kernel: [345269.889367] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:01:31 s1lp14 kernel: [345269.889368] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:01:31 s1lp14 kernel: [345269.889372] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:01:31 s1lp14 kernel: [345269.889373] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:01:31 s1lp14 kernel: [345269.889377] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:01:31 s1lp14 kernel: [345269.889382] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:01:31 s1lp14 kernel: [345269.889384] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:01:31 s1lp14 kernel: [345269.889386] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:01:31 s1lp14 kernel: [345269.889390] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:01:31 s1lp14 kernel: [345269.889392] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:01:31 s1lp14 kernel: [345269.889393] Mem-Info: Mar 20 07:01:31 s1lp14 kernel: [345269.889398] active_anon:4712346 inactive_anon:201707 isolated_anon:0 Mar 20 07:01:31 s1lp14 kernel: [345269.889398] active_file:86 inactive_file:157 isolated_file:0 Mar 20 07:01:31 s1lp14 kernel: [345269.889398] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 07:01:31 s1lp14 kernel: [345269.889398] slab_reclaimable:17310 slab_unreclaimable:40841 Mar 20 07:01:31 s1lp14 kernel: [345269.889398] mapped:1949 shmem:1012 pagetables:21155 bounce:0 Mar 20 07:01:31 s1lp14 kernel: [345269.889398] free:23467 free_pcp:0 free_cma:0 Mar 20 07:01:31 s1lp14 kernel: [345269.889402] Node 0 active_anon:18849384kB inactive_anon:806828kB active_file:344kB inactive_file:628kB unevictable:28396kB isolated(anon):0kB isolated(file):0kB mapped:7796kB dirty:0kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:01:31 s1lp14 kernel: [345269.889403] Node 0 DMA free:73680kB min:2280kB low:4344kB high:6408kB active_anon:1894284kB inactive_anon:102264kB active_file:20kB inactive_file:24kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:64kB pagetables:8072kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:01:31 s1lp14 kernel: [345269.889407] lowmem_reserve[]: 0 17889 17889 Mar 20 07:01:31 s1lp14 kernel: [345269.889410] Node 0 Normal free:20188kB min:20244kB low:38560kB high:56876kB active_anon:16956068kB inactive_anon:702888kB active_file:324kB inactive_file:316kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8000kB pagetables:76548kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:01:31 s1lp14 kernel: [345269.889415] lowmem_reserve[]: 0 0 0 Mar 20 07:01:31 s1lp14 kernel: [345269.889417] Node 0 DMA: 155*4kB (UM) 29*8kB (UME) 76*16kB (UM) 38*32kB (UME) 28*64kB (UM) 8*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74196kB Mar 20 07:01:31 s1lp14 kernel: [345269.889430] Node 0 Normal: 851*4kB (UME) 679*8kB (UME) 406*16kB (UME) 179*32kB (UM) 6*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 21444kB Mar 20 07:01:31 s1lp14 kernel: [345269.889441] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:01:31 s1lp14 kernel: [345269.889442] 3196 total pagecache pages Mar 20 07:01:31 s1lp14 kernel: [345269.889443] 28 pages in swap cache Mar 20 07:01:31 s1lp14 kernel: [345269.889444] Swap cache stats: add 2798336, delete 2798150, find 14895/24458 Mar 20 07:01:31 s1lp14 kernel: [345269.889444] Free swap = 0kB Mar 20 07:01:31 s1lp14 kernel: [345269.889445] Total swap = 640412kB Mar 20 07:01:31 s1lp14 kernel: [345269.889446] 5242880 pages RAM Mar 20 07:01:31 s1lp14 kernel: [345269.889446] 0 pages HighMem/MovableOnly Mar 20 07:01:31 s1lp14 kernel: [345269.889447] 142387 pages reserved Mar 20 07:01:31 s1lp14 kernel: [345269.889447] 0 pages cma reserved Mar 20 07:01:31 s1lp14 kernel: [345269.889448] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:01:31 s1lp14 kernel: [345269.889453] [ 551] 0 551 12750 603 135168 266 0 systemd-journal Mar 20 07:01:31 s1lp14 kernel: [345269.889455] [ 635] 0 635 3774 389 86016 582 -1000 systemd-udevd Mar 20 07:01:31 s1lp14 kernel: [345269.889457] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:01:31 s1lp14 kernel: [345269.889459] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:01:31 s1lp14 kernel: [345269.889461] [ 1078] 100 1078 20782 580 100352 167 0 systemd-timesyn Mar 20 07:01:31 s1lp14 kernel: [345269.889463] [ 1132] 102 1132 2482 512 98304 194 0 systemd-resolve Mar 20 07:01:31 s1lp14 kernel: [345269.889465] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:01:31 s1lp14 kernel: [345269.889466] [ 1226] 0 1226 1547 422 79872 65 0 cron Mar 20 07:01:31 s1lp14 kernel: [345269.889468] [ 1229] 0 1229 2444 507 98304 192 0 systemd-logind Mar 20 07:01:31 s1lp14 kernel: [345269.889469] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:01:31 s1lp14 kernel: [345269.889471] [ 1255] 0 1255 58495 600 131072 215 0 accounts-daemon Mar 20 07:01:31 s1lp14 kernel: [345269.889473] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:01:31 s1lp14 kernel: [345269.889474] [ 1259] 0 1259 20060 508 83968 58 0 irqbalance Mar 20 07:01:31 s1lp14 kernel: [345269.889476] [ 1265] 0 1265 2673 215 83968 308 0 pkcsslotd Mar 20 07:01:31 s1lp14 kernel: [345269.889478] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:01:31 s1lp14 kernel: [345269.889479] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:01:31 s1lp14 kernel: [345269.889481] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:01:31 s1lp14 kernel: [345269.889483] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:01:31 s1lp14 kernel: [345269.889486] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:01:31 s1lp14 kernel: [345269.889487] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:01:31 s1lp14 kernel: [345269.889489] [ 7772] 101 7772 2793 492 100352 200 0 systemd-network Mar 20 07:01:31 s1lp14 kernel: [345269.889491] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:01:31 s1lp14 kernel: [345269.889493] [66598] 0 66598 394264 78 253952 2410 -900 snapd Mar 20 07:01:31 s1lp14 kernel: [345269.889495] [113723] 0 113723 2359 439 88064 115 0 wpa_supplicant Mar 20 07:01:31 s1lp14 kernel: [345269.889496] [116349] 0 116349 8972 388 83968 130 0 master Mar 20 07:01:31 s1lp14 kernel: [345269.889498] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:01:31 s1lp14 kernel: [345269.889500] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:01:31 s1lp14 kernel: [345269.889502] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:01:31 s1lp14 kernel: [345269.889504] [117440] 103 117440 54882 428 98304 140 0 rsyslogd Mar 20 07:01:31 s1lp14 kernel: [345269.889505] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:01:31 s1lp14 kernel: [345269.889507] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:01:31 s1lp14 kernel: [345269.889509] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:01:31 s1lp14 kernel: [345269.889511] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:01:31 s1lp14 kernel: [345269.889513] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:01:31 s1lp14 kernel: [345269.889514] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:01:31 s1lp14 kernel: [345269.889516] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:01:31 s1lp14 kernel: [345269.889518] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:01:31 s1lp14 kernel: [345269.889520] [70732] 111 70732 9042 420 88064 125 0 pickup Mar 20 07:01:31 s1lp14 kernel: [345269.889522] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:01:31 s1lp14 kernel: [345269.889524] [190296] 0 190296 3262 395 104448 65 -1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889526] [190297] 0 190297 3262 218 102400 74 -1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889528] [190298] 0 190298 3262 232 102400 59 -1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889530] [190299] 0 190299 3262 259 102400 64 -1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889532] [190300] 0 190300 3262 312 102400 53 -1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889534] [190302] 0 190302 3262 220 102400 71 -1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889536] [190304] 0 190304 3262 238 102400 80 -1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889538] [190307] 0 190307 3262 291 102400 58 -1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889540] [190308] 0 190308 3262 254 102400 89 -1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889541] [190430] 0 190430 1211004 1070787 9797632 137033 1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889543] [190442] 0 190442 1162305 1159046 9408512 83 1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889545] [190448] 0 190448 618407 615178 5040128 58 1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889547] [190450] 0 190450 320773 317583 2660352 64 1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889549] [190451] 0 190451 907651 904436 7370752 57 1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889551] [190456] 0 190456 381176 377934 3141632 57 1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889552] [190457] 0 190457 444092 440872 3645440 51 1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889555] [190458] 0 190458 30031 26792 317440 51 1000 stress-ng Mar 20 07:01:31 s1lp14 kernel: [345269.889556] Out of memory: Kill process 190430 (stress-ng) score 1223 or sacrifice child Mar 20 07:01:31 s1lp14 kernel: [345269.889565] Killed process 190430 (stress-ng) total-vm:4844016kB, anon-rss:4283144kB, file-rss:0kB, shmem-rss:4kB Mar 20 07:01:31 s1lp14 kernel: [345270.352754] oom_reaper: reaped process 190430 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:01:31 s1lp14 stress-ng: memory (MB): total 19923.80, free 1281.27, shared 1.99, buffer 0.36, swap 625.40, free swap 381.66 Mar 20 07:01:44 s1lp14 kernel: [345284.013177] pkcsslotd invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:01:44 s1lp14 kernel: [345284.013178] pkcsslotd cpuset=/ mems_allowed=0 Mar 20 07:01:44 s1lp14 kernel: [345284.013183] CPU: 0 PID: 1265 Comm: pkcsslotd Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:01:44 s1lp14 kernel: [345284.013184] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:01:44 s1lp14 kernel: [345284.013184] Call Trace: Mar 20 07:01:44 s1lp14 kernel: [345284.013192] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:01:44 s1lp14 kernel: [345284.013196] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:01:44 s1lp14 kernel: [345284.013201] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:01:44 s1lp14 kernel: [345284.013202] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:01:44 s1lp14 kernel: [345284.013203] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:01:44 s1lp14 kernel: [345284.013205] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:01:44 s1lp14 kernel: [345284.013207] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:01:44 s1lp14 kernel: [345284.013210] [<0000000000325bd8>] __read_swap_cache_async+0x180/0x270 Mar 20 07:01:44 s1lp14 kernel: [345284.013210] [<0000000000325eac>] swapin_readahead+0x184/0x290 Mar 20 07:01:44 s1lp14 kernel: [345284.013214] [<00000000002e5932>] shmem_swapin+0x72/0xb8 Mar 20 07:01:44 s1lp14 kernel: [345284.013215] [<00000000002e74ca>] shmem_getpage_gfp+0x682/0xeb0 Mar 20 07:01:44 s1lp14 kernel: [345284.013216] [<00000000002e7fca>] shmem_fault+0x9a/0x230 Mar 20 07:01:44 s1lp14 kernel: [345284.013219] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:01:44 s1lp14 kernel: [345284.013220] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:01:44 s1lp14 kernel: [345284.013221] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:01:44 s1lp14 kernel: [345284.013224] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:01:44 s1lp14 kernel: [345284.013227] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:01:44 s1lp14 kernel: [345284.013228] Mem-Info: Mar 20 07:01:44 s1lp14 kernel: [345284.013231] active_anon:4562564 inactive_anon:351435 isolated_anon:0 Mar 20 07:01:44 s1lp14 kernel: [345284.013231] active_file:43 inactive_file:189 isolated_file:0 Mar 20 07:01:44 s1lp14 kernel: [345284.013231] unevictable:7099 dirty:0 writeback:45 unstable:0 Mar 20 07:01:44 s1lp14 kernel: [345284.013231] slab_reclaimable:17310 slab_unreclaimable:40855 Mar 20 07:01:44 s1lp14 kernel: [345284.013231] mapped:2050 shmem:252 pagetables:21104 bounce:0 Mar 20 07:01:44 s1lp14 kernel: [345284.013231] free:23462 free_pcp:0 free_cma:0 Mar 20 07:01:44 s1lp14 kernel: [345284.013234] Node 0 active_anon:18250256kB inactive_anon:1405740kB active_file:172kB inactive_file:756kB unevictable:28396kB isolated(anon):0kB isolated(file):0kB mapped:8200kB dirty:0kB writeback:180kB shmem:1008kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:01:44 s1lp14 kernel: [345284.013234] Node 0 DMA free:73692kB min:2280kB low:4344kB high:6408kB active_anon:1865644kB inactive_anon:130332kB active_file:16kB inactive_file:8kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:48kB pagetables:8052kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:01:44 s1lp14 kernel: [345284.013237] lowmem_reserve[]: 0 17889 17889 Mar 20 07:01:44 s1lp14 kernel: [345284.013238] Node 0 Normal free:20156kB min:20244kB low:38560kB high:56876kB active_anon:16383832kB inactive_anon:1276004kB active_file:156kB inactive_file:1076kB unevictable:28396kB writepending:200kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8016kB pagetables:76364kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:01:44 s1lp14 kernel: [345284.013241] lowmem_reserve[]: 0 0 0 Mar 20 07:01:44 s1lp14 kernel: [345284.013242] Node 0 DMA: 94*4kB (M) 66*8kB (UME) 107*16kB (UM) 42*32kB (UME) 14*64kB (UM) 8*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73976kB Mar 20 07:01:44 s1lp14 kernel: [345284.013249] Node 0 Normal: 42*4kB (UME) 454*8kB (UME) 428*16kB (UME) 329*32kB (UME) 12*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 21944kB Mar 20 07:01:44 s1lp14 kernel: [345284.013256] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:01:44 s1lp14 kernel: [345284.013256] 15146 total pagecache pages Mar 20 07:01:44 s1lp14 kernel: [345284.013257] 12703 pages in swap cache Mar 20 07:01:44 s1lp14 kernel: [345284.013258] Swap cache stats: add 2936402, delete 2923542, find 15235/24890 Mar 20 07:01:44 s1lp14 kernel: [345284.013258] Free swap = 0kB Mar 20 07:01:44 s1lp14 kernel: [345284.013259] Total swap = 640412kB Mar 20 07:01:44 s1lp14 kernel: [345284.013259] 5242880 pages RAM Mar 20 07:01:44 s1lp14 kernel: [345284.013260] 0 pages HighMem/MovableOnly Mar 20 07:01:44 s1lp14 kernel: [345284.013260] 142387 pages reserved Mar 20 07:01:44 s1lp14 kernel: [345284.013260] 0 pages cma reserved Mar 20 07:01:44 s1lp14 kernel: [345284.013261] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:01:44 s1lp14 kernel: [345284.013263] [ 551] 0 551 12750 595 135168 273 0 systemd-journal Mar 20 07:01:44 s1lp14 kernel: [345284.013264] [ 635] 0 635 3774 389 86016 582 -1000 systemd-udevd Mar 20 07:01:44 s1lp14 kernel: [345284.013265] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:01:44 s1lp14 kernel: [345284.013266] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:01:44 s1lp14 kernel: [345284.013267] [ 1078] 100 1078 20782 580 100352 167 0 systemd-timesyn Mar 20 07:01:44 s1lp14 kernel: [345284.013268] [ 1132] 102 1132 2482 512 98304 202 0 systemd-resolve Mar 20 07:01:44 s1lp14 kernel: [345284.013269] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:01:44 s1lp14 kernel: [345284.013270] [ 1226] 0 1226 1547 417 79872 87 0 cron Mar 20 07:01:44 s1lp14 kernel: [345284.013271] [ 1229] 0 1229 2444 502 98304 199 0 systemd-logind Mar 20 07:01:44 s1lp14 kernel: [345284.013272] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:01:44 s1lp14 kernel: [345284.013273] [ 1255] 0 1255 58495 563 131072 220 0 accounts-daemon Mar 20 07:01:44 s1lp14 kernel: [345284.013274] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:01:44 s1lp14 kernel: [345284.013275] [ 1259] 0 1259 20060 517 83968 67 0 irqbalance Mar 20 07:01:44 s1lp14 kernel: [345284.013276] [ 1265] 0 1265 2673 323 83968 310 0 pkcsslotd Mar 20 07:01:44 s1lp14 kernel: [345284.013277] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:01:44 s1lp14 kernel: [345284.013277] [ 1433] 0 1433 1125 456 73728 40 0 iscsid Mar 20 07:01:44 s1lp14 kernel: [345284.013278] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:01:44 s1lp14 kernel: [345284.013279] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:01:44 s1lp14 kernel: [345284.013280] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:01:44 s1lp14 kernel: [345284.013281] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:01:44 s1lp14 kernel: [345284.013282] [ 7772] 101 7772 2793 486 100352 216 0 systemd-network Mar 20 07:01:44 s1lp14 kernel: [345284.013283] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:01:44 s1lp14 kernel: [345284.013284] [66598] 0 66598 394264 78 253952 2509 -900 snapd Mar 20 07:01:44 s1lp14 kernel: [345284.013285] [113723] 0 113723 2359 520 88064 118 0 wpa_supplicant Mar 20 07:01:44 s1lp14 kernel: [345284.013286] [116349] 0 116349 8972 413 83968 114 0 master Mar 20 07:01:44 s1lp14 kernel: [345284.013287] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:01:44 s1lp14 kernel: [345284.013288] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:01:44 s1lp14 kernel: [345284.013289] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:01:44 s1lp14 kernel: [345284.013290] [117440] 103 117440 54882 609 98304 187 0 rsyslogd Mar 20 07:01:44 s1lp14 kernel: [345284.013291] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:01:44 s1lp14 kernel: [345284.013292] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:01:44 s1lp14 kernel: [345284.013293] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:01:44 s1lp14 kernel: [345284.013294] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:01:44 s1lp14 kernel: [345284.013295] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:01:44 s1lp14 kernel: [345284.013296] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:01:44 s1lp14 kernel: [345284.013297] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:01:44 s1lp14 kernel: [345284.013298] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:01:44 s1lp14 kernel: [345284.013299] [70732] 111 70732 9042 351 88064 128 0 pickup Mar 20 07:01:44 s1lp14 kernel: [345284.013300] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:01:44 s1lp14 kernel: [345284.013301] [190296] 0 190296 3262 444 104448 65 -1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013302] [190297] 0 190297 3262 212 102400 84 -1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013303] [190298] 0 190298 3262 232 102400 59 -1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013304] [190299] 0 190299 3262 259 102400 64 -1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013305] [190300] 0 190300 3262 312 102400 53 -1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013306] [190302] 0 190302 3262 220 102400 71 -1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013307] [190304] 0 190304 3262 238 102400 80 -1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013308] [190307] 0 190307 3262 291 102400 58 -1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013308] [190308] 0 190308 3262 269 102400 64 -1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013310] [190442] 0 190442 1293608 1242799 10459136 47680 1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013311] [190448] 0 190448 750205 718078 6094848 28998 1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013312] [190450] 0 190450 452550 421596 3713024 27767 1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013313] [190451] 0 190451 987887 952917 8011776 31844 1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013314] [190456] 0 190456 534553 531337 4370432 57 1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013315] [190457] 0 190457 772568 769390 6273024 51 1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013315] [190458] 0 190458 231942 228707 1933312 51 1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013316] [190460] 0 190460 39429 36252 391168 51 1000 stress-ng Mar 20 07:01:44 s1lp14 kernel: [345284.013317] Out of memory: Kill process 190442 (stress-ng) score 1238 or sacrifice child Mar 20 07:01:44 s1lp14 kernel: [345284.013324] Killed process 190442 (stress-ng) total-vm:5174432kB, anon-rss:4970956kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:01:45 s1lp14 kernel: [345284.867284] oom_reaper: reaped process 190442 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:4kB Mar 20 07:01:48 s1lp14 stress-ng: memory (MB): total 19923.80, free 91.75, shared 3.95, buffer 0.34, swap 625.40, free swap 139.49 Mar 20 07:01:52 s1lp14 kernel: [345291.815619] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:01:52 s1lp14 kernel: [345291.815620] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:01:52 s1lp14 kernel: [345291.815624] CPU: 7 PID: 190464 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:01:52 s1lp14 kernel: [345291.815625] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:01:52 s1lp14 kernel: [345291.815625] Call Trace: Mar 20 07:01:52 s1lp14 kernel: [345291.815634] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:01:52 s1lp14 kernel: [345291.815638] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:01:52 s1lp14 kernel: [345291.815642] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:01:52 s1lp14 kernel: [345291.815643] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:01:52 s1lp14 kernel: [345291.815643] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:01:52 s1lp14 kernel: [345291.815645] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:01:52 s1lp14 kernel: [345291.815648] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:01:52 s1lp14 kernel: [345291.815652] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:01:52 s1lp14 kernel: [345291.815653] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:01:52 s1lp14 kernel: [345291.815654] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:01:52 s1lp14 kernel: [345291.815656] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:01:52 s1lp14 kernel: [345291.815659] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:01:52 s1lp14 kernel: [345291.815659] Mem-Info: Mar 20 07:01:52 s1lp14 kernel: [345291.815662] active_anon:4562101 inactive_anon:351745 isolated_anon:280 Mar 20 07:01:52 s1lp14 kernel: [345291.815662] active_file:161 inactive_file:260 isolated_file:0 Mar 20 07:01:52 s1lp14 kernel: [345291.815662] unevictable:7099 dirty:22 writeback:635 unstable:0 Mar 20 07:01:52 s1lp14 kernel: [345291.815662] slab_reclaimable:17302 slab_unreclaimable:40897 Mar 20 07:01:52 s1lp14 kernel: [345291.815662] mapped:3285 shmem:1012 pagetables:21069 bounce:0 Mar 20 07:01:52 s1lp14 kernel: [345291.815662] free:23402 free_pcp:180 free_cma:0 Mar 20 07:01:52 s1lp14 kernel: [345291.815665] Node 0 active_anon:18248404kB inactive_anon:1406980kB active_file:644kB inactive_file:1040kB unevictable:28396kB isolated(anon):1120kB isolated(file):0kB mapped:13140kB dirty:88kB writeback:2540kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:01:52 s1lp14 kernel: [345291.815665] Node 0 DMA free:73564kB min:2280kB low:4344kB high:6408kB active_anon:1850020kB inactive_anon:146516kB active_file:12kB inactive_file:16kB unevictable:0kB writepending:116kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:48kB pagetables:8084kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:01:52 s1lp14 kernel: [345291.815668] lowmem_reserve[]: 0 17889 17889 Mar 20 07:01:52 s1lp14 kernel: [345291.815669] Node 0 Normal free:20044kB min:20244kB low:38560kB high:56876kB active_anon:16398164kB inactive_anon:1260316kB active_file:1580kB inactive_file:952kB unevictable:28396kB writepending:2512kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8000kB pagetables:76192kB bounce:0kB free_pcp:720kB local_pcp:172kB free_cma:0kB Mar 20 07:01:52 s1lp14 kernel: [345291.815671] lowmem_reserve[]: 0 0 0 Mar 20 07:01:52 s1lp14 kernel: [345291.815673] Node 0 DMA: 226*4kB (UM) 113*8kB (UME) 17*16kB (UM) 38*32kB (UME) 19*64kB (UM) 8*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73632kB Mar 20 07:01:52 s1lp14 kernel: [345291.815679] Node 0 Normal: 857*4kB (UE) 853*8kB (UME) 365*16kB (UME) 120*32kB (UME) 6*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 20316kB Mar 20 07:01:52 s1lp14 kernel: [345291.815685] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:01:52 s1lp14 kernel: [345291.815685] 23731 total pagecache pages Mar 20 07:01:52 s1lp14 kernel: [345291.815686] 20490 pages in swap cache Mar 20 07:01:52 s1lp14 kernel: [345291.815687] Swap cache stats: add 2985680, delete 2965033, find 15913/25701 Mar 20 07:01:52 s1lp14 kernel: [345291.815687] Free swap = 0kB Mar 20 07:01:52 s1lp14 kernel: [345291.815687] Total swap = 640412kB Mar 20 07:01:52 s1lp14 kernel: [345291.815688] 5242880 pages RAM Mar 20 07:01:52 s1lp14 kernel: [345291.815688] 0 pages HighMem/MovableOnly Mar 20 07:01:52 s1lp14 kernel: [345291.815688] 142387 pages reserved Mar 20 07:01:52 s1lp14 kernel: [345291.815689] 0 pages cma reserved Mar 20 07:01:52 s1lp14 kernel: [345291.815689] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:01:52 s1lp14 kernel: [345291.815691] [ 551] 0 551 12750 747 135168 273 0 systemd-journal Mar 20 07:01:52 s1lp14 kernel: [345291.815692] [ 635] 0 635 3774 389 86016 582 -1000 systemd-udevd Mar 20 07:01:52 s1lp14 kernel: [345291.815693] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:01:52 s1lp14 kernel: [345291.815694] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:01:52 s1lp14 kernel: [345291.815695] [ 1078] 100 1078 20782 580 100352 167 0 systemd-timesyn Mar 20 07:01:52 s1lp14 kernel: [345291.815696] [ 1132] 102 1132 2482 512 98304 202 0 systemd-resolve Mar 20 07:01:52 s1lp14 kernel: [345291.815697] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:01:52 s1lp14 kernel: [345291.815698] [ 1226] 0 1226 1547 417 79872 87 0 cron Mar 20 07:01:52 s1lp14 kernel: [345291.815699] [ 1229] 0 1229 2444 502 98304 201 0 systemd-logind Mar 20 07:01:52 s1lp14 kernel: [345291.815700] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:01:52 s1lp14 kernel: [345291.815701] [ 1255] 0 1255 58495 594 131072 221 0 accounts-daemon Mar 20 07:01:52 s1lp14 kernel: [345291.815701] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:01:52 s1lp14 kernel: [345291.815702] [ 1259] 0 1259 20060 516 83968 68 0 irqbalance Mar 20 07:01:52 s1lp14 kernel: [345291.815703] [ 1265] 0 1265 2673 1188 83968 311 0 pkcsslotd Mar 20 07:01:52 s1lp14 kernel: [345291.815704] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:01:52 s1lp14 kernel: [345291.815705] [ 1433] 0 1433 1125 456 73728 40 0 iscsid Mar 20 07:01:52 s1lp14 kernel: [345291.815706] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:01:52 s1lp14 kernel: [345291.815707] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:01:52 s1lp14 kernel: [345291.815708] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:01:52 s1lp14 kernel: [345291.815709] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:01:52 s1lp14 kernel: [345291.815710] [ 7772] 101 7772 2793 486 100352 216 0 systemd-network Mar 20 07:01:52 s1lp14 kernel: [345291.815711] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:01:52 s1lp14 kernel: [345291.815712] [66598] 0 66598 394264 78 253952 2509 -900 snapd Mar 20 07:01:52 s1lp14 kernel: [345291.815713] [113723] 0 113723 2359 477 88064 118 0 wpa_supplicant Mar 20 07:01:52 s1lp14 kernel: [345291.815713] [116349] 0 116349 8972 413 83968 114 0 master Mar 20 07:01:52 s1lp14 kernel: [345291.815714] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:01:52 s1lp14 kernel: [345291.815715] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:01:52 s1lp14 kernel: [345291.815716] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:01:52 s1lp14 kernel: [345291.815717] [117440] 103 117440 54882 672 98304 151 0 rsyslogd Mar 20 07:01:52 s1lp14 kernel: [345291.815718] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:01:52 s1lp14 kernel: [345291.815719] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:01:52 s1lp14 kernel: [345291.815720] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:01:52 s1lp14 kernel: [345291.815721] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:01:52 s1lp14 kernel: [345291.815721] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:01:52 s1lp14 kernel: [345291.815722] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:01:52 s1lp14 kernel: [345291.815723] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:01:52 s1lp14 kernel: [345291.815724] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:01:52 s1lp14 kernel: [345291.815725] [70732] 111 70732 9042 351 88064 128 0 pickup Mar 20 07:01:52 s1lp14 kernel: [345291.815726] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:01:52 s1lp14 kernel: [345291.815727] [190296] 0 190296 3262 452 104448 65 -1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815728] [190297] 0 190297 3262 212 102400 84 -1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815729] [190298] 0 190298 3262 232 102400 59 -1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815730] [190299] 0 190299 3262 259 102400 64 -1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815731] [190300] 0 190300 3262 312 102400 53 -1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815732] [190302] 0 190302 3262 220 102400 71 -1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815733] [190304] 0 190304 3262 311 102400 61 -1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815734] [190307] 0 190307 3262 291 102400 58 -1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815735] [190308] 0 190308 3262 269 102400 64 -1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815736] [190448] 0 190448 917710 877724 7450624 36869 1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815737] [190450] 0 190450 628432 588894 5120000 36417 1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815738] [190451] 0 190451 1164244 1097421 9422848 63705 1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815739] [190456] 0 190456 650382 647206 5296128 57 1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815740] [190457] 0 190457 1106555 1103388 8962048 51 1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815741] [190458] 0 190458 427712 424542 3514368 51 1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815742] [190460] 0 190460 150548 147377 1282048 51 1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815742] [190464] 0 190464 9555 6384 153600 51 1000 stress-ng Mar 20 07:01:52 s1lp14 kernel: [345291.815743] Out of memory: Kill process 190451 (stress-ng) score 1214 or sacrifice child Mar 20 07:01:52 s1lp14 kernel: [345291.815749] Killed process 190451 (stress-ng) total-vm:4656976kB, anon-rss:4389416kB, file-rss:264kB, shmem-rss:4kB Mar 20 07:01:53 s1lp14 kernel: [345292.849583] oom_reaper: reaped process 190451 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:02:00 s1lp14 stress-ng: memory (MB): total 19923.80, free 92.16, shared 3.95, buffer 0.37, swap 625.40, free swap 209.23 Mar 20 07:02:05 s1lp14 kernel: [345304.269462] systemd-journal invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:02:05 s1lp14 kernel: [345304.269464] systemd-journal cpuset=/ mems_allowed=0 Mar 20 07:02:05 s1lp14 kernel: [345304.269472] CPU: 0 PID: 551 Comm: systemd-journal Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:02:05 s1lp14 kernel: [345304.269474] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:02:05 s1lp14 kernel: [345304.269475] Call Trace: Mar 20 07:02:05 s1lp14 kernel: [345304.269484] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:02:05 s1lp14 kernel: [345304.269489] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:02:05 s1lp14 kernel: [345304.269494] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:02:05 s1lp14 kernel: [345304.269496] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:02:05 s1lp14 kernel: [345304.269498] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:02:05 s1lp14 kernel: [345304.269501] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:02:05 s1lp14 kernel: [345304.269503] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:02:05 s1lp14 kernel: [345304.269507] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:02:05 s1lp14 kernel: [345304.269513] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:02:05 s1lp14 kernel: [345304.269515] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:02:05 s1lp14 kernel: [345304.269518] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:02:05 s1lp14 kernel: [345304.269522] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:02:05 s1lp14 kernel: [345304.269525] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:02:05 s1lp14 kernel: [345304.269526] Mem-Info: Mar 20 07:02:05 s1lp14 kernel: [345304.269531] active_anon:4562399 inactive_anon:351534 isolated_anon:32 Mar 20 07:02:05 s1lp14 kernel: [345304.269531] active_file:0 inactive_file:127 isolated_file:0 Mar 20 07:02:05 s1lp14 kernel: [345304.269531] unevictable:7099 dirty:3 writeback:73 unstable:0 Mar 20 07:02:05 s1lp14 kernel: [345304.269531] slab_reclaimable:17302 slab_unreclaimable:40805 Mar 20 07:02:05 s1lp14 kernel: [345304.269531] mapped:3056 shmem:1011 pagetables:21092 bounce:0 Mar 20 07:02:05 s1lp14 kernel: [345304.269531] free:23312 free_pcp:14 free_cma:0 Mar 20 07:02:05 s1lp14 kernel: [345304.269537] Node 0 active_anon:18249596kB inactive_anon:1406136kB active_file:0kB inactive_file:508kB unevictable:28396kB isolated(anon):128kB isolated(file):0kB mapped:12224kB dirty:12kB writeback:292kB shmem:4044kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:02:05 s1lp14 kernel: [345304.269538] Node 0 DMA free:73356kB min:2280kB low:4344kB high:6408kB active_anon:1972532kB inactive_anon:22668kB active_file:116kB inactive_file:456kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:64kB pagetables:7956kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:02:05 s1lp14 kernel: [345304.269543] lowmem_reserve[]: 0 17889 17889 Mar 20 07:02:05 s1lp14 kernel: [345304.269546] Node 0 Normal free:19892kB min:20244kB low:38560kB high:56876kB active_anon:16276832kB inactive_anon:1381444kB active_file:720kB inactive_file:884kB unevictable:28396kB writepending:260kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7984kB pagetables:76412kB bounce:0kB free_pcp:56kB local_pcp:0kB free_cma:0kB Mar 20 07:02:05 s1lp14 kernel: [345304.269551] lowmem_reserve[]: 0 0 0 Mar 20 07:02:05 s1lp14 kernel: [345304.269554] Node 0 DMA: 206*4kB (UM) 138*8kB (UME) 45*16kB (UM) 46*32kB (UME) 18*64kB (UM) 8*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74392kB Mar 20 07:02:05 s1lp14 kernel: [345304.269570] Node 0 Normal: 857*4kB (UME) 584*8kB (UME) 421*16kB (UME) 210*32kB (UME) 3*64kB (ME) 0*128kB 0*256kB 0*512kB 0*1024kB = 21748kB Mar 20 07:02:05 s1lp14 kernel: [345304.269584] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:02:05 s1lp14 kernel: [345304.269585] 3264 total pagecache pages Mar 20 07:02:05 s1lp14 kernel: [345304.269586] 14 pages in swap cache Mar 20 07:02:05 s1lp14 kernel: [345304.269588] Swap cache stats: add 3049488, delete 3049314, find 15987/25828 Mar 20 07:02:05 s1lp14 kernel: [345304.269589] Free swap = 0kB Mar 20 07:02:05 s1lp14 kernel: [345304.269590] Total swap = 640412kB Mar 20 07:02:05 s1lp14 kernel: [345304.269591] 5242880 pages RAM Mar 20 07:02:05 s1lp14 kernel: [345304.269591] 0 pages HighMem/MovableOnly Mar 20 07:02:05 s1lp14 kernel: [345304.269592] 142387 pages reserved Mar 20 07:02:05 s1lp14 kernel: [345304.269593] 0 pages cma reserved Mar 20 07:02:05 s1lp14 kernel: [345304.269594] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:02:05 s1lp14 kernel: [345304.269598] [ 551] 0 551 12750 407 135168 272 0 systemd-journal Mar 20 07:02:05 s1lp14 kernel: [345304.269600] [ 635] 0 635 3774 389 86016 582 -1000 systemd-udevd Mar 20 07:02:05 s1lp14 kernel: [345304.269603] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:02:05 s1lp14 kernel: [345304.269605] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:02:05 s1lp14 kernel: [345304.269607] [ 1078] 100 1078 20782 580 100352 167 0 systemd-timesyn Mar 20 07:02:05 s1lp14 kernel: [345304.269610] [ 1132] 102 1132 2482 512 98304 202 0 systemd-resolve Mar 20 07:02:05 s1lp14 kernel: [345304.269611] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:02:05 s1lp14 kernel: [345304.269613] [ 1226] 0 1226 1547 439 79872 48 0 cron Mar 20 07:02:05 s1lp14 kernel: [345304.269615] [ 1229] 0 1229 2444 502 98304 201 0 systemd-logind Mar 20 07:02:05 s1lp14 kernel: [345304.269616] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:02:05 s1lp14 kernel: [345304.269618] [ 1255] 0 1255 58495 598 131072 217 0 accounts-daemon Mar 20 07:02:05 s1lp14 kernel: [345304.269620] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:02:05 s1lp14 kernel: [345304.269621] [ 1259] 0 1259 20060 466 83968 64 0 irqbalance Mar 20 07:02:05 s1lp14 kernel: [345304.269622] [ 1265] 0 1265 2673 1224 83968 308 0 pkcsslotd Mar 20 07:02:05 s1lp14 kernel: [345304.269624] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:02:05 s1lp14 kernel: [345304.269626] [ 1433] 0 1433 1125 456 73728 40 0 iscsid Mar 20 07:02:05 s1lp14 kernel: [345304.269627] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:02:05 s1lp14 kernel: [345304.269629] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:02:05 s1lp14 kernel: [345304.269631] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:02:05 s1lp14 kernel: [345304.269632] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:02:05 s1lp14 kernel: [345304.269634] [ 7772] 101 7772 2793 486 100352 216 0 systemd-network Mar 20 07:02:05 s1lp14 kernel: [345304.269635] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:02:05 s1lp14 kernel: [345304.269637] [66598] 0 66598 394264 14 253952 2509 -900 snapd Mar 20 07:02:05 s1lp14 kernel: [345304.269638] [113723] 0 113723 2359 406 88064 118 0 wpa_supplicant Mar 20 07:02:05 s1lp14 kernel: [345304.269639] [116349] 0 116349 8972 409 83968 118 0 master Mar 20 07:02:05 s1lp14 kernel: [345304.269640] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:02:05 s1lp14 kernel: [345304.269642] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:02:05 s1lp14 kernel: [345304.269643] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:02:05 s1lp14 kernel: [345304.269644] [117440] 103 117440 54882 629 98304 144 0 rsyslogd Mar 20 07:02:05 s1lp14 kernel: [345304.269645] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:02:05 s1lp14 kernel: [345304.269647] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:02:05 s1lp14 kernel: [345304.269648] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:02:05 s1lp14 kernel: [345304.269649] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:02:05 s1lp14 kernel: [345304.269650] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:02:05 s1lp14 kernel: [345304.269651] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:02:05 s1lp14 kernel: [345304.269653] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:02:05 s1lp14 kernel: [345304.269654] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:02:05 s1lp14 kernel: [345304.269655] [70732] 111 70732 9042 351 88064 140 0 pickup Mar 20 07:02:05 s1lp14 kernel: [345304.269657] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:02:05 s1lp14 kernel: [345304.269658] [190296] 0 190296 3262 382 104448 65 -1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269659] [190297] 0 190297 3262 275 102400 60 -1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269660] [190298] 0 190298 3262 232 102400 59 -1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269662] [190299] 0 190299 3262 259 102400 64 -1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269663] [190300] 0 190300 3262 312 102400 53 -1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269665] [190302] 0 190302 3262 220 102400 71 -1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269666] [190304] 0 190304 3262 304 102400 61 -1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269667] [190307] 0 190307 3262 289 102400 60 -1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269668] [190308] 0 190308 3262 269 102400 64 -1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269670] [190448] 0 190448 1065768 991944 8636416 70671 1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269671] [190450] 0 190450 757099 687672 6150144 66299 1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269673] [190456] 0 190456 796823 793639 6467584 57 1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269674] [190457] 0 190457 1312633 1309454 10610688 51 1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269675] [190458] 0 190458 529935 526756 4333568 51 1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269677] [190460] 0 190460 302433 299256 2512896 51 1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269678] [190464] 0 190464 302328 299151 2510848 51 1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269680] [190469] 0 190469 8332 5158 143360 51 1000 stress-ng Mar 20 07:02:05 s1lp14 kernel: [345304.269681] Out of memory: Kill process 190457 (stress-ng) score 1241 or sacrifice child Mar 20 07:02:05 s1lp14 kernel: [345304.269692] Killed process 190457 (stress-ng) total-vm:5250532kB, anon-rss:5237576kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:02:06 s1lp14 kernel: [345305.650829] oom_reaper: reaped process 190457 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:02:06 s1lp14 kernel: [345305.883371] systemd-journal invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:02:06 s1lp14 kernel: [345305.883373] systemd-journal cpuset=/ mems_allowed=0 Mar 20 07:02:06 s1lp14 kernel: [345305.883378] CPU: 0 PID: 551 Comm: systemd-journal Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:02:06 s1lp14 kernel: [345305.883379] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:02:06 s1lp14 kernel: [345305.883380] Call Trace: Mar 20 07:02:06 s1lp14 kernel: [345305.883388] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:02:06 s1lp14 kernel: [345305.883392] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:02:06 s1lp14 kernel: [345305.883396] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:02:06 s1lp14 kernel: [345305.883397] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:02:06 s1lp14 kernel: [345305.883398] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:02:06 s1lp14 kernel: [345305.883400] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:02:06 s1lp14 kernel: [345305.883401] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:02:06 s1lp14 kernel: [345305.883404] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:02:06 s1lp14 kernel: [345305.883408] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:02:06 s1lp14 kernel: [345305.883410] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:02:06 s1lp14 kernel: [345305.883411] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:02:06 s1lp14 kernel: [345305.883414] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:02:06 s1lp14 kernel: [345305.883416] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:02:06 s1lp14 kernel: [345305.883418] Mem-Info: Mar 20 07:02:06 s1lp14 kernel: [345305.883420] active_anon:4562377 inactive_anon:351736 isolated_anon:64 Mar 20 07:02:06 s1lp14 kernel: [345305.883420] active_file:83 inactive_file:14 isolated_file:0 Mar 20 07:02:06 s1lp14 kernel: [345305.883420] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 07:02:06 s1lp14 kernel: [345305.883420] slab_reclaimable:17302 slab_unreclaimable:40829 Mar 20 07:02:06 s1lp14 kernel: [345305.883420] mapped:2922 shmem:1012 pagetables:21156 bounce:0 Mar 20 07:02:06 s1lp14 kernel: [345305.883420] free:23437 free_pcp:455 free_cma:0 Mar 20 07:02:06 s1lp14 kernel: [345305.883423] Node 0 active_anon:18249508kB inactive_anon:1406944kB active_file:332kB inactive_file:56kB unevictable:28396kB isolated(anon):256kB isolated(file):0kB mapped:11688kB dirty:0kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:02:06 s1lp14 kernel: [345305.883424] Node 0 DMA free:73640kB min:2280kB low:4344kB high:6408kB active_anon:1876148kB inactive_anon:119704kB active_file:0kB inactive_file:40kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:64kB pagetables:8004kB bounce:0kB free_pcp:524kB local_pcp:0kB free_cma:0kB Mar 20 07:02:06 s1lp14 kernel: [345305.883426] lowmem_reserve[]: 0 17889 17889 Mar 20 07:02:06 s1lp14 kernel: [345305.883428] Node 0 Normal free:20108kB min:20244kB low:38560kB high:56876kB active_anon:16373280kB inactive_anon:1287176kB active_file:364kB inactive_file:360kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7984kB pagetables:76620kB bounce:0kB free_pcp:1296kB local_pcp:0kB free_cma:0kB Mar 20 07:02:06 s1lp14 kernel: [345305.883431] lowmem_reserve[]: 0 0 0 Mar 20 07:02:06 s1lp14 kernel: [345305.883432] Node 0 DMA: 147*4kB (U) 131*8kB (UME) 43*16kB (U) 21*32kB (UE) 18*64kB (UM) 8*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73268kB Mar 20 07:02:06 s1lp14 kernel: [345305.883439] Node 0 Normal: 842*4kB (UME) 633*8kB (UE) 301*16kB (UME) 163*32kB (UME) 13*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB = 19296kB Mar 20 07:02:06 s1lp14 kernel: [345305.883446] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:02:06 s1lp14 kernel: [345305.883447] 3081 total pagecache pages Mar 20 07:02:06 s1lp14 kernel: [345305.883448] 14 pages in swap cache Mar 20 07:02:06 s1lp14 kernel: [345305.883448] Swap cache stats: add 3049489, delete 3049315, find 15988/25830 Mar 20 07:02:06 s1lp14 kernel: [345305.883449] Free swap = 0kB Mar 20 07:02:06 s1lp14 kernel: [345305.883449] Total swap = 640412kB Mar 20 07:02:06 s1lp14 kernel: [345305.883449] 5242880 pages RAM Mar 20 07:02:06 s1lp14 kernel: [345305.883450] 0 pages HighMem/MovableOnly Mar 20 07:02:06 s1lp14 kernel: [345305.883450] 142387 pages reserved Mar 20 07:02:06 s1lp14 kernel: [345305.883451] 0 pages cma reserved Mar 20 07:02:06 s1lp14 kernel: [345305.883451] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:02:06 s1lp14 kernel: [345305.883453] [ 551] 0 551 12750 659 135168 272 0 systemd-journal Mar 20 07:02:06 s1lp14 kernel: [345305.883455] [ 635] 0 635 3774 389 86016 582 -1000 systemd-udevd Mar 20 07:02:06 s1lp14 kernel: [345305.883456] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:02:06 s1lp14 kernel: [345305.883457] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:02:06 s1lp14 kernel: [345305.883458] [ 1078] 100 1078 20782 580 100352 167 0 systemd-timesyn Mar 20 07:02:06 s1lp14 kernel: [345305.883459] [ 1132] 102 1132 2482 512 98304 202 0 systemd-resolve Mar 20 07:02:06 s1lp14 kernel: [345305.883460] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:02:06 s1lp14 kernel: [345305.883461] [ 1226] 0 1226 1547 439 79872 48 0 cron Mar 20 07:02:06 s1lp14 kernel: [345305.883462] [ 1229] 0 1229 2444 502 98304 201 0 systemd-logind Mar 20 07:02:06 s1lp14 kernel: [345305.883462] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:02:06 s1lp14 kernel: [345305.883463] [ 1255] 0 1255 58495 599 131072 216 0 accounts-daemon Mar 20 07:02:06 s1lp14 kernel: [345305.883464] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:02:06 s1lp14 kernel: [345305.883465] [ 1259] 0 1259 20060 508 83968 58 0 irqbalance Mar 20 07:02:06 s1lp14 kernel: [345305.883466] [ 1265] 0 1265 2673 1224 83968 308 0 pkcsslotd Mar 20 07:02:06 s1lp14 kernel: [345305.883467] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:02:06 s1lp14 kernel: [345305.883468] [ 1433] 0 1433 1125 456 73728 40 0 iscsid Mar 20 07:02:06 s1lp14 kernel: [345305.883469] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:02:06 s1lp14 kernel: [345305.883470] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:02:06 s1lp14 kernel: [345305.883471] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:02:06 s1lp14 kernel: [345305.883472] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:02:06 s1lp14 kernel: [345305.883473] [ 7772] 101 7772 2793 486 100352 216 0 systemd-network Mar 20 07:02:06 s1lp14 kernel: [345305.883474] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:02:06 s1lp14 kernel: [345305.883475] [66598] 0 66598 394264 14 253952 2509 -900 snapd Mar 20 07:02:06 s1lp14 kernel: [345305.883476] [113723] 0 113723 2359 406 88064 118 0 wpa_supplicant Mar 20 07:02:06 s1lp14 kernel: [345305.883477] [116349] 0 116349 8972 409 83968 118 0 master Mar 20 07:02:06 s1lp14 kernel: [345305.883478] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:02:06 s1lp14 kernel: [345305.883479] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:02:06 s1lp14 kernel: [345305.883480] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:02:06 s1lp14 kernel: [345305.883481] [117440] 103 117440 54882 583 98304 142 0 rsyslogd Mar 20 07:02:06 s1lp14 kernel: [345305.883482] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:02:06 s1lp14 kernel: [345305.883482] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:02:06 s1lp14 kernel: [345305.883483] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:02:06 s1lp14 kernel: [345305.883484] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:02:06 s1lp14 kernel: [345305.883485] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:02:06 s1lp14 kernel: [345305.883486] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:02:06 s1lp14 kernel: [345305.883487] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:02:06 s1lp14 kernel: [345305.883488] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:02:06 s1lp14 kernel: [345305.883489] [70732] 111 70732 9042 351 88064 140 0 pickup Mar 20 07:02:06 s1lp14 kernel: [345305.883490] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:02:06 s1lp14 kernel: [345305.883491] [190296] 0 190296 3262 417 104448 65 -1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883492] [190297] 0 190297 3262 274 102400 61 -1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883493] [190298] 0 190298 3262 260 102400 52 -1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883494] [190299] 0 190299 3262 259 102400 64 -1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883495] [190300] 0 190300 3262 311 102400 54 -1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883496] [190302] 0 190302 3262 220 102400 71 -1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883497] [190304] 0 190304 3262 303 102400 62 -1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883498] [190307] 0 190307 3262 289 102400 60 -1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883499] [190308] 0 190308 3262 268 102400 65 -1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883500] [190448] 0 190448 1282207 1208412 10366976 70671 1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883501] [190450] 0 190450 1019984 950557 8269824 66299 1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883502] [190456] 0 190456 1112928 1109745 9013248 57 1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883503] [190458] 0 190458 781093 777916 6342656 51 1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883504] [190460] 0 190460 302433 299256 2512896 51 1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883505] [190464] 0 190464 302328 299151 2510848 51 1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883506] [190469] 0 190469 270133 266900 2238464 51 1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883507] [190470] 0 190470 4357 1180 112640 51 1000 stress-ng Mar 20 07:02:06 s1lp14 kernel: [345305.883508] Out of memory: Kill process 190448 (stress-ng) score 1236 or sacrifice child Mar 20 07:02:06 s1lp14 kernel: [345305.883515] Killed process 190448 (stress-ng) total-vm:5128828kB, anon-rss:4833408kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:02:06 s1lp14 stress-ng: memory (MB): total 19923.80, free 91.31, shared 3.95, buffer 0.39, swap 625.40, free swap 0.00 Mar 20 07:02:07 s1lp14 kernel: [345306.959589] oom_reaper: reaped process 190448 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:02:08 s1lp14 stress-ng: memory (MB): total 19923.80, free 91.15, shared 3.95, buffer 0.40, swap 625.40, free swap 230.88 Mar 20 07:02:19 s1lp14 kernel: [345318.430706] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:02:19 s1lp14 kernel: [345318.430707] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:02:19 s1lp14 kernel: [345318.430712] CPU: 5 PID: 190460 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:02:19 s1lp14 kernel: [345318.430712] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:02:19 s1lp14 kernel: [345318.430713] Call Trace: Mar 20 07:02:19 s1lp14 kernel: [345318.430722] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:02:19 s1lp14 kernel: [345318.430726] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:02:19 s1lp14 kernel: [345318.430729] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:02:19 s1lp14 kernel: [345318.430730] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:02:19 s1lp14 kernel: [345318.430731] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:02:19 s1lp14 kernel: [345318.430733] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:02:19 s1lp14 kernel: [345318.430736] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:02:19 s1lp14 kernel: [345318.430739] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:02:19 s1lp14 kernel: [345318.430740] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:02:19 s1lp14 kernel: [345318.430741] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:02:19 s1lp14 kernel: [345318.430744] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:02:19 s1lp14 kernel: [345318.430746] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:02:19 s1lp14 kernel: [345318.430747] Mem-Info: Mar 20 07:02:19 s1lp14 kernel: [345318.430749] active_anon:4562526 inactive_anon:351719 isolated_anon:0 Mar 20 07:02:19 s1lp14 kernel: [345318.430749] active_file:43 inactive_file:133 isolated_file:0 Mar 20 07:02:19 s1lp14 kernel: [345318.430749] unevictable:7099 dirty:3 writeback:129 unstable:0 Mar 20 07:02:19 s1lp14 kernel: [345318.430749] slab_reclaimable:17302 slab_unreclaimable:40857 Mar 20 07:02:19 s1lp14 kernel: [345318.430749] mapped:2890 shmem:1012 pagetables:21111 bounce:0 Mar 20 07:02:19 s1lp14 kernel: [345318.430749] free:23378 free_pcp:22 free_cma:0 Mar 20 07:02:19 s1lp14 kernel: [345318.430752] Node 0 active_anon:18250104kB inactive_anon:1406876kB active_file:172kB inactive_file:532kB unevictable:28396kB isolated(anon):0kB isolated(file):0kB mapped:11560kB dirty:12kB writeback:516kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:02:19 s1lp14 kernel: [345318.430752] Node 0 DMA free:73640kB min:2280kB low:4344kB high:6408kB active_anon:1791016kB inactive_anon:205236kB active_file:0kB inactive_file:12kB unevictable:0kB writepending:60kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:8080kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:02:19 s1lp14 kernel: [345318.430755] lowmem_reserve[]: 0 17889 17889 Mar 20 07:02:19 s1lp14 kernel: [345318.430756] Node 0 Normal free:19872kB min:20244kB low:38560kB high:56876kB active_anon:16458764kB inactive_anon:1201640kB active_file:172kB inactive_file:520kB unevictable:28396kB writepending:468kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7968kB pagetables:76364kB bounce:0kB free_pcp:88kB local_pcp:0kB free_cma:0kB Mar 20 07:02:19 s1lp14 kernel: [345318.430758] lowmem_reserve[]: 0 0 0 Mar 20 07:02:19 s1lp14 kernel: [345318.430760] Node 0 DMA: 216*4kB (UM) 105*8kB (UME) 54*16kB (UM) 31*32kB (UME) 18*64kB (UM) 8*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73832kB Mar 20 07:02:19 s1lp14 kernel: [345318.430765] Node 0 Normal: 744*4kB (UM) 604*8kB (UME) 331*16kB (UME) 216*32kB (UME) 2*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 20144kB Mar 20 07:02:19 s1lp14 kernel: [345318.430771] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:02:19 s1lp14 kernel: [345318.430772] 14282 total pagecache pages Mar 20 07:02:19 s1lp14 kernel: [345318.430772] 11098 pages in swap cache Mar 20 07:02:19 s1lp14 kernel: [345318.430773] Swap cache stats: add 3120111, delete 3108854, find 16001/25849 Mar 20 07:02:19 s1lp14 kernel: [345318.430773] Free swap = 0kB Mar 20 07:02:19 s1lp14 kernel: [345318.430773] Total swap = 640412kB Mar 20 07:02:19 s1lp14 kernel: [345318.430774] 5242880 pages RAM Mar 20 07:02:19 s1lp14 kernel: [345318.430774] 0 pages HighMem/MovableOnly Mar 20 07:02:19 s1lp14 kernel: [345318.430774] 142387 pages reserved Mar 20 07:02:19 s1lp14 kernel: [345318.430775] 0 pages cma reserved Mar 20 07:02:19 s1lp14 kernel: [345318.430775] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:02:19 s1lp14 kernel: [345318.430777] [ 551] 0 551 12750 644 135168 272 0 systemd-journal Mar 20 07:02:19 s1lp14 kernel: [345318.430778] [ 635] 0 635 3774 389 86016 582 -1000 systemd-udevd Mar 20 07:02:19 s1lp14 kernel: [345318.430779] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:02:19 s1lp14 kernel: [345318.430780] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:02:19 s1lp14 kernel: [345318.430781] [ 1078] 100 1078 20782 580 100352 167 0 systemd-timesyn Mar 20 07:02:19 s1lp14 kernel: [345318.430782] [ 1132] 102 1132 2482 512 98304 202 0 systemd-resolve Mar 20 07:02:19 s1lp14 kernel: [345318.430783] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:02:19 s1lp14 kernel: [345318.430784] [ 1226] 0 1226 1547 438 79872 49 0 cron Mar 20 07:02:19 s1lp14 kernel: [345318.430785] [ 1229] 0 1229 2444 502 98304 201 0 systemd-logind Mar 20 07:02:19 s1lp14 kernel: [345318.430786] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:02:19 s1lp14 kernel: [345318.430787] [ 1255] 0 1255 58495 601 131072 214 0 accounts-daemon Mar 20 07:02:19 s1lp14 kernel: [345318.430787] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:02:19 s1lp14 kernel: [345318.430788] [ 1259] 0 1259 20060 374 83968 58 0 irqbalance Mar 20 07:02:19 s1lp14 kernel: [345318.430789] [ 1265] 0 1265 2673 1226 83968 308 0 pkcsslotd Mar 20 07:02:19 s1lp14 kernel: [345318.430790] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:02:19 s1lp14 kernel: [345318.430791] [ 1433] 0 1433 1125 456 73728 40 0 iscsid Mar 20 07:02:19 s1lp14 kernel: [345318.430792] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:02:19 s1lp14 kernel: [345318.430793] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:02:19 s1lp14 kernel: [345318.430794] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:02:19 s1lp14 kernel: [345318.430795] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:02:19 s1lp14 kernel: [345318.430796] [ 7772] 101 7772 2793 486 100352 216 0 systemd-network Mar 20 07:02:19 s1lp14 kernel: [345318.430797] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:02:19 s1lp14 kernel: [345318.430798] [66598] 0 66598 394264 14 253952 2513 -900 snapd Mar 20 07:02:19 s1lp14 kernel: [345318.430799] [113723] 0 113723 2359 476 88064 116 0 wpa_supplicant Mar 20 07:02:19 s1lp14 kernel: [345318.430800] [116349] 0 116349 8972 408 83968 119 0 master Mar 20 07:02:19 s1lp14 kernel: [345318.430800] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:02:19 s1lp14 kernel: [345318.430801] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:02:19 s1lp14 kernel: [345318.430802] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:02:19 s1lp14 kernel: [345318.430803] [117440] 103 117440 54882 363 98304 142 0 rsyslogd Mar 20 07:02:19 s1lp14 kernel: [345318.430804] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:02:19 s1lp14 kernel: [345318.430805] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:02:19 s1lp14 kernel: [345318.430806] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:02:19 s1lp14 kernel: [345318.430806] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:02:19 s1lp14 kernel: [345318.430807] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:02:19 s1lp14 kernel: [345318.430808] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:02:19 s1lp14 kernel: [345318.430809] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:02:19 s1lp14 kernel: [345318.430810] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:02:19 s1lp14 kernel: [345318.430811] [70732] 111 70732 9042 351 88064 140 0 pickup Mar 20 07:02:19 s1lp14 kernel: [345318.430812] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:02:19 s1lp14 kernel: [345318.430813] [190296] 0 190296 3262 444 104448 65 -1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430814] [190297] 0 190297 3262 274 102400 61 -1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430815] [190298] 0 190298 3262 261 102400 51 -1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430816] [190299] 0 190299 3262 259 102400 64 -1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430817] [190300] 0 190300 3262 311 102400 54 -1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430817] [190302] 0 190302 3262 220 102400 71 -1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430818] [190304] 0 190304 3262 303 102400 62 -1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430819] [190307] 0 190307 3262 215 102400 59 -1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430820] [190308] 0 190308 3262 268 102400 65 -1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430821] [190450] 0 190450 1147512 1068822 9289728 75619 1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430822] [190456] 0 190456 1238274 1173852 10014720 61347 1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430823] [190458] 0 190458 937983 934807 7612416 51 1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430824] [190460] 0 190460 454892 451774 3731456 51 1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430825] [190464] 0 190464 581074 577898 4741120 51 1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430826] [190469] 0 190469 408814 405635 3362816 51 1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430827] [190470] 0 190470 287187 284068 2390016 51 1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430827] [190471] 0 190471 8954 5775 147456 50 1000 stress-ng Mar 20 07:02:19 s1lp14 kernel: [345318.430828] Out of memory: Kill process 190456 (stress-ng) score 1228 or sacrifice child Mar 20 07:02:19 s1lp14 kernel: [345318.430834] Killed process 190456 (stress-ng) total-vm:4953096kB, anon-rss:4694976kB, file-rss:428kB, shmem-rss:4kB Mar 20 07:02:20 s1lp14 stress-ng: memory (MB): total 19923.80, free 192.62, shared 3.95, buffer 0.36, swap 625.40, free swap 217.73 Mar 20 07:02:20 s1lp14 kernel: [345319.505470] oom_reaper: reaped process 190456 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:02:30 s1lp14 kernel: [345329.911365] systemd-timesyn invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:02:30 s1lp14 kernel: [345329.911368] systemd-timesyn cpuset=/ mems_allowed=0 Mar 20 07:02:30 s1lp14 kernel: [345329.911375] CPU: 0 PID: 1078 Comm: systemd-timesyn Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:02:30 s1lp14 kernel: [345329.911376] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:02:30 s1lp14 kernel: [345329.911377] Call Trace: Mar 20 07:02:30 s1lp14 kernel: [345329.911386] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:02:30 s1lp14 kernel: [345329.911391] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:02:30 s1lp14 kernel: [345329.911395] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:02:30 s1lp14 kernel: [345329.911397] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:02:30 s1lp14 kernel: [345329.911399] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:02:30 s1lp14 kernel: [345329.911402] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:02:30 s1lp14 kernel: [345329.911404] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:02:30 s1lp14 kernel: [345329.911408] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:02:30 s1lp14 kernel: [345329.911412] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:02:30 s1lp14 kernel: [345329.911414] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:02:30 s1lp14 kernel: [345329.911416] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:02:30 s1lp14 kernel: [345329.911419] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:02:30 s1lp14 kernel: [345329.911422] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:02:30 s1lp14 kernel: [345329.911424] Mem-Info: Mar 20 07:02:30 s1lp14 kernel: [345329.911429] active_anon:4574190 inactive_anon:340226 isolated_anon:194 Mar 20 07:02:30 s1lp14 kernel: [345329.911429] active_file:144 inactive_file:124 isolated_file:0 Mar 20 07:02:30 s1lp14 kernel: [345329.911429] unevictable:7099 dirty:0 writeback:222 unstable:0 Mar 20 07:02:30 s1lp14 kernel: [345329.911429] slab_reclaimable:17286 slab_unreclaimable:40856 Mar 20 07:02:30 s1lp14 kernel: [345329.911429] mapped:2972 shmem:922 pagetables:21089 bounce:0 Mar 20 07:02:30 s1lp14 kernel: [345329.911429] free:23467 free_pcp:4 free_cma:0 Mar 20 07:02:30 s1lp14 kernel: [345329.911434] Node 0 active_anon:18296760kB inactive_anon:1360904kB active_file:576kB inactive_file:496kB unevictable:28396kB isolated(anon):776kB isolated(file):0kB mapped:11888kB dirty:0kB writeback:888kB shmem:3688kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:02:30 s1lp14 kernel: [345329.911435] Node 0 DMA free:73708kB min:2280kB low:4344kB high:6408kB active_anon:1873616kB inactive_anon:122916kB active_file:120kB inactive_file:208kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:64kB pagetables:7860kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:02:30 s1lp14 kernel: [345329.911440] lowmem_reserve[]: 0 17889 17889 Mar 20 07:02:30 s1lp14 kernel: [345329.911443] Node 0 Normal free:20160kB min:20244kB low:38560kB high:56876kB active_anon:16423488kB inactive_anon:1237324kB active_file:676kB inactive_file:144kB unevictable:28396kB writepending:1180kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:8000kB pagetables:76496kB bounce:0kB free_pcp:16kB local_pcp:0kB free_cma:0kB Mar 20 07:02:30 s1lp14 kernel: [345329.911447] lowmem_reserve[]: 0 0 0 Mar 20 07:02:30 s1lp14 kernel: [345329.911449] Node 0 DMA: 222*4kB (UM) 154*8kB (UME) 37*16kB (UM) 28*32kB (UME) 20*64kB (UM) 8*128kB (UME) 4*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74008kB Mar 20 07:02:30 s1lp14 kernel: [345329.911460] Node 0 Normal: 793*4kB (UME) 778*8kB (UME) 305*16kB (UME) 180*32kB (UM) 4*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 20292kB Mar 20 07:02:30 s1lp14 kernel: [345329.911472] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:02:30 s1lp14 kernel: [345329.911472] 18777 total pagecache pages Mar 20 07:02:30 s1lp14 kernel: [345329.911474] 15789 pages in swap cache Mar 20 07:02:30 s1lp14 kernel: [345329.911475] Swap cache stats: add 3181565, delete 3165617, find 16086/25992 Mar 20 07:02:30 s1lp14 kernel: [345329.911476] Free swap = 0kB Mar 20 07:02:30 s1lp14 kernel: [345329.911476] Total swap = 640412kB Mar 20 07:02:30 s1lp14 kernel: [345329.911477] 5242880 pages RAM Mar 20 07:02:30 s1lp14 kernel: [345329.911478] 0 pages HighMem/MovableOnly Mar 20 07:02:30 s1lp14 kernel: [345329.911478] 142387 pages reserved Mar 20 07:02:30 s1lp14 kernel: [345329.911479] 0 pages cma reserved Mar 20 07:02:30 s1lp14 kernel: [345329.911480] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:02:30 s1lp14 kernel: [345329.911484] [ 551] 0 551 12750 662 135168 270 0 systemd-journal Mar 20 07:02:30 s1lp14 kernel: [345329.911486] [ 635] 0 635 3774 470 86016 560 -1000 systemd-udevd Mar 20 07:02:30 s1lp14 kernel: [345329.911488] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:02:30 s1lp14 kernel: [345329.911490] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:02:30 s1lp14 kernel: [345329.911493] [ 1078] 100 1078 20782 521 100352 167 0 systemd-timesyn Mar 20 07:02:30 s1lp14 kernel: [345329.911494] [ 1132] 102 1132 2482 477 98304 202 0 systemd-resolve Mar 20 07:02:30 s1lp14 kernel: [345329.911496] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:02:30 s1lp14 kernel: [345329.911498] [ 1226] 0 1226 1547 436 79872 51 0 cron Mar 20 07:02:30 s1lp14 kernel: [345329.911500] [ 1229] 0 1229 2444 567 98304 180 0 systemd-logind Mar 20 07:02:30 s1lp14 kernel: [345329.911502] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:02:30 s1lp14 kernel: [345329.911503] [ 1255] 0 1255 58495 588 131072 215 0 accounts-daemon Mar 20 07:02:30 s1lp14 kernel: [345329.911505] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:02:30 s1lp14 kernel: [345329.911507] [ 1259] 0 1259 20060 530 83968 58 0 irqbalance Mar 20 07:02:30 s1lp14 kernel: [345329.911509] [ 1265] 0 1265 2673 1133 83968 308 0 pkcsslotd Mar 20 07:02:30 s1lp14 kernel: [345329.911511] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:02:30 s1lp14 kernel: [345329.911512] [ 1433] 0 1433 1125 456 73728 40 0 iscsid Mar 20 07:02:30 s1lp14 kernel: [345329.911514] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:02:30 s1lp14 kernel: [345329.911515] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:02:30 s1lp14 kernel: [345329.911517] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:02:30 s1lp14 kernel: [345329.911519] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:02:30 s1lp14 kernel: [345329.911521] [ 7772] 101 7772 2793 486 100352 216 0 systemd-network Mar 20 07:02:30 s1lp14 kernel: [345329.911523] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:02:30 s1lp14 kernel: [345329.911525] [66598] 0 66598 394264 14 253952 2529 -900 snapd Mar 20 07:02:30 s1lp14 kernel: [345329.911526] [113723] 0 113723 2359 430 88064 116 0 wpa_supplicant Mar 20 07:02:30 s1lp14 kernel: [345329.911528] [116349] 0 116349 8972 405 83968 122 0 master Mar 20 07:02:30 s1lp14 kernel: [345329.911530] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:02:30 s1lp14 kernel: [345329.911532] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:02:30 s1lp14 kernel: [345329.911534] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:02:30 s1lp14 kernel: [345329.911536] [117440] 103 117440 54882 555 98304 142 0 rsyslogd Mar 20 07:02:30 s1lp14 kernel: [345329.911538] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:02:30 s1lp14 kernel: [345329.911540] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:02:30 s1lp14 kernel: [345329.911542] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:02:30 s1lp14 kernel: [345329.911543] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:02:30 s1lp14 kernel: [345329.911545] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:02:30 s1lp14 kernel: [345329.911547] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:02:30 s1lp14 kernel: [345329.911549] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:02:30 s1lp14 kernel: [345329.911551] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:02:30 s1lp14 kernel: [345329.911553] [70732] 111 70732 9042 351 88064 142 0 pickup Mar 20 07:02:30 s1lp14 kernel: [345329.911554] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:02:30 s1lp14 kernel: [345329.911556] [190296] 0 190296 3262 444 104448 65 -1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911558] [190297] 0 190297 3262 274 102400 61 -1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911560] [190298] 0 190298 3262 261 102400 51 -1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911562] [190299] 0 190299 3262 313 102400 52 -1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911563] [190300] 0 190300 3262 311 102400 54 -1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911566] [190302] 0 190302 3262 220 102400 71 -1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911568] [190304] 0 190304 3262 303 102400 62 -1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911570] [190307] 0 190307 3262 215 102400 59 -1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911571] [190308] 0 190308 3262 268 102400 65 -1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911574] [190450] 0 190450 1348875 1208906 10917888 136845 1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911575] [190458] 0 190458 1050818 1047640 8515584 51 1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911577] [190460] 0 190460 565618 562442 4618240 51 1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911579] [190464] 0 190464 789956 786778 6412288 51 1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911581] [190469] 0 190469 526629 523436 4306944 51 1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911583] [190470] 0 190470 555577 552397 4538368 51 1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911584] [190471] 0 190471 217528 214338 1816576 50 1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911586] [190476] 0 190476 5077 1903 116736 51 1000 stress-ng Mar 20 07:02:30 s1lp14 kernel: [345329.911587] Out of memory: Kill process 190450 (stress-ng) score 1248 or sacrifice child Mar 20 07:02:30 s1lp14 kernel: [345329.911595] Killed process 190450 (stress-ng) total-vm:5395500kB, anon-rss:4835384kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:02:31 s1lp14 stress-ng: memory (MB): total 19923.80, free 123.57, shared 3.95, buffer 0.35, swap 625.40, free swap 489.19 Mar 20 07:02:31 s1lp14 kernel: [345330.995761] oom_reaper: reaped process 190450 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:4kB Mar 20 07:02:45 s1lp14 kernel: [345344.116338] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:02:45 s1lp14 kernel: [345344.116340] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:02:45 s1lp14 kernel: [345344.116346] CPU: 2 PID: 190470 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:02:45 s1lp14 kernel: [345344.116346] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:02:45 s1lp14 kernel: [345344.116347] Call Trace: Mar 20 07:02:45 s1lp14 kernel: [345344.116356] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:02:45 s1lp14 kernel: [345344.116361] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:02:45 s1lp14 kernel: [345344.116365] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:02:45 s1lp14 kernel: [345344.116367] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:02:45 s1lp14 kernel: [345344.116368] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:02:45 s1lp14 kernel: [345344.116371] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:02:45 s1lp14 kernel: [345344.116375] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:02:45 s1lp14 kernel: [345344.116379] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:02:45 s1lp14 kernel: [345344.116381] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:02:45 s1lp14 kernel: [345344.116383] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:02:45 s1lp14 kernel: [345344.116386] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:02:45 s1lp14 kernel: [345344.116389] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:02:45 s1lp14 kernel: [345344.116390] Mem-Info: Mar 20 07:02:45 s1lp14 kernel: [345344.116395] active_anon:4562289 inactive_anon:351715 isolated_anon:136 Mar 20 07:02:45 s1lp14 kernel: [345344.116395] active_file:203 inactive_file:117 isolated_file:0 Mar 20 07:02:45 s1lp14 kernel: [345344.116395] unevictable:7099 dirty:0 writeback:539 unstable:0 Mar 20 07:02:45 s1lp14 kernel: [345344.116395] slab_reclaimable:17286 slab_unreclaimable:40931 Mar 20 07:02:45 s1lp14 kernel: [345344.116395] mapped:3038 shmem:1012 pagetables:21106 bounce:0 Mar 20 07:02:45 s1lp14 kernel: [345344.116395] free:23415 free_pcp:0 free_cma:0 Mar 20 07:02:45 s1lp14 kernel: [345344.116400] Node 0 active_anon:18249156kB inactive_anon:1406860kB active_file:812kB inactive_file:468kB unevictable:28396kB isolated(anon):544kB isolated(file):0kB mapped:12152kB dirty:0kB writeback:2156kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:02:45 s1lp14 kernel: [345344.116401] Node 0 DMA free:73728kB min:2280kB low:4344kB high:6408kB active_anon:1885512kB inactive_anon:110328kB active_file:172kB inactive_file:260kB unevictable:0kB writepending:4kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:8080kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:02:45 s1lp14 kernel: [345344.116405] lowmem_reserve[]: 0 17889 17889 Mar 20 07:02:45 s1lp14 kernel: [345344.116408] Node 0 Normal free:19932kB min:20244kB low:38560kB high:56876kB active_anon:16363296kB inactive_anon:1296372kB active_file:556kB inactive_file:792kB unevictable:28396kB writepending:1524kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7968kB pagetables:76344kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:02:45 s1lp14 kernel: [345344.116413] lowmem_reserve[]: 0 0 0 Mar 20 07:02:45 s1lp14 kernel: [345344.116415] Node 0 DMA: 212*4kB (UM) 134*8kB (UME) 51*16kB (UM) 38*32kB (UME) 26*64kB (UM) 10*128kB (UME) 3*256kB (UME) 2*512kB (UE) 64*1024kB (UM) = 74224kB Mar 20 07:02:45 s1lp14 kernel: [345344.116427] Node 0 Normal: 560*4kB (UME) 694*8kB (UME) 282*16kB (UME) 252*32kB (UME) 2*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 20496kB Mar 20 07:02:45 s1lp14 kernel: [345344.116438] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:02:45 s1lp14 kernel: [345344.116439] 14282 total pagecache pages Mar 20 07:02:45 s1lp14 kernel: [345344.116440] 11126 pages in swap cache Mar 20 07:02:45 s1lp14 kernel: [345344.116441] Swap cache stats: add 3318763, delete 3307479, find 16227/26333 Mar 20 07:02:45 s1lp14 kernel: [345344.116442] Free swap = 0kB Mar 20 07:02:45 s1lp14 kernel: [345344.116442] Total swap = 640412kB Mar 20 07:02:45 s1lp14 kernel: [345344.116443] 5242880 pages RAM Mar 20 07:02:45 s1lp14 kernel: [345344.116444] 0 pages HighMem/MovableOnly Mar 20 07:02:45 s1lp14 kernel: [345344.116444] 142387 pages reserved Mar 20 07:02:45 s1lp14 kernel: [345344.116445] 0 pages cma reserved Mar 20 07:02:45 s1lp14 kernel: [345344.116446] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:02:45 s1lp14 kernel: [345344.116450] [ 551] 0 551 12750 588 135168 268 0 systemd-journal Mar 20 07:02:45 s1lp14 kernel: [345344.116452] [ 635] 0 635 3774 470 86016 560 -1000 systemd-udevd Mar 20 07:02:45 s1lp14 kernel: [345344.116455] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:02:45 s1lp14 kernel: [345344.116457] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:02:45 s1lp14 kernel: [345344.116459] [ 1078] 100 1078 20782 569 100352 149 0 systemd-timesyn Mar 20 07:02:45 s1lp14 kernel: [345344.116461] [ 1132] 102 1132 2482 465 98304 180 0 systemd-resolve Mar 20 07:02:45 s1lp14 kernel: [345344.116463] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:02:45 s1lp14 kernel: [345344.116465] [ 1226] 0 1226 1547 434 79872 53 0 cron Mar 20 07:02:45 s1lp14 kernel: [345344.116466] [ 1229] 0 1229 2444 566 98304 181 0 systemd-logind Mar 20 07:02:45 s1lp14 kernel: [345344.116468] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:02:45 s1lp14 kernel: [345344.116470] [ 1255] 0 1255 58495 601 131072 214 0 accounts-daemon Mar 20 07:02:45 s1lp14 kernel: [345344.116472] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:02:45 s1lp14 kernel: [345344.116473] [ 1259] 0 1259 20060 459 83968 58 0 irqbalance Mar 20 07:02:45 s1lp14 kernel: [345344.116475] [ 1265] 0 1265 2673 1226 83968 308 0 pkcsslotd Mar 20 07:02:45 s1lp14 kernel: [345344.116477] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:02:45 s1lp14 kernel: [345344.116479] [ 1433] 0 1433 1125 456 73728 40 0 iscsid Mar 20 07:02:45 s1lp14 kernel: [345344.116481] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:02:45 s1lp14 kernel: [345344.116482] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:02:45 s1lp14 kernel: [345344.116484] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:02:45 s1lp14 kernel: [345344.116486] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:02:45 s1lp14 kernel: [345344.116489] [ 7772] 101 7772 2793 486 100352 216 0 systemd-network Mar 20 07:02:45 s1lp14 kernel: [345344.116490] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:02:45 s1lp14 kernel: [345344.116492] [66598] 0 66598 394264 14 253952 2529 -900 snapd Mar 20 07:02:45 s1lp14 kernel: [345344.116494] [113723] 0 113723 2359 407 88064 116 0 wpa_supplicant Mar 20 07:02:45 s1lp14 kernel: [345344.116496] [116349] 0 116349 8972 419 83968 112 0 master Mar 20 07:02:45 s1lp14 kernel: [345344.116498] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:02:45 s1lp14 kernel: [345344.116499] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:02:45 s1lp14 kernel: [345344.116501] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:02:45 s1lp14 kernel: [345344.116503] [117440] 103 117440 54882 422 98304 142 0 rsyslogd Mar 20 07:02:45 s1lp14 kernel: [345344.116505] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:02:45 s1lp14 kernel: [345344.116507] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:02:45 s1lp14 kernel: [345344.116508] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:02:45 s1lp14 kernel: [345344.116509] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:02:45 s1lp14 kernel: [345344.116511] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:02:45 s1lp14 kernel: [345344.116512] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:02:45 s1lp14 kernel: [345344.116514] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:02:45 s1lp14 kernel: [345344.116516] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:02:45 s1lp14 kernel: [345344.116518] [70732] 111 70732 9042 368 88064 116 0 pickup Mar 20 07:02:45 s1lp14 kernel: [345344.116520] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:02:45 s1lp14 kernel: [345344.116522] [190296] 0 190296 3262 444 104448 65 -1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116523] [190297] 0 190297 3262 274 102400 61 -1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116525] [190298] 0 190298 3262 261 102400 51 -1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116527] [190299] 0 190299 3262 313 102400 52 -1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116529] [190300] 0 190300 3262 308 102400 57 -1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116531] [190302] 0 190302 3262 312 102400 53 -1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116533] [190304] 0 190304 3262 303 102400 62 -1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116535] [190307] 0 190307 3262 215 102400 59 -1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116537] [190308] 0 190308 3262 268 102400 65 -1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116539] [190458] 0 190458 1133850 993690 9181184 137035 1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116541] [190460] 0 190460 738052 734873 5996544 51 1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116543] [190464] 0 190464 1026978 1023798 8325120 51 1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116545] [190469] 0 190469 727530 724352 5912576 51 1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116546] [190470] 0 190470 892783 889608 7251968 51 1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116548] [190471] 0 190471 407903 404726 3356672 50 1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116549] [190476] 0 190476 124733 121554 1075200 51 1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116552] [190478] 0 190478 12726 9547 178176 51 1000 stress-ng Mar 20 07:02:45 s1lp14 kernel: [345344.116553] Out of memory: Kill process 190458 (stress-ng) score 1208 or sacrifice child Mar 20 07:02:45 s1lp14 kernel: [345344.116560] Killed process 190458 (stress-ng) total-vm:4535400kB, anon-rss:3974520kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:02:46 s1lp14 kernel: [345345.088062] oom_reaper: reaped process 190458 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:4kB Mar 20 07:02:47 s1lp14 stress-ng: memory (MB): total 19923.80, free 91.45, shared 1.02, buffer 0.35, swap 625.40, free swap 482.76 Mar 20 07:03:00 s1lp14 kernel: [345359.354899] stress-ng invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=-1000 Mar 20 07:03:00 s1lp14 kernel: [345359.354901] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:03:00 s1lp14 kernel: [345359.354908] CPU: 0 PID: 190296 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:03:00 s1lp14 kernel: [345359.354909] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:03:00 s1lp14 kernel: [345359.354910] Call Trace: Mar 20 07:03:00 s1lp14 kernel: [345359.354919] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:03:00 s1lp14 kernel: [345359.354924] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:03:00 s1lp14 kernel: [345359.354929] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:03:00 s1lp14 kernel: [345359.354930] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:03:00 s1lp14 kernel: [345359.354932] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:03:00 s1lp14 kernel: [345359.354936] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:03:00 s1lp14 kernel: [345359.354937] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:03:00 s1lp14 kernel: [345359.354941] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:03:00 s1lp14 kernel: [345359.354946] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:03:00 s1lp14 kernel: [345359.354949] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:03:00 s1lp14 kernel: [345359.354951] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:03:00 s1lp14 kernel: [345359.354954] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:03:00 s1lp14 kernel: [345359.354957] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:03:00 s1lp14 kernel: [345359.354959] Mem-Info: Mar 20 07:03:00 s1lp14 kernel: [345359.354964] active_anon:4561697 inactive_anon:352521 isolated_anon:70 Mar 20 07:03:00 s1lp14 kernel: [345359.354964] active_file:25 inactive_file:95 isolated_file:0 Mar 20 07:03:00 s1lp14 kernel: [345359.354964] unevictable:7099 dirty:2 writeback:64 unstable:0 Mar 20 07:03:00 s1lp14 kernel: [345359.354964] slab_reclaimable:17286 slab_unreclaimable:40850 Mar 20 07:03:00 s1lp14 kernel: [345359.354964] mapped:2920 shmem:1012 pagetables:21075 bounce:0 Mar 20 07:03:00 s1lp14 kernel: [345359.354964] free:23500 free_pcp:0 free_cma:0 Mar 20 07:03:00 s1lp14 kernel: [345359.354968] Node 0 active_anon:18246788kB inactive_anon:1410084kB active_file:100kB inactive_file:380kB unevictable:28396kB isolated(anon):280kB isolated(file):0kB mapped:11680kB dirty:8kB writeback:256kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:03:00 s1lp14 kernel: [345359.354969] Node 0 DMA free:73824kB min:2280kB low:4344kB high:6408kB active_anon:1892896kB inactive_anon:102612kB active_file:8kB inactive_file:384kB unevictable:0kB writepending:212kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:96kB pagetables:8228kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:03:00 s1lp14 kernel: [345359.354973] lowmem_reserve[]: 0 17889 17889 Mar 20 07:03:00 s1lp14 kernel: [345359.354976] Node 0 Normal free:20176kB min:20244kB low:38560kB high:56876kB active_anon:16353920kB inactive_anon:1307472kB active_file:92kB inactive_file:872kB unevictable:28396kB writepending:344kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7952kB pagetables:76072kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:03:00 s1lp14 kernel: [345359.354981] lowmem_reserve[]: 0 0 0 Mar 20 07:03:00 s1lp14 kernel: [345359.354984] Node 0 DMA: 101*4kB (UM) 114*8kB (UME) 57*16kB (UM) 46*32kB (UME) 28*64kB (UM) 9*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74484kB Mar 20 07:03:00 s1lp14 kernel: [345359.354998] Node 0 Normal: 516*4kB (UME) 578*8kB (UME) 408*16kB (UME) 257*32kB (UM) 1*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 21504kB Mar 20 07:03:00 s1lp14 kernel: [345359.355010] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:03:00 s1lp14 kernel: [345359.355010] 23673 total pagecache pages Mar 20 07:03:00 s1lp14 kernel: [345359.355012] 20554 pages in swap cache Mar 20 07:03:00 s1lp14 kernel: [345359.355013] Swap cache stats: add 3470687, delete 3449970, find 17531/28285 Mar 20 07:03:00 s1lp14 kernel: [345359.355014] Free swap = 0kB Mar 20 07:03:00 s1lp14 kernel: [345359.355014] Total swap = 640412kB Mar 20 07:03:00 s1lp14 kernel: [345359.355015] 5242880 pages RAM Mar 20 07:03:00 s1lp14 kernel: [345359.355016] 0 pages HighMem/MovableOnly Mar 20 07:03:00 s1lp14 kernel: [345359.355017] 142387 pages reserved Mar 20 07:03:00 s1lp14 kernel: [345359.355017] 0 pages cma reserved Mar 20 07:03:00 s1lp14 kernel: [345359.355018] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:03:00 s1lp14 kernel: [345359.355022] [ 551] 0 551 12750 619 135168 267 0 systemd-journal Mar 20 07:03:00 s1lp14 kernel: [345359.355024] [ 635] 0 635 3774 465 86016 565 -1000 systemd-udevd Mar 20 07:03:00 s1lp14 kernel: [345359.355027] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:03:00 s1lp14 kernel: [345359.355029] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:03:00 s1lp14 kernel: [345359.355031] [ 1078] 100 1078 20782 566 100352 159 0 systemd-timesyn Mar 20 07:03:00 s1lp14 kernel: [345359.355033] [ 1132] 102 1132 2482 461 98304 196 0 systemd-resolve Mar 20 07:03:00 s1lp14 kernel: [345359.355034] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:03:00 s1lp14 kernel: [345359.355036] [ 1226] 0 1226 1547 426 79872 61 0 cron Mar 20 07:03:00 s1lp14 kernel: [345359.355038] [ 1229] 0 1229 2444 556 98304 191 0 systemd-logind Mar 20 07:03:00 s1lp14 kernel: [345359.355040] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:03:00 s1lp14 kernel: [345359.355041] [ 1255] 0 1255 58495 514 131072 218 0 accounts-daemon Mar 20 07:03:00 s1lp14 kernel: [345359.355043] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:03:00 s1lp14 kernel: [345359.355045] [ 1259] 0 1259 20060 495 83968 58 0 irqbalance Mar 20 07:03:00 s1lp14 kernel: [345359.355047] [ 1265] 0 1265 2673 1175 83968 310 0 pkcsslotd Mar 20 07:03:00 s1lp14 kernel: [345359.355049] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:03:00 s1lp14 kernel: [345359.355051] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:03:00 s1lp14 kernel: [345359.355053] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:03:00 s1lp14 kernel: [345359.355054] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:03:00 s1lp14 kernel: [345359.355057] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:03:00 s1lp14 kernel: [345359.355058] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:03:00 s1lp14 kernel: [345359.355060] [ 7772] 101 7772 2793 486 100352 221 0 systemd-network Mar 20 07:03:00 s1lp14 kernel: [345359.355062] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:03:00 s1lp14 kernel: [345359.355064] [66598] 0 66598 394264 207 253952 2116 -900 snapd Mar 20 07:03:00 s1lp14 kernel: [345359.355066] [113723] 0 113723 2359 520 88064 118 0 wpa_supplicant Mar 20 07:03:00 s1lp14 kernel: [345359.355068] [116349] 0 116349 8972 419 83968 112 0 master Mar 20 07:03:00 s1lp14 kernel: [345359.355070] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:03:00 s1lp14 kernel: [345359.355071] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:03:00 s1lp14 kernel: [345359.355073] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:03:00 s1lp14 kernel: [345359.355075] [117440] 103 117440 54882 522 98304 151 0 rsyslogd Mar 20 07:03:00 s1lp14 kernel: [345359.355077] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:03:00 s1lp14 kernel: [345359.355079] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:03:00 s1lp14 kernel: [345359.355081] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:03:00 s1lp14 kernel: [345359.355083] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:03:00 s1lp14 kernel: [345359.355085] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:03:00 s1lp14 kernel: [345359.355087] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:03:00 s1lp14 kernel: [345359.355089] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:03:00 s1lp14 kernel: [345359.355091] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:03:00 s1lp14 kernel: [345359.355093] [70732] 111 70732 9042 368 88064 116 0 pickup Mar 20 07:03:00 s1lp14 kernel: [345359.355095] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:03:00 s1lp14 kernel: [345359.355097] [190296] 0 190296 3262 444 104448 65 -1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355099] [190297] 0 190297 3262 274 102400 61 -1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355101] [190298] 0 190298 3262 261 102400 51 -1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355103] [190299] 0 190299 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355105] [190300] 0 190300 3262 262 102400 56 -1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355107] [190302] 0 190302 3262 312 102400 53 -1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355109] [190304] 0 190304 3262 303 102400 62 -1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355111] [190307] 0 190307 3262 215 102400 59 -1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355112] [190308] 0 190308 3262 256 102400 77 -1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355115] [190460] 0 190460 907448 767109 7368704 137177 1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355117] [190464] 0 190464 1189356 1185938 9623552 246 1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355118] [190469] 0 190469 810374 807197 6592512 51 1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355120] [190470] 0 190470 1187774 1184595 9611264 51 1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355122] [190471] 0 190471 606387 603211 4943872 50 1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355124] [190476] 0 190476 226069 222893 1886208 51 1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355126] [190478] 0 190478 105454 102276 919552 51 1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355128] [190482] 0 190482 22067 18864 253952 51 1000 stress-ng Mar 20 07:03:00 s1lp14 kernel: [345359.355129] Out of memory: Kill process 190464 (stress-ng) score 1219 or sacrifice child Mar 20 07:03:00 s1lp14 kernel: [345359.355138] Killed process 190464 (stress-ng) total-vm:4757424kB, anon-rss:4743688kB, file-rss:60kB, shmem-rss:4kB Mar 20 07:03:01 s1lp14 kernel: [345360.529826] oom_reaper: reaped process 190464 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:03:01 s1lp14 stress-ng: memory (MB): total 19923.80, free 252.45, shared 3.95, buffer 0.35, swap 625.40, free swap 0.00 Mar 20 07:03:01 s1lp14 kernel: [345360.625167] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:03:01 s1lp14 kernel: [345360.625169] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:03:01 s1lp14 kernel: [345360.625176] CPU: 4 PID: 190476 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:03:01 s1lp14 kernel: [345360.625177] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:03:01 s1lp14 kernel: [345360.625179] Call Trace: Mar 20 07:03:01 s1lp14 kernel: [345360.625188] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:03:01 s1lp14 kernel: [345360.625193] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:03:01 s1lp14 kernel: [345360.625198] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:03:01 s1lp14 kernel: [345360.625199] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:03:01 s1lp14 kernel: [345360.625202] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:03:01 s1lp14 kernel: [345360.625205] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:03:01 s1lp14 kernel: [345360.625209] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:03:01 s1lp14 kernel: [345360.625214] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:03:01 s1lp14 kernel: [345360.625215] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:03:01 s1lp14 kernel: [345360.625217] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:03:01 s1lp14 kernel: [345360.625220] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:03:01 s1lp14 kernel: [345360.625223] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:03:01 s1lp14 kernel: [345360.625224] Mem-Info: Mar 20 07:03:01 s1lp14 kernel: [345360.625229] active_anon:4755375 inactive_anon:158735 isolated_anon:96 Mar 20 07:03:01 s1lp14 kernel: [345360.625229] active_file:142 inactive_file:86 isolated_file:0 Mar 20 07:03:01 s1lp14 kernel: [345360.625229] unevictable:7099 dirty:8 writeback:0 unstable:0 Mar 20 07:03:01 s1lp14 kernel: [345360.625229] slab_reclaimable:17286 slab_unreclaimable:40866 Mar 20 07:03:01 s1lp14 kernel: [345360.625229] mapped:2987 shmem:1012 pagetables:21059 bounce:0 Mar 20 07:03:01 s1lp14 kernel: [345360.625229] free:23379 free_pcp:346 free_cma:0 Mar 20 07:03:01 s1lp14 kernel: [345360.625234] Node 0 active_anon:19021500kB inactive_anon:634940kB active_file:568kB inactive_file:344kB unevictable:28396kB isolated(anon):384kB isolated(file):0kB mapped:11948kB dirty:32kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:03:01 s1lp14 kernel: [345360.625235] Node 0 DMA free:73620kB min:2280kB low:4344kB high:6408kB active_anon:1934604kB inactive_anon:60832kB active_file:32kB inactive_file:0kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:8184kB bounce:0kB free_pcp:508kB local_pcp:0kB free_cma:0kB Mar 20 07:03:01 s1lp14 kernel: [345360.625238] lowmem_reserve[]: 0 17889 17889 Mar 20 07:03:01 s1lp14 kernel: [345360.625241] Node 0 Normal free:19896kB min:20244kB low:38560kB high:56876kB active_anon:17088168kB inactive_anon:573132kB active_file:624kB inactive_file:0kB unevictable:28396kB writepending:24kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7968kB pagetables:76052kB bounce:0kB free_pcp:876kB local_pcp:436kB free_cma:0kB Mar 20 07:03:01 s1lp14 kernel: [345360.625246] lowmem_reserve[]: 0 0 0 Mar 20 07:03:01 s1lp14 kernel: [345360.625248] Node 0 DMA: 173*4kB (U) 108*8kB (UE) 22*16kB (U) 28*32kB (UME) 28*64kB (UM) 9*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73588kB Mar 20 07:03:01 s1lp14 kernel: [345360.625259] Node 0 Normal: 978*4kB (UME) 629*8kB (UE) 266*16kB (UE) 212*32kB (UME) 1*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 20048kB Mar 20 07:03:01 s1lp14 kernel: [345360.625270] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:03:01 s1lp14 kernel: [345360.625270] 23833 total pagecache pages Mar 20 07:03:01 s1lp14 kernel: [345360.625271] 20739 pages in swap cache Mar 20 07:03:01 s1lp14 kernel: [345360.625272] Swap cache stats: add 3471981, delete 3451079, find 17974/28929 Mar 20 07:03:01 s1lp14 kernel: [345360.625273] Free swap = 0kB Mar 20 07:03:01 s1lp14 kernel: [345360.625274] Total swap = 640412kB Mar 20 07:03:01 s1lp14 kernel: [345360.625274] 5242880 pages RAM Mar 20 07:03:01 s1lp14 kernel: [345360.625275] 0 pages HighMem/MovableOnly Mar 20 07:03:01 s1lp14 kernel: [345360.625276] 142387 pages reserved Mar 20 07:03:01 s1lp14 kernel: [345360.625276] 0 pages cma reserved Mar 20 07:03:01 s1lp14 kernel: [345360.625277] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:03:01 s1lp14 kernel: [345360.625281] [ 551] 0 551 12750 655 135168 266 0 systemd-journal Mar 20 07:03:01 s1lp14 kernel: [345360.625283] [ 635] 0 635 3774 465 86016 565 -1000 systemd-udevd Mar 20 07:03:01 s1lp14 kernel: [345360.625286] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:03:01 s1lp14 kernel: [345360.625288] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:03:01 s1lp14 kernel: [345360.625290] [ 1078] 100 1078 20782 566 100352 160 0 systemd-timesyn Mar 20 07:03:01 s1lp14 kernel: [345360.625293] [ 1132] 102 1132 2482 461 98304 196 0 systemd-resolve Mar 20 07:03:01 s1lp14 kernel: [345360.625294] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:03:01 s1lp14 kernel: [345360.625296] [ 1226] 0 1226 1547 426 79872 61 0 cron Mar 20 07:03:01 s1lp14 kernel: [345360.625298] [ 1229] 0 1229 2444 556 98304 191 0 systemd-logind Mar 20 07:03:01 s1lp14 kernel: [345360.625300] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:03:01 s1lp14 kernel: [345360.625303] [ 1255] 0 1255 58495 597 131072 218 0 accounts-daemon Mar 20 07:03:01 s1lp14 kernel: [345360.625305] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:03:01 s1lp14 kernel: [345360.625306] [ 1259] 0 1259 20060 495 83968 58 0 irqbalance Mar 20 07:03:01 s1lp14 kernel: [345360.625308] [ 1265] 0 1265 2673 1175 83968 310 0 pkcsslotd Mar 20 07:03:01 s1lp14 kernel: [345360.625310] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:03:01 s1lp14 kernel: [345360.625312] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:03:01 s1lp14 kernel: [345360.625314] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:03:01 s1lp14 kernel: [345360.625316] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:03:01 s1lp14 kernel: [345360.625318] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:03:01 s1lp14 kernel: [345360.625319] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:03:01 s1lp14 kernel: [345360.625321] [ 7772] 101 7772 2793 486 100352 221 0 systemd-network Mar 20 07:03:01 s1lp14 kernel: [345360.625323] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:03:01 s1lp14 kernel: [345360.625325] [66598] 0 66598 394264 611 253952 1677 -900 snapd Mar 20 07:03:01 s1lp14 kernel: [345360.625327] [113723] 0 113723 2359 459 88064 118 0 wpa_supplicant Mar 20 07:03:01 s1lp14 kernel: [345360.625329] [116349] 0 116349 8972 419 83968 112 0 master Mar 20 07:03:01 s1lp14 kernel: [345360.625330] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:03:01 s1lp14 kernel: [345360.625332] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:03:01 s1lp14 kernel: [345360.625334] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:03:01 s1lp14 kernel: [345360.625336] [117440] 103 117440 54882 467 98304 143 0 rsyslogd Mar 20 07:03:01 s1lp14 kernel: [345360.625338] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:03:01 s1lp14 kernel: [345360.625341] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:03:01 s1lp14 kernel: [345360.625343] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:03:01 s1lp14 kernel: [345360.625344] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:03:01 s1lp14 kernel: [345360.625346] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:03:01 s1lp14 kernel: [345360.625348] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:03:01 s1lp14 kernel: [345360.625350] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:03:01 s1lp14 kernel: [345360.625352] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:03:01 s1lp14 kernel: [345360.625354] [70732] 111 70732 9042 368 88064 116 0 pickup Mar 20 07:03:01 s1lp14 kernel: [345360.625356] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:03:01 s1lp14 kernel: [345360.625358] [190296] 0 190296 3262 444 104448 65 -1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625360] [190297] 0 190297 3262 274 102400 61 -1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625362] [190298] 0 190298 3262 261 102400 51 -1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625363] [190299] 0 190299 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625365] [190300] 0 190300 3262 262 102400 56 -1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625367] [190302] 0 190302 3262 312 102400 53 -1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625369] [190304] 0 190304 3262 244 102400 61 -1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625371] [190307] 0 190307 3262 215 102400 59 -1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625373] [190308] 0 190308 3262 256 102400 77 -1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625375] [190460] 0 190460 914433 773507 7424000 137803 1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625377] [190469] 0 190469 960315 957137 7792640 51 1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625378] [190470] 0 190470 1446886 1443707 11700224 51 1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625380] [190471] 0 190471 606387 603211 4943872 50 1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625382] [190476] 0 190476 391757 388583 3227648 51 1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625384] [190478] 0 190478 324526 321348 2689024 51 1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625385] [190482] 0 190482 397202 394022 3270656 51 1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625387] [190487] 0 190487 13246 10072 182272 51 1000 stress-ng Mar 20 07:03:01 s1lp14 kernel: [345360.625388] Out of memory: Kill process 190470 (stress-ng) score 1266 or sacrifice child Mar 20 07:03:01 s1lp14 kernel: [345360.625396] Killed process 190470 (stress-ng) total-vm:5787544kB, anon-rss:5774588kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:03:02 s1lp14 kernel: [345361.860219] oom_reaper: reaped process 190470 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:03:02 s1lp14 stress-ng: memory (MB): total 19923.80, free 378.16, shared 3.95, buffer 0.41, swap 625.40, free swap 0.00 Mar 20 07:03:03 s1lp14 kernel: [345362.200378] stress-ng invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=-1000 Mar 20 07:03:03 s1lp14 kernel: [345362.200379] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:03:03 s1lp14 kernel: [345362.200383] CPU: 3 PID: 190296 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:03:03 s1lp14 kernel: [345362.200384] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:03:03 s1lp14 kernel: [345362.200385] Call Trace: Mar 20 07:03:03 s1lp14 kernel: [345362.200393] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:03:03 s1lp14 kernel: [345362.200397] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:03:03 s1lp14 kernel: [345362.200401] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:03:03 s1lp14 kernel: [345362.200402] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:03:03 s1lp14 kernel: [345362.200403] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:03:03 s1lp14 kernel: [345362.200405] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:03:03 s1lp14 kernel: [345362.200405] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:03:03 s1lp14 kernel: [345362.200409] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:03:03 s1lp14 kernel: [345362.200413] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:03:03 s1lp14 kernel: [345362.200414] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:03:03 s1lp14 kernel: [345362.200415] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:03:03 s1lp14 kernel: [345362.200418] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:03:03 s1lp14 kernel: [345362.200421] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:03:03 s1lp14 kernel: [345362.200421] Mem-Info: Mar 20 07:03:03 s1lp14 kernel: [345362.200425] active_anon:4698139 inactive_anon:215575 isolated_anon:96 Mar 20 07:03:03 s1lp14 kernel: [345362.200425] active_file:0 inactive_file:27 isolated_file:0 Mar 20 07:03:03 s1lp14 kernel: [345362.200425] unevictable:7099 dirty:16 writeback:0 unstable:0 Mar 20 07:03:03 s1lp14 kernel: [345362.200425] slab_reclaimable:17286 slab_unreclaimable:40906 Mar 20 07:03:03 s1lp14 kernel: [345362.200425] mapped:2979 shmem:1012 pagetables:21080 bounce:0 Mar 20 07:03:03 s1lp14 kernel: [345362.200425] free:23439 free_pcp:0 free_cma:0 Mar 20 07:03:03 s1lp14 kernel: [345362.200427] Node 0 active_anon:18792556kB inactive_anon:862300kB active_file:0kB inactive_file:108kB unevictable:28396kB isolated(anon):384kB isolated(file):0kB mapped:11916kB dirty:64kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:03:03 s1lp14 kernel: [345362.200428] Node 0 DMA free:73788kB min:2280kB low:4344kB high:6408kB active_anon:1915304kB inactive_anon:79492kB active_file:0kB inactive_file:512kB unevictable:0kB writepending:28kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:8152kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:03:03 s1lp14 kernel: [345362.200430] lowmem_reserve[]: 0 17889 17889 Mar 20 07:03:03 s1lp14 kernel: [345362.200432] Node 0 Normal free:19968kB min:20244kB low:38560kB high:56876kB active_anon:16877172kB inactive_anon:781208kB active_file:756kB inactive_file:408kB unevictable:28396kB writepending:36kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7952kB pagetables:76168kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:03:03 s1lp14 kernel: [345362.200434] lowmem_reserve[]: 0 0 0 Mar 20 07:03:03 s1lp14 kernel: [345362.200435] Node 0 DMA: 202*4kB (UM) 115*8kB (UME) 76*16kB (UM) 23*32kB (UME) 35*64kB (UM) 9*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74912kB Mar 20 07:03:03 s1lp14 kernel: [345362.200442] Node 0 Normal: 984*4kB (UME) 849*8kB (UME) 338*16kB (UME) 186*32kB (UME) 1*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 22152kB Mar 20 07:03:03 s1lp14 kernel: [345362.200449] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:03:03 s1lp14 kernel: [345362.200450] 3407 total pagecache pages Mar 20 07:03:03 s1lp14 kernel: [345362.200451] 273 pages in swap cache Mar 20 07:03:03 s1lp14 kernel: [345362.200451] Swap cache stats: add 3472012, delete 3471576, find 17991/28954 Mar 20 07:03:03 s1lp14 kernel: [345362.200452] Free swap = 0kB Mar 20 07:03:03 s1lp14 kernel: [345362.200452] Total swap = 640412kB Mar 20 07:03:03 s1lp14 kernel: [345362.200453] 5242880 pages RAM Mar 20 07:03:03 s1lp14 kernel: [345362.200453] 0 pages HighMem/MovableOnly Mar 20 07:03:03 s1lp14 kernel: [345362.200453] 142387 pages reserved Mar 20 07:03:03 s1lp14 kernel: [345362.200454] 0 pages cma reserved Mar 20 07:03:03 s1lp14 kernel: [345362.200454] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:03:03 s1lp14 kernel: [345362.200457] [ 551] 0 551 12750 666 135168 266 0 systemd-journal Mar 20 07:03:03 s1lp14 kernel: [345362.200458] [ 635] 0 635 3774 465 86016 565 -1000 systemd-udevd Mar 20 07:03:03 s1lp14 kernel: [345362.200460] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:03:03 s1lp14 kernel: [345362.200461] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:03:03 s1lp14 kernel: [345362.200462] [ 1078] 100 1078 20782 566 100352 160 0 systemd-timesyn Mar 20 07:03:03 s1lp14 kernel: [345362.200463] [ 1132] 102 1132 2482 461 98304 196 0 systemd-resolve Mar 20 07:03:03 s1lp14 kernel: [345362.200464] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:03:03 s1lp14 kernel: [345362.200465] [ 1226] 0 1226 1547 414 79872 61 0 cron Mar 20 07:03:03 s1lp14 kernel: [345362.200466] [ 1229] 0 1229 2444 556 98304 191 0 systemd-logind Mar 20 07:03:03 s1lp14 kernel: [345362.200467] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:03:03 s1lp14 kernel: [345362.200468] [ 1255] 0 1255 58495 473 131072 215 0 accounts-daemon Mar 20 07:03:03 s1lp14 kernel: [345362.200469] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:03:03 s1lp14 kernel: [345362.200470] [ 1259] 0 1259 20060 495 83968 58 0 irqbalance Mar 20 07:03:03 s1lp14 kernel: [345362.200471] [ 1265] 0 1265 2673 1175 83968 310 0 pkcsslotd Mar 20 07:03:03 s1lp14 kernel: [345362.200472] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:03:03 s1lp14 kernel: [345362.200473] [ 1433] 0 1433 1125 455 73728 41 0 iscsid Mar 20 07:03:03 s1lp14 kernel: [345362.200474] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:03:03 s1lp14 kernel: [345362.200474] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:03:03 s1lp14 kernel: [345362.200476] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:03:03 s1lp14 kernel: [345362.200476] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:03:03 s1lp14 kernel: [345362.200478] [ 7772] 101 7772 2793 486 100352 221 0 systemd-network Mar 20 07:03:03 s1lp14 kernel: [345362.200479] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:03:03 s1lp14 kernel: [345362.200479] [66598] 0 66598 394264 611 253952 1677 -900 snapd Mar 20 07:03:03 s1lp14 kernel: [345362.200480] [113723] 0 113723 2359 459 88064 118 0 wpa_supplicant Mar 20 07:03:03 s1lp14 kernel: [345362.200481] [116349] 0 116349 8972 419 83968 112 0 master Mar 20 07:03:03 s1lp14 kernel: [345362.200482] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:03:03 s1lp14 kernel: [345362.200483] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:03:03 s1lp14 kernel: [345362.200484] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:03:03 s1lp14 kernel: [345362.200485] [117440] 103 117440 54882 178 98304 143 0 rsyslogd Mar 20 07:03:03 s1lp14 kernel: [345362.200486] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:03:03 s1lp14 kernel: [345362.200486] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:03:03 s1lp14 kernel: [345362.200487] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:03:03 s1lp14 kernel: [345362.200488] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:03:03 s1lp14 kernel: [345362.200489] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:03:03 s1lp14 kernel: [345362.200490] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:03:03 s1lp14 kernel: [345362.200491] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:03:03 s1lp14 kernel: [345362.200492] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:03:03 s1lp14 kernel: [345362.200493] [70732] 111 70732 9042 368 88064 116 0 pickup Mar 20 07:03:03 s1lp14 kernel: [345362.200494] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:03:03 s1lp14 kernel: [345362.200495] [190296] 0 190296 3262 431 104448 65 -1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200496] [190297] 0 190297 3262 274 102400 61 -1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200496] [190298] 0 190298 3262 314 102400 51 -1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200497] [190299] 0 190299 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200498] [190300] 0 190300 3262 262 102400 56 -1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200499] [190302] 0 190302 3262 312 102400 53 -1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200500] [190304] 0 190304 3262 244 102400 61 -1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200501] [190307] 0 190307 3262 215 102400 59 -1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200502] [190308] 0 190308 3262 256 102400 77 -1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200503] [190460] 0 190460 1344751 1203767 10883072 137819 1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200504] [190469] 0 190469 1019286 1016112 8263680 51 1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200505] [190471] 0 190471 606387 603211 4943872 50 1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200506] [190476] 0 190476 552631 549408 4513792 51 1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200507] [190478] 0 190478 490845 487613 4020224 51 1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200508] [190482] 0 190482 708305 705073 5758976 51 1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200509] [190487] 0 190487 344205 340981 2846720 51 1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200510] [190488] 0 190488 8401 5222 143360 50 1000 stress-ng Mar 20 07:03:03 s1lp14 kernel: [345362.200510] Out of memory: Kill process 190460 (stress-ng) score 1247 or sacrifice child Mar 20 07:03:03 s1lp14 kernel: [345362.200517] Killed process 190460 (stress-ng) total-vm:5379004kB, anon-rss:4814996kB, file-rss:68kB, shmem-rss:4kB Mar 20 07:03:04 s1lp14 stress-ng: memory (MB): total 19923.80, free 124.48, shared 1.85, buffer 0.38, swap 625.40, free swap 359.54 Mar 20 07:03:04 s1lp14 kernel: [345363.293960] oom_reaper: reaped process 190460 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:03:15 s1lp14 kernel: [345374.262935] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:03:15 s1lp14 kernel: [345374.262936] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:03:15 s1lp14 kernel: [345374.262943] CPU: 5 PID: 190489 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:03:15 s1lp14 kernel: [345374.262944] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:03:15 s1lp14 kernel: [345374.262945] Call Trace: Mar 20 07:03:15 s1lp14 kernel: [345374.262954] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:03:15 s1lp14 kernel: [345374.262959] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:03:15 s1lp14 kernel: [345374.262963] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:03:15 s1lp14 kernel: [345374.262965] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:03:15 s1lp14 kernel: [345374.262966] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:03:15 s1lp14 kernel: [345374.262969] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:03:15 s1lp14 kernel: [345374.262971] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:03:15 s1lp14 kernel: [345374.262975] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:03:15 s1lp14 kernel: [345374.262977] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:03:15 s1lp14 kernel: [345374.262979] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:03:15 s1lp14 kernel: [345374.262982] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:03:15 s1lp14 kernel: [345374.262985] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:03:15 s1lp14 kernel: [345374.262986] Mem-Info: Mar 20 07:03:15 s1lp14 kernel: [345374.262991] active_anon:4562154 inactive_anon:351800 isolated_anon:159 Mar 20 07:03:15 s1lp14 kernel: [345374.262991] active_file:231 inactive_file:293 isolated_file:0 Mar 20 07:03:15 s1lp14 kernel: [345374.262991] unevictable:7099 dirty:0 writeback:936 unstable:0 Mar 20 07:03:15 s1lp14 kernel: [345374.262991] slab_reclaimable:17286 slab_unreclaimable:40930 Mar 20 07:03:15 s1lp14 kernel: [345374.262991] mapped:2914 shmem:764 pagetables:21123 bounce:0 Mar 20 07:03:15 s1lp14 kernel: [345374.262991] free:23456 free_pcp:253 free_cma:0 Mar 20 07:03:15 s1lp14 kernel: [345374.262996] Node 0 active_anon:18248616kB inactive_anon:1407200kB active_file:924kB inactive_file:1172kB unevictable:28396kB isolated(anon):636kB isolated(file):0kB mapped:11656kB dirty:0kB writeback:3744kB shmem:3056kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:03:15 s1lp14 kernel: [345374.262998] Node 0 DMA free:73696kB min:2280kB low:4344kB high:6408kB active_anon:1833732kB inactive_anon:162316kB active_file:40kB inactive_file:132kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:96kB pagetables:8320kB bounce:0kB free_pcp:152kB local_pcp:0kB free_cma:0kB Mar 20 07:03:15 s1lp14 kernel: [345374.263002] lowmem_reserve[]: 0 17889 17889 Mar 20 07:03:15 s1lp14 kernel: [345374.263004] Node 0 Normal free:20128kB min:20244kB low:38560kB high:56876kB active_anon:16414868kB inactive_anon:1244300kB active_file:884kB inactive_file:1040kB unevictable:28396kB writepending:3328kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7952kB pagetables:76172kB bounce:0kB free_pcp:864kB local_pcp:132kB free_cma:0kB Mar 20 07:03:15 s1lp14 kernel: [345374.263008] lowmem_reserve[]: 0 0 0 Mar 20 07:03:15 s1lp14 kernel: [345374.263011] Node 0 DMA: 166*4kB (UM) 135*8kB (UME) 47*16kB (UM) 19*32kB (UME) 25*64kB (UM) 9*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73696kB Mar 20 07:03:15 s1lp14 kernel: [345374.263023] Node 0 Normal: 451*4kB (U) 864*8kB (UME) 289*16kB (UME) 211*32kB (UM) 1*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 20156kB Mar 20 07:03:15 s1lp14 kernel: [345374.263034] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:03:15 s1lp14 kernel: [345374.263035] 10468 total pagecache pages Mar 20 07:03:15 s1lp14 kernel: [345374.263036] 7497 pages in swap cache Mar 20 07:03:15 s1lp14 kernel: [345374.263037] Swap cache stats: add 3611299, delete 3603640, find 18634/29731 Mar 20 07:03:15 s1lp14 kernel: [345374.263038] Free swap = 0kB Mar 20 07:03:15 s1lp14 kernel: [345374.263038] Total swap = 640412kB Mar 20 07:03:15 s1lp14 kernel: [345374.263039] 5242880 pages RAM Mar 20 07:03:15 s1lp14 kernel: [345374.263040] 0 pages HighMem/MovableOnly Mar 20 07:03:15 s1lp14 kernel: [345374.263040] 142387 pages reserved Mar 20 07:03:15 s1lp14 kernel: [345374.263041] 0 pages cma reserved Mar 20 07:03:15 s1lp14 kernel: [345374.263042] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:03:15 s1lp14 kernel: [345374.263045] [ 551] 0 551 12750 530 135168 266 0 systemd-journal Mar 20 07:03:15 s1lp14 kernel: [345374.263047] [ 635] 0 635 3774 462 86016 574 -1000 systemd-udevd Mar 20 07:03:15 s1lp14 kernel: [345374.263050] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:03:15 s1lp14 kernel: [345374.263051] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:03:15 s1lp14 kernel: [345374.263054] [ 1078] 100 1078 20782 566 100352 166 0 systemd-timesyn Mar 20 07:03:15 s1lp14 kernel: [345374.263056] [ 1132] 102 1132 2482 461 98304 201 0 systemd-resolve Mar 20 07:03:15 s1lp14 kernel: [345374.263057] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:03:15 s1lp14 kernel: [345374.263059] [ 1226] 0 1226 1547 405 79872 79 0 cron Mar 20 07:03:15 s1lp14 kernel: [345374.263061] [ 1229] 0 1229 2444 550 98304 200 0 systemd-logind Mar 20 07:03:15 s1lp14 kernel: [345374.263063] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:03:15 s1lp14 kernel: [345374.263064] [ 1255] 0 1255 58495 621 131072 220 0 accounts-daemon Mar 20 07:03:15 s1lp14 kernel: [345374.263066] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:03:15 s1lp14 kernel: [345374.263068] [ 1259] 0 1259 20060 534 83968 59 0 irqbalance Mar 20 07:03:15 s1lp14 kernel: [345374.263069] [ 1265] 0 1265 2673 987 83968 310 0 pkcsslotd Mar 20 07:03:15 s1lp14 kernel: [345374.263071] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:03:15 s1lp14 kernel: [345374.263073] [ 1433] 0 1433 1125 452 73728 44 0 iscsid Mar 20 07:03:15 s1lp14 kernel: [345374.263075] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:03:15 s1lp14 kernel: [345374.263076] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:03:15 s1lp14 kernel: [345374.263078] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:03:15 s1lp14 kernel: [345374.263080] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:03:15 s1lp14 kernel: [345374.263082] [ 7772] 101 7772 2793 486 100352 221 0 systemd-network Mar 20 07:03:15 s1lp14 kernel: [345374.263084] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:03:15 s1lp14 kernel: [345374.263086] [66598] 0 66598 394264 72 253952 2410 -900 snapd Mar 20 07:03:15 s1lp14 kernel: [345374.263088] [113723] 0 113723 2359 442 88064 133 0 wpa_supplicant Mar 20 07:03:15 s1lp14 kernel: [345374.263089] [116349] 0 116349 8972 404 83968 135 0 master Mar 20 07:03:15 s1lp14 kernel: [345374.263091] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:03:15 s1lp14 kernel: [345374.263092] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:03:15 s1lp14 kernel: [345374.263094] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:03:15 s1lp14 kernel: [345374.263096] [117440] 103 117440 54882 674 98304 169 0 rsyslogd Mar 20 07:03:15 s1lp14 kernel: [345374.263098] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:03:15 s1lp14 kernel: [345374.263100] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:03:15 s1lp14 kernel: [345374.263102] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:03:15 s1lp14 kernel: [345374.263104] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:03:15 s1lp14 kernel: [345374.263106] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:03:15 s1lp14 kernel: [345374.263107] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:03:15 s1lp14 kernel: [345374.263109] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:03:15 s1lp14 kernel: [345374.263111] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:03:15 s1lp14 kernel: [345374.263113] [70732] 111 70732 9042 360 88064 137 0 pickup Mar 20 07:03:15 s1lp14 kernel: [345374.263115] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:03:15 s1lp14 kernel: [345374.263117] [190296] 0 190296 3262 370 104448 65 -1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263118] [190297] 0 190297 3262 270 102400 65 -1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263120] [190298] 0 190298 3262 314 102400 51 -1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263122] [190299] 0 190299 3262 301 102400 64 -1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263124] [190300] 0 190300 3262 250 102400 68 -1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263126] [190302] 0 190302 3262 300 102400 65 -1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263128] [190304] 0 190304 3262 244 102400 61 -1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263130] [190307] 0 190307 3262 205 102400 69 -1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263132] [190308] 0 190308 3262 324 102400 54 -1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263134] [190469] 0 190469 1144871 1005105 9269248 136645 1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263136] [190471] 0 190471 1005927 1002748 8157184 59 1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263138] [190476] 0 190476 649758 646578 5292032 62 1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263139] [190478] 0 190478 623023 619845 5076992 62 1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263141] [190482] 0 190482 905197 902016 7350272 61 1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263143] [190487] 0 190487 563978 560810 4605952 52 1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263145] [190488] 0 190488 140868 137697 1204224 50 1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263147] [190489] 0 190489 34368 31199 352256 51 1000 stress-ng Mar 20 07:03:15 s1lp14 kernel: [345374.263148] Out of memory: Kill process 190469 (stress-ng) score 1210 or sacrifice child Mar 20 07:03:15 s1lp14 kernel: [345374.263156] Killed process 190469 (stress-ng) total-vm:4579484kB, anon-rss:4020152kB, file-rss:264kB, shmem-rss:4kB Mar 20 07:03:16 s1lp14 kernel: [345375.223338] oom_reaper: reaped process 190469 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:03:26 s1lp14 stress-ng: memory (MB): total 19923.80, free 138.59, shared 3.95, buffer 0.36, swap 625.40, free swap 502.02 Mar 20 07:03:29 s1lp14 kernel: [345388.309149] pkcsslotd invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:03:29 s1lp14 kernel: [345388.309150] pkcsslotd cpuset=/ mems_allowed=0 Mar 20 07:03:29 s1lp14 kernel: [345388.309156] CPU: 3 PID: 1265 Comm: pkcsslotd Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:03:29 s1lp14 kernel: [345388.309157] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:03:29 s1lp14 kernel: [345388.309158] Call Trace: Mar 20 07:03:29 s1lp14 kernel: [345388.309166] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:03:29 s1lp14 kernel: [345388.309171] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:03:29 s1lp14 kernel: [345388.309175] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:03:29 s1lp14 kernel: [345388.309177] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:03:29 s1lp14 kernel: [345388.309178] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:03:29 s1lp14 kernel: [345388.309181] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:03:29 s1lp14 kernel: [345388.309185] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:03:29 s1lp14 kernel: [345388.309187] [<0000000000325bd8>] __read_swap_cache_async+0x180/0x270 Mar 20 07:03:29 s1lp14 kernel: [345388.309189] [<0000000000325eac>] swapin_readahead+0x184/0x290 Mar 20 07:03:29 s1lp14 kernel: [345388.309193] [<00000000002e5932>] shmem_swapin+0x72/0xb8 Mar 20 07:03:29 s1lp14 kernel: [345388.309195] [<00000000002e74ca>] shmem_getpage_gfp+0x682/0xeb0 Mar 20 07:03:29 s1lp14 kernel: [345388.309196] [<00000000002e7fca>] shmem_fault+0x9a/0x230 Mar 20 07:03:29 s1lp14 kernel: [345388.309200] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:03:29 s1lp14 kernel: [345388.309202] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:03:29 s1lp14 kernel: [345388.309203] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:03:29 s1lp14 kernel: [345388.309207] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:03:29 s1lp14 kernel: [345388.309210] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:03:29 s1lp14 kernel: [345388.309211] Mem-Info: Mar 20 07:03:29 s1lp14 kernel: [345388.309215] active_anon:4562489 inactive_anon:351346 isolated_anon:128 Mar 20 07:03:29 s1lp14 kernel: [345388.309215] active_file:187 inactive_file:94 isolated_file:0 Mar 20 07:03:29 s1lp14 kernel: [345388.309215] unevictable:7099 dirty:12 writeback:203 unstable:0 Mar 20 07:03:29 s1lp14 kernel: [345388.309215] slab_reclaimable:17286 slab_unreclaimable:40926 Mar 20 07:03:29 s1lp14 kernel: [345388.309215] mapped:2163 shmem:76 pagetables:21106 bounce:0 Mar 20 07:03:29 s1lp14 kernel: [345388.309215] free:23491 free_pcp:194 free_cma:0 Mar 20 07:03:29 s1lp14 kernel: [345388.309219] Node 0 active_anon:18249956kB inactive_anon:1405384kB active_file:748kB inactive_file:376kB unevictable:28396kB isolated(anon):512kB isolated(file):0kB mapped:8652kB dirty:48kB writeback:812kB shmem:304kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:03:29 s1lp14 kernel: [345388.309220] Node 0 DMA free:73836kB min:2280kB low:4344kB high:6408kB active_anon:1833792kB inactive_anon:161992kB active_file:20kB inactive_file:228kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:96kB pagetables:8208kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:03:29 s1lp14 kernel: [345388.309224] lowmem_reserve[]: 0 17889 17889 Mar 20 07:03:29 s1lp14 kernel: [345388.309227] Node 0 Normal free:20128kB min:20244kB low:38560kB high:56876kB active_anon:16416848kB inactive_anon:1243764kB active_file:600kB inactive_file:580kB unevictable:28396kB writepending:1276kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7936kB pagetables:76216kB bounce:0kB free_pcp:776kB local_pcp:200kB free_cma:0kB Mar 20 07:03:29 s1lp14 kernel: [345388.309231] lowmem_reserve[]: 0 0 0 Mar 20 07:03:29 s1lp14 kernel: [345388.309234] Node 0 DMA: 237*4kB (UM) 128*8kB (UME) 47*16kB (UM) 24*32kB (UME) 25*64kB (UM) 9*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74084kB Mar 20 07:03:29 s1lp14 kernel: [345388.309244] Node 0 Normal: 701*4kB (UME) 565*8kB (UME) 278*16kB (UME) 297*32kB (UM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB = 21276kB Mar 20 07:03:29 s1lp14 kernel: [345388.309253] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:03:29 s1lp14 kernel: [345388.309254] 13089 total pagecache pages Mar 20 07:03:29 s1lp14 kernel: [345388.309255] 10869 pages in swap cache Mar 20 07:03:29 s1lp14 kernel: [345388.309256] Swap cache stats: add 3748690, delete 3737658, find 18845/30200 Mar 20 07:03:29 s1lp14 kernel: [345388.309257] Free swap = 0kB Mar 20 07:03:29 s1lp14 kernel: [345388.309257] Total swap = 640412kB Mar 20 07:03:29 s1lp14 kernel: [345388.309258] 5242880 pages RAM Mar 20 07:03:29 s1lp14 kernel: [345388.309258] 0 pages HighMem/MovableOnly Mar 20 07:03:29 s1lp14 kernel: [345388.309259] 142387 pages reserved Mar 20 07:03:29 s1lp14 kernel: [345388.309259] 0 pages cma reserved Mar 20 07:03:29 s1lp14 kernel: [345388.309260] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:03:29 s1lp14 kernel: [345388.309263] [ 551] 0 551 12750 550 135168 275 0 systemd-journal Mar 20 07:03:29 s1lp14 kernel: [345388.309265] [ 635] 0 635 3774 462 86016 574 -1000 systemd-udevd Mar 20 07:03:29 s1lp14 kernel: [345388.309267] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:03:29 s1lp14 kernel: [345388.309269] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:03:29 s1lp14 kernel: [345388.309271] [ 1078] 100 1078 20782 566 100352 166 0 systemd-timesyn Mar 20 07:03:29 s1lp14 kernel: [345388.309272] [ 1132] 102 1132 2482 461 98304 201 0 systemd-resolve Mar 20 07:03:29 s1lp14 kernel: [345388.309274] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:03:29 s1lp14 kernel: [345388.309275] [ 1226] 0 1226 1547 405 79872 83 0 cron Mar 20 07:03:29 s1lp14 kernel: [345388.309277] [ 1229] 0 1229 2444 550 98304 200 0 systemd-logind Mar 20 07:03:29 s1lp14 kernel: [345388.309278] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:03:29 s1lp14 kernel: [345388.309280] [ 1255] 0 1255 58495 583 131072 219 0 accounts-daemon Mar 20 07:03:29 s1lp14 kernel: [345388.309282] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:03:29 s1lp14 kernel: [345388.309283] [ 1259] 0 1259 20060 403 83968 61 0 irqbalance Mar 20 07:03:29 s1lp14 kernel: [345388.309285] [ 1265] 0 1265 2673 239 83968 310 0 pkcsslotd Mar 20 07:03:29 s1lp14 kernel: [345388.309286] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:03:29 s1lp14 kernel: [345388.309288] [ 1433] 0 1433 1125 452 73728 44 0 iscsid Mar 20 07:03:29 s1lp14 kernel: [345388.309289] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:03:29 s1lp14 kernel: [345388.309291] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:03:29 s1lp14 kernel: [345388.309293] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:03:29 s1lp14 kernel: [345388.309294] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:03:29 s1lp14 kernel: [345388.309296] [ 7772] 101 7772 2793 537 100352 203 0 systemd-network Mar 20 07:03:29 s1lp14 kernel: [345388.309298] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:03:29 s1lp14 kernel: [345388.309299] [66598] 0 66598 394264 77 253952 2491 -900 snapd Mar 20 07:03:29 s1lp14 kernel: [345388.309301] [113723] 0 113723 2359 426 88064 120 0 wpa_supplicant Mar 20 07:03:29 s1lp14 kernel: [345388.309303] [116349] 0 116349 8972 404 83968 135 0 master Mar 20 07:03:29 s1lp14 kernel: [345388.309304] [116354] 111 116354 9056 420 92160 132 0 qmgr Mar 20 07:03:29 s1lp14 kernel: [345388.309306] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:03:29 s1lp14 kernel: [345388.309307] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:03:29 s1lp14 kernel: [345388.309309] [117440] 103 117440 54882 508 98304 164 0 rsyslogd Mar 20 07:03:29 s1lp14 kernel: [345388.309311] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:03:29 s1lp14 kernel: [345388.309312] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:03:29 s1lp14 kernel: [345388.309314] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:03:29 s1lp14 kernel: [345388.309316] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:03:29 s1lp14 kernel: [345388.309317] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:03:29 s1lp14 kernel: [345388.309319] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:03:29 s1lp14 kernel: [345388.309321] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:03:29 s1lp14 kernel: [345388.309322] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:03:29 s1lp14 kernel: [345388.309324] [70732] 111 70732 9042 360 88064 137 0 pickup Mar 20 07:03:29 s1lp14 kernel: [345388.309326] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:03:29 s1lp14 kernel: [345388.309327] [190296] 0 190296 3262 304 104448 65 -1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309329] [190297] 0 190297 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309331] [190298] 0 190298 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309333] [190299] 0 190299 3262 300 102400 65 -1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309334] [190300] 0 190300 3262 249 102400 69 -1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309336] [190302] 0 190302 3262 299 102400 66 -1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309338] [190304] 0 190304 3262 243 102400 62 -1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309340] [190307] 0 190307 3262 200 102400 74 -1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309341] [190308] 0 190308 3262 310 102400 55 -1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309343] [190471] 0 190471 1229385 1090371 9945088 135883 1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309345] [190476] 0 190476 743439 740252 6041600 62 1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309347] [190478] 0 190478 698910 695725 5685248 62 1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309349] [190482] 0 190482 1051815 1048631 8523776 61 1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309350] [190487] 0 190487 707952 704772 5756928 52 1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309352] [190488] 0 190488 256246 253069 2125824 52 1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309354] [190489] 0 190489 352879 349705 2916352 51 1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309356] [190493] 0 190493 23848 20670 268288 51 1000 stress-ng Mar 20 07:03:29 s1lp14 kernel: [345388.309357] Out of memory: Kill process 190471 (stress-ng) score 1226 or sacrifice child Mar 20 07:03:29 s1lp14 kernel: [345388.309364] Killed process 190471 (stress-ng) total-vm:4917540kB, anon-rss:4361272kB, file-rss:208kB, shmem-rss:4kB Mar 20 07:03:30 s1lp14 kernel: [345389.344622] oom_reaper: reaped process 190471 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:03:30 s1lp14 stress-ng: memory (MB): total 19923.80, free 492.44, shared 3.40, buffer 0.34, swap 625.40, free swap 391.01 Mar 20 07:03:44 s1lp14 kernel: [345403.431141] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:03:44 s1lp14 kernel: [345403.431143] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:03:44 s1lp14 kernel: [345403.431149] CPU: 4 PID: 190488 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:03:44 s1lp14 kernel: [345403.431149] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:03:44 s1lp14 kernel: [345403.431150] Call Trace: Mar 20 07:03:44 s1lp14 kernel: [345403.431160] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:03:44 s1lp14 kernel: [345403.431165] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:03:44 s1lp14 kernel: [345403.431169] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:03:44 s1lp14 kernel: [345403.431171] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:03:44 s1lp14 kernel: [345403.431172] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:03:44 s1lp14 kernel: [345403.431175] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:03:44 s1lp14 kernel: [345403.431178] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:03:44 s1lp14 kernel: [345403.431182] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:03:44 s1lp14 kernel: [345403.431184] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:03:44 s1lp14 kernel: [345403.431185] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:03:44 s1lp14 kernel: [345403.431189] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:03:44 s1lp14 kernel: [345403.431192] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:03:44 s1lp14 kernel: [345403.431193] Mem-Info: Mar 20 07:03:44 s1lp14 kernel: [345403.431198] active_anon:4562076 inactive_anon:351846 isolated_anon:32 Mar 20 07:03:44 s1lp14 kernel: [345403.431198] active_file:65 inactive_file:169 isolated_file:0 Mar 20 07:03:44 s1lp14 kernel: [345403.431198] unevictable:7099 dirty:0 writeback:203 unstable:0 Mar 20 07:03:44 s1lp14 kernel: [345403.431198] slab_reclaimable:17303 slab_unreclaimable:40861 Mar 20 07:03:44 s1lp14 kernel: [345403.431198] mapped:2977 shmem:1012 pagetables:21091 bounce:0 Mar 20 07:03:44 s1lp14 kernel: [345403.431198] free:23608 free_pcp:177 free_cma:0 Mar 20 07:03:44 s1lp14 kernel: [345403.431202] Node 0 active_anon:18248304kB inactive_anon:1407384kB active_file:260kB inactive_file:676kB unevictable:28396kB isolated(anon):128kB isolated(file):0kB mapped:11908kB dirty:0kB writeback:812kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:03:44 s1lp14 kernel: [345403.431203] Node 0 DMA free:73784kB min:2280kB low:4344kB high:6408kB active_anon:1911376kB inactive_anon:84460kB active_file:12kB inactive_file:12kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:96kB pagetables:8320kB bounce:0kB free_pcp:96kB local_pcp:0kB free_cma:0kB Mar 20 07:03:44 s1lp14 kernel: [345403.431208] lowmem_reserve[]: 0 17889 17889 Mar 20 07:03:44 s1lp14 kernel: [345403.431210] Node 0 Normal free:20648kB min:20244kB low:38560kB high:56876kB active_anon:16336764kB inactive_anon:1323296kB active_file:248kB inactive_file:952kB unevictable:28396kB writepending:1396kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7936kB pagetables:76044kB bounce:0kB free_pcp:612kB local_pcp:0kB free_cma:0kB Mar 20 07:03:44 s1lp14 kernel: [345403.431216] lowmem_reserve[]: 0 0 0 Mar 20 07:03:44 s1lp14 kernel: [345403.431218] Node 0 DMA: 121*4kB (UM) 115*8kB (UME) 62*16kB (UM) 18*32kB (UM) 28*64kB (UM) 9*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73756kB Mar 20 07:03:44 s1lp14 kernel: [345403.431229] Node 0 Normal: 648*4kB (UME) 686*8kB (UME) 302*16kB (UME) 223*32kB (UME) 2*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 20176kB Mar 20 07:03:44 s1lp14 kernel: [345403.431240] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:03:44 s1lp14 kernel: [345403.431241] 19975 total pagecache pages Mar 20 07:03:44 s1lp14 kernel: [345403.431242] 16788 pages in swap cache Mar 20 07:03:44 s1lp14 kernel: [345403.431243] Swap cache stats: add 3908620, delete 3891651, find 20290/32170 Mar 20 07:03:44 s1lp14 kernel: [345403.431244] Free swap = 0kB Mar 20 07:03:44 s1lp14 kernel: [345403.431244] Total swap = 640412kB Mar 20 07:03:44 s1lp14 kernel: [345403.431245] 5242880 pages RAM Mar 20 07:03:44 s1lp14 kernel: [345403.431246] 0 pages HighMem/MovableOnly Mar 20 07:03:44 s1lp14 kernel: [345403.431246] 142387 pages reserved Mar 20 07:03:44 s1lp14 kernel: [345403.431247] 0 pages cma reserved Mar 20 07:03:44 s1lp14 kernel: [345403.431248] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:03:44 s1lp14 kernel: [345403.431251] [ 551] 0 551 12750 592 135168 279 0 systemd-journal Mar 20 07:03:44 s1lp14 kernel: [345403.431254] [ 635] 0 635 3774 462 86016 574 -1000 systemd-udevd Mar 20 07:03:44 s1lp14 kernel: [345403.431256] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:03:44 s1lp14 kernel: [345403.431258] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:03:44 s1lp14 kernel: [345403.431260] [ 1078] 100 1078 20782 566 100352 166 0 systemd-timesyn Mar 20 07:03:44 s1lp14 kernel: [345403.431261] [ 1132] 102 1132 2482 461 98304 201 0 systemd-resolve Mar 20 07:03:44 s1lp14 kernel: [345403.431263] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:03:44 s1lp14 kernel: [345403.431265] [ 1226] 0 1226 1547 405 79872 83 0 cron Mar 20 07:03:44 s1lp14 kernel: [345403.431267] [ 1229] 0 1229 2444 550 98304 200 0 systemd-logind Mar 20 07:03:44 s1lp14 kernel: [345403.431268] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:03:44 s1lp14 kernel: [345403.431270] [ 1255] 0 1255 58495 505 131072 221 0 accounts-daemon Mar 20 07:03:44 s1lp14 kernel: [345403.431271] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:03:44 s1lp14 kernel: [345403.431273] [ 1259] 0 1259 20060 441 83968 78 0 irqbalance Mar 20 07:03:44 s1lp14 kernel: [345403.431275] [ 1265] 0 1265 2673 1226 83968 308 0 pkcsslotd Mar 20 07:03:44 s1lp14 kernel: [345403.431276] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:03:44 s1lp14 kernel: [345403.431278] [ 1433] 0 1433 1125 448 73728 48 0 iscsid Mar 20 07:03:44 s1lp14 kernel: [345403.431280] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:03:44 s1lp14 kernel: [345403.431282] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:03:44 s1lp14 kernel: [345403.431285] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:03:44 s1lp14 kernel: [345403.431287] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:03:44 s1lp14 kernel: [345403.431288] [ 7772] 101 7772 2793 601 100352 193 0 systemd-network Mar 20 07:03:44 s1lp14 kernel: [345403.431290] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:03:44 s1lp14 kernel: [345403.431292] [66598] 0 66598 394264 48 253952 2285 -900 snapd Mar 20 07:03:44 s1lp14 kernel: [345403.431294] [113723] 0 113723 2359 520 88064 118 0 wpa_supplicant Mar 20 07:03:44 s1lp14 kernel: [345403.431295] [116349] 0 116349 8972 352 83968 117 0 master Mar 20 07:03:44 s1lp14 kernel: [345403.431297] [116354] 111 116354 9056 391 92160 110 0 qmgr Mar 20 07:03:44 s1lp14 kernel: [345403.431299] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:03:44 s1lp14 kernel: [345403.431302] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:03:44 s1lp14 kernel: [345403.431303] [117440] 103 117440 54882 682 98304 164 0 rsyslogd Mar 20 07:03:44 s1lp14 kernel: [345403.431305] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:03:44 s1lp14 kernel: [345403.431307] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:03:44 s1lp14 kernel: [345403.431310] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:03:44 s1lp14 kernel: [345403.431311] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:03:44 s1lp14 kernel: [345403.431313] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:03:44 s1lp14 kernel: [345403.431315] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:03:44 s1lp14 kernel: [345403.431317] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:03:44 s1lp14 kernel: [345403.431318] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:03:44 s1lp14 kernel: [345403.431320] [70732] 111 70732 9042 347 88064 120 0 pickup Mar 20 07:03:44 s1lp14 kernel: [345403.431322] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:03:44 s1lp14 kernel: [345403.431323] [190296] 0 190296 3262 417 104448 65 -1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431325] [190297] 0 190297 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431327] [190298] 0 190298 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431328] [190299] 0 190299 3262 297 102400 68 -1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431329] [190300] 0 190300 3262 249 102400 69 -1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431331] [190302] 0 190302 3262 296 102400 69 -1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431332] [190304] 0 190304 3262 243 102400 62 -1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431333] [190307] 0 190307 3262 270 102400 64 -1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431334] [190308] 0 190308 3262 310 102400 55 -1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431335] [190476] 0 190476 845600 718811 6875136 123660 1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431336] [190478] 0 190478 800789 784093 6500352 13572 1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431338] [190482] 0 190482 1097221 1094063 8888320 61 1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431341] [190487] 0 190487 953481 950293 7737344 52 1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431342] [190488] 0 190488 372045 368890 3069952 52 1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431343] [190489] 0 190489 713302 710146 5799936 51 1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431344] [190493] 0 190493 241891 238733 2011136 51 1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431345] [190495] 0 190495 34524 31376 352256 50 1000 stress-ng Mar 20 07:03:44 s1lp14 kernel: [345403.431346] Out of memory: Kill process 190482 (stress-ng) score 1202 or sacrifice child Mar 20 07:03:44 s1lp14 kernel: [345403.431352] Killed process 190482 (stress-ng) total-vm:4388884kB, anon-rss:4375892kB, file-rss:356kB, shmem-rss:4kB Mar 20 07:03:45 s1lp14 kernel: [345404.586635] oom_reaper: reaped process 190482 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:03:45 s1lp14 stress-ng: memory (MB): total 19923.80, free 313.67, shared 3.95, buffer 0.34, swap 625.40, free swap 0.02 Mar 20 07:03:45 s1lp14 kernel: [345404.688407] systemd-journal invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:03:45 s1lp14 kernel: [345404.688409] systemd-journal cpuset=/ mems_allowed=0 Mar 20 07:03:45 s1lp14 kernel: [345404.688415] CPU: 3 PID: 551 Comm: systemd-journal Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:03:45 s1lp14 kernel: [345404.688416] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:03:45 s1lp14 kernel: [345404.688417] Call Trace: Mar 20 07:03:45 s1lp14 kernel: [345404.688426] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:03:45 s1lp14 kernel: [345404.688431] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:03:45 s1lp14 kernel: [345404.688435] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:03:45 s1lp14 kernel: [345404.688437] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:03:45 s1lp14 kernel: [345404.688438] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:03:45 s1lp14 kernel: [345404.688441] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:03:45 s1lp14 kernel: [345404.688443] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:03:45 s1lp14 kernel: [345404.688447] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:03:45 s1lp14 kernel: [345404.688452] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:03:45 s1lp14 kernel: [345404.688455] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:03:45 s1lp14 kernel: [345404.688456] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:03:45 s1lp14 kernel: [345404.688460] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:03:45 s1lp14 kernel: [345404.688463] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:03:45 s1lp14 kernel: [345404.688464] Mem-Info: Mar 20 07:03:45 s1lp14 kernel: [345404.688469] active_anon:4630957 inactive_anon:282980 isolated_anon:160 Mar 20 07:03:45 s1lp14 kernel: [345404.688469] active_file:128 inactive_file:0 isolated_file:0 Mar 20 07:03:45 s1lp14 kernel: [345404.688469] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 07:03:45 s1lp14 kernel: [345404.688469] slab_reclaimable:17311 slab_unreclaimable:40893 Mar 20 07:03:45 s1lp14 kernel: [345404.688469] mapped:3062 shmem:1012 pagetables:20897 bounce:0 Mar 20 07:03:45 s1lp14 kernel: [345404.688469] free:23397 free_pcp:0 free_cma:0 Mar 20 07:03:45 s1lp14 kernel: [345404.688473] Node 0 active_anon:18523828kB inactive_anon:1131920kB active_file:512kB inactive_file:0kB unevictable:28396kB isolated(anon):640kB isolated(file):0kB mapped:12248kB dirty:0kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:03:45 s1lp14 kernel: [345404.688474] Node 0 DMA free:73740kB min:2280kB low:4344kB high:6408kB active_anon:1916512kB inactive_anon:78412kB active_file:56kB inactive_file:952kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:7908kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:03:45 s1lp14 kernel: [345404.688479] lowmem_reserve[]: 0 17889 17889 Mar 20 07:03:45 s1lp14 kernel: [345404.688483] Node 0 Normal free:19848kB min:20244kB low:38560kB high:56876kB active_anon:16607672kB inactive_anon:1052668kB active_file:1044kB inactive_file:576kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7936kB pagetables:75680kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:03:45 s1lp14 kernel: [345404.688487] lowmem_reserve[]: 0 0 0 Mar 20 07:03:45 s1lp14 kernel: [345404.688490] Node 0 DMA: 168*4kB (UM) 113*8kB (UE) 43*16kB (U) 40*32kB (UM) 28*64kB (UM) 9*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74328kB Mar 20 07:03:45 s1lp14 kernel: [345404.688500] Node 0 Normal: 744*4kB (UME) 467*8kB (UME) 244*16kB (UME) 314*32kB (UME) 3*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 20856kB Mar 20 07:03:45 s1lp14 kernel: [345404.688510] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:03:45 s1lp14 kernel: [345404.688511] 19675 total pagecache pages Mar 20 07:03:45 s1lp14 kernel: [345404.688513] 16461 pages in swap cache Mar 20 07:03:45 s1lp14 kernel: [345404.688513] Swap cache stats: add 3908734, delete 3892092, find 20344/32259 Mar 20 07:03:45 s1lp14 kernel: [345404.688514] Free swap = 0kB Mar 20 07:03:45 s1lp14 kernel: [345404.688514] Total swap = 640412kB Mar 20 07:03:45 s1lp14 kernel: [345404.688515] 5242880 pages RAM Mar 20 07:03:45 s1lp14 kernel: [345404.688516] 0 pages HighMem/MovableOnly Mar 20 07:03:45 s1lp14 kernel: [345404.688516] 142387 pages reserved Mar 20 07:03:45 s1lp14 kernel: [345404.688517] 0 pages cma reserved Mar 20 07:03:45 s1lp14 kernel: [345404.688518] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:03:45 s1lp14 kernel: [345404.688521] [ 551] 0 551 12750 538 135168 270 0 systemd-journal Mar 20 07:03:45 s1lp14 kernel: [345404.688523] [ 635] 0 635 3774 462 86016 574 -1000 systemd-udevd Mar 20 07:03:45 s1lp14 kernel: [345404.688525] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:03:45 s1lp14 kernel: [345404.688527] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:03:45 s1lp14 kernel: [345404.688528] [ 1078] 100 1078 20782 566 100352 166 0 systemd-timesyn Mar 20 07:03:45 s1lp14 kernel: [345404.688530] [ 1132] 102 1132 2482 461 98304 201 0 systemd-resolve Mar 20 07:03:45 s1lp14 kernel: [345404.688532] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:03:45 s1lp14 kernel: [345404.688534] [ 1226] 0 1226 1547 405 79872 83 0 cron Mar 20 07:03:45 s1lp14 kernel: [345404.688535] [ 1229] 0 1229 2444 550 98304 200 0 systemd-logind Mar 20 07:03:45 s1lp14 kernel: [345404.688537] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:03:45 s1lp14 kernel: [345404.688539] [ 1255] 0 1255 58495 242 131072 221 0 accounts-daemon Mar 20 07:03:45 s1lp14 kernel: [345404.688540] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:03:45 s1lp14 kernel: [345404.688542] [ 1259] 0 1259 20060 441 83968 78 0 irqbalance Mar 20 07:03:45 s1lp14 kernel: [345404.688544] [ 1265] 0 1265 2673 1226 83968 308 0 pkcsslotd Mar 20 07:03:45 s1lp14 kernel: [345404.688546] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:03:45 s1lp14 kernel: [345404.688547] [ 1433] 0 1433 1125 448 73728 48 0 iscsid Mar 20 07:03:45 s1lp14 kernel: [345404.688549] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:03:45 s1lp14 kernel: [345404.688551] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:03:45 s1lp14 kernel: [345404.688553] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:03:45 s1lp14 kernel: [345404.688555] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:03:45 s1lp14 kernel: [345404.688556] [ 7772] 101 7772 2793 601 100352 193 0 systemd-network Mar 20 07:03:45 s1lp14 kernel: [345404.688558] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:03:45 s1lp14 kernel: [345404.688560] [66598] 0 66598 394264 17 253952 2264 -900 snapd Mar 20 07:03:45 s1lp14 kernel: [345404.688562] [113723] 0 113723 2359 520 88064 118 0 wpa_supplicant Mar 20 07:03:45 s1lp14 kernel: [345404.688564] [116349] 0 116349 8972 352 83968 117 0 master Mar 20 07:03:45 s1lp14 kernel: [345404.688565] [116354] 111 116354 9056 391 92160 110 0 qmgr Mar 20 07:03:45 s1lp14 kernel: [345404.688568] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:03:45 s1lp14 kernel: [345404.688569] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:03:45 s1lp14 kernel: [345404.688571] [117440] 103 117440 54882 470 98304 155 0 rsyslogd Mar 20 07:03:45 s1lp14 kernel: [345404.688573] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:03:45 s1lp14 kernel: [345404.688575] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:03:45 s1lp14 kernel: [345404.688577] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:03:45 s1lp14 kernel: [345404.688579] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:03:45 s1lp14 kernel: [345404.688580] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:03:45 s1lp14 kernel: [345404.688582] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:03:45 s1lp14 kernel: [345404.688584] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:03:45 s1lp14 kernel: [345404.688586] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:03:45 s1lp14 kernel: [345404.688588] [70732] 111 70732 9042 347 88064 120 0 pickup Mar 20 07:03:45 s1lp14 kernel: [345404.688590] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:03:45 s1lp14 kernel: [345404.688592] [190296] 0 190296 3262 444 104448 65 -1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688594] [190297] 0 190297 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688595] [190298] 0 190298 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688597] [190299] 0 190299 3262 297 102400 68 -1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688599] [190300] 0 190300 3262 267 102400 62 -1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688601] [190302] 0 190302 3262 296 102400 69 -1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688603] [190304] 0 190304 3262 243 102400 62 -1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688605] [190307] 0 190307 3262 270 102400 64 -1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688607] [190308] 0 190308 3262 310 102400 55 -1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688609] [190476] 0 190476 952481 825693 7729152 123662 1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688611] [190478] 0 190478 918080 901342 7454720 13615 1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688613] [190487] 0 190487 1043451 1040275 8456192 52 1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688615] [190488] 0 190488 401989 398809 3309568 52 1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688617] [190489] 0 190489 957875 954701 7772160 51 1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688619] [190493] 0 190493 574352 571178 4687872 51 1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688621] [190495] 0 190495 204868 201691 1716224 50 1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688622] [190500] 0 190500 6041 2862 124928 51 1000 stress-ng Mar 20 07:03:45 s1lp14 kernel: [345404.688624] Out of memory: Kill process 190487 (stress-ng) score 1192 or sacrifice child Mar 20 07:03:45 s1lp14 kernel: [345404.688633] Killed process 190487 (stress-ng) total-vm:4173804kB, anon-rss:4160860kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:03:46 s1lp14 kernel: [345405.668584] oom_reaper: reaped process 190487 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:03:46 s1lp14 stress-ng: memory (MB): total 19923.80, free 151.67, shared 3.95, buffer 0.32, swap 625.40, free swap 0.00 Mar 20 07:03:46 s1lp14 kernel: [345405.917838] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:03:46 s1lp14 kernel: [345405.917839] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:03:46 s1lp14 kernel: [345405.917845] CPU: 5 PID: 190489 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:03:46 s1lp14 kernel: [345405.917846] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:03:46 s1lp14 kernel: [345405.917848] Call Trace: Mar 20 07:03:46 s1lp14 kernel: [345405.917857] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:03:46 s1lp14 kernel: [345405.917862] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:03:46 s1lp14 kernel: [345405.917866] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:03:46 s1lp14 kernel: [345405.917868] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:03:46 s1lp14 kernel: [345405.917869] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:03:46 s1lp14 kernel: [345405.917872] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:03:46 s1lp14 kernel: [345405.917876] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:03:46 s1lp14 kernel: [345405.917880] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:03:46 s1lp14 kernel: [345405.917882] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:03:46 s1lp14 kernel: [345405.917884] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:03:46 s1lp14 kernel: [345405.917887] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:03:46 s1lp14 kernel: [345405.917890] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:03:46 s1lp14 kernel: [345405.917891] Mem-Info: Mar 20 07:03:46 s1lp14 kernel: [345405.917896] active_anon:4561913 inactive_anon:351665 isolated_anon:96 Mar 20 07:03:46 s1lp14 kernel: [345405.917896] active_file:16 inactive_file:142 isolated_file:0 Mar 20 07:03:46 s1lp14 kernel: [345405.917896] unevictable:7099 dirty:3 writeback:0 unstable:0 Mar 20 07:03:46 s1lp14 kernel: [345405.917896] slab_reclaimable:17311 slab_unreclaimable:40916 Mar 20 07:03:46 s1lp14 kernel: [345405.917896] mapped:3108 shmem:1012 pagetables:21169 bounce:0 Mar 20 07:03:46 s1lp14 kernel: [345405.917896] free:23440 free_pcp:0 free_cma:0 Mar 20 07:03:46 s1lp14 kernel: [345405.917901] Node 0 active_anon:18247652kB inactive_anon:1406660kB active_file:64kB inactive_file:568kB unevictable:28396kB isolated(anon):384kB isolated(file):0kB mapped:12432kB dirty:12kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:03:46 s1lp14 kernel: [345405.917902] Node 0 DMA free:73820kB min:2280kB low:4344kB high:6408kB active_anon:1902740kB inactive_anon:91832kB active_file:152kB inactive_file:216kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:8384kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:03:46 s1lp14 kernel: [345405.917907] lowmem_reserve[]: 0 17889 17889 Mar 20 07:03:46 s1lp14 kernel: [345405.917909] Node 0 Normal free:19940kB min:20244kB low:38560kB high:56876kB active_anon:16345912kB inactive_anon:1314204kB active_file:584kB inactive_file:224kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7952kB pagetables:76292kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:03:46 s1lp14 kernel: [345405.917914] lowmem_reserve[]: 0 0 0 Mar 20 07:03:46 s1lp14 kernel: [345405.917917] Node 0 DMA: 178*4kB (UM) 95*8kB (UME) 46*16kB (UM) 57*32kB (UM) 28*64kB (UM) 9*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74816kB Mar 20 07:03:46 s1lp14 kernel: [345405.917929] Node 0 Normal: 932*4kB (UME) 535*8kB (UME) 211*16kB (UME) 338*32kB (UM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB = 22200kB Mar 20 07:03:46 s1lp14 kernel: [345405.917939] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:03:46 s1lp14 kernel: [345405.917940] 19553 total pagecache pages Mar 20 07:03:46 s1lp14 kernel: [345405.917941] 16461 pages in swap cache Mar 20 07:03:46 s1lp14 kernel: [345405.917942] Swap cache stats: add 3908742, delete 3892100, find 20348/32265 Mar 20 07:03:46 s1lp14 kernel: [345405.917943] Free swap = 0kB Mar 20 07:03:46 s1lp14 kernel: [345405.917943] Total swap = 640412kB Mar 20 07:03:46 s1lp14 kernel: [345405.917944] 5242880 pages RAM Mar 20 07:03:46 s1lp14 kernel: [345405.917945] 0 pages HighMem/MovableOnly Mar 20 07:03:46 s1lp14 kernel: [345405.917945] 142387 pages reserved Mar 20 07:03:46 s1lp14 kernel: [345405.917946] 0 pages cma reserved Mar 20 07:03:46 s1lp14 kernel: [345405.917947] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:03:46 s1lp14 kernel: [345405.917951] [ 551] 0 551 12750 558 135168 269 0 systemd-journal Mar 20 07:03:46 s1lp14 kernel: [345405.917953] [ 635] 0 635 3774 462 86016 574 -1000 systemd-udevd Mar 20 07:03:46 s1lp14 kernel: [345405.917955] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:03:46 s1lp14 kernel: [345405.917957] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:03:46 s1lp14 kernel: [345405.917959] [ 1078] 100 1078 20782 566 100352 166 0 systemd-timesyn Mar 20 07:03:46 s1lp14 kernel: [345405.917961] [ 1132] 102 1132 2482 461 98304 201 0 systemd-resolve Mar 20 07:03:46 s1lp14 kernel: [345405.917962] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:03:46 s1lp14 kernel: [345405.917964] [ 1226] 0 1226 1547 405 79872 83 0 cron Mar 20 07:03:46 s1lp14 kernel: [345405.917966] [ 1229] 0 1229 2444 550 98304 200 0 systemd-logind Mar 20 07:03:46 s1lp14 kernel: [345405.917968] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:03:46 s1lp14 kernel: [345405.917970] [ 1255] 0 1255 58495 344 131072 217 0 accounts-daemon Mar 20 07:03:46 s1lp14 kernel: [345405.917971] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:03:46 s1lp14 kernel: [345405.917973] [ 1259] 0 1259 20060 441 83968 78 0 irqbalance Mar 20 07:03:46 s1lp14 kernel: [345405.917975] [ 1265] 0 1265 2673 1226 83968 308 0 pkcsslotd Mar 20 07:03:46 s1lp14 kernel: [345405.917977] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:03:46 s1lp14 kernel: [345405.917979] [ 1433] 0 1433 1125 448 73728 48 0 iscsid Mar 20 07:03:46 s1lp14 kernel: [345405.917981] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:03:46 s1lp14 kernel: [345405.917983] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:03:46 s1lp14 kernel: [345405.917985] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:03:46 s1lp14 kernel: [345405.917987] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:03:46 s1lp14 kernel: [345405.917988] [ 7772] 101 7772 2793 601 100352 193 0 systemd-network Mar 20 07:03:46 s1lp14 kernel: [345405.917990] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:03:46 s1lp14 kernel: [345405.917992] [66598] 0 66598 394264 17 253952 2264 -900 snapd Mar 20 07:03:46 s1lp14 kernel: [345405.917994] [113723] 0 113723 2359 520 88064 118 0 wpa_supplicant Mar 20 07:03:46 s1lp14 kernel: [345405.917995] [116349] 0 116349 8972 352 83968 117 0 master Mar 20 07:03:46 s1lp14 kernel: [345405.917997] [116354] 111 116354 9056 391 92160 110 0 qmgr Mar 20 07:03:46 s1lp14 kernel: [345405.918000] [116878] 0 116878 95644 594 139264 492 0 udisksd Mar 20 07:03:46 s1lp14 kernel: [345405.918001] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:03:46 s1lp14 kernel: [345405.918003] [117440] 103 117440 54882 446 98304 146 0 rsyslogd Mar 20 07:03:46 s1lp14 kernel: [345405.918005] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:03:46 s1lp14 kernel: [345405.918007] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:03:46 s1lp14 kernel: [345405.918009] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:03:46 s1lp14 kernel: [345405.918011] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:03:46 s1lp14 kernel: [345405.918013] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:03:46 s1lp14 kernel: [345405.918015] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:03:46 s1lp14 kernel: [345405.918017] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:03:46 s1lp14 kernel: [345405.918019] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:03:46 s1lp14 kernel: [345405.918021] [70732] 111 70732 9042 347 88064 120 0 pickup Mar 20 07:03:46 s1lp14 kernel: [345405.918022] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:03:46 s1lp14 kernel: [345405.918025] [190296] 0 190296 3262 417 104448 65 -1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918026] [190297] 0 190297 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918028] [190298] 0 190298 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918030] [190299] 0 190299 3262 297 102400 68 -1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918032] [190300] 0 190300 3262 267 102400 62 -1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918034] [190302] 0 190302 3262 296 102400 69 -1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918036] [190304] 0 190304 3262 278 102400 51 -1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918038] [190307] 0 190307 3262 270 102400 64 -1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918040] [190308] 0 190308 3262 310 102400 55 -1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918042] [190476] 0 190476 1048182 921397 8495104 123662 1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918044] [190478] 0 190478 995884 979080 8077312 13616 1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918046] [190488] 0 190488 502846 499633 4116480 52 1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918048] [190489] 0 190489 1137424 1134244 9209856 51 1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918050] [190493] 0 190493 822892 819681 6692864 51 1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918052] [190495] 0 190495 364255 361048 3006464 50 1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918054] [190500] 0 190500 181224 178044 1525760 51 1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918055] [190501] 0 190501 5963 2785 124928 51 1000 stress-ng Mar 20 07:03:46 s1lp14 kernel: [345405.918056] Out of memory: Kill process 190489 (stress-ng) score 1209 or sacrifice child Mar 20 07:03:46 s1lp14 kernel: [345405.918065] Killed process 190489 (stress-ng) total-vm:4549696kB, anon-rss:4536736kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:03:48 s1lp14 kernel: [345407.154859] oom_reaper: reaped process 190489 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:03:48 s1lp14 stress-ng: memory (MB): total 19923.80, free 575.82, shared 3.95, buffer 0.32, swap 625.40, free swap 0.00 Mar 20 07:03:48 s1lp14 kernel: [345407.318710] udisksd invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:03:48 s1lp14 kernel: [345407.318713] udisksd cpuset=/ mems_allowed=0 Mar 20 07:03:48 s1lp14 kernel: [345407.318720] CPU: 3 PID: 116878 Comm: udisksd Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:03:48 s1lp14 kernel: [345407.318721] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:03:48 s1lp14 kernel: [345407.318722] Call Trace: Mar 20 07:03:48 s1lp14 kernel: [345407.318731] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:03:48 s1lp14 kernel: [345407.318735] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:03:48 s1lp14 kernel: [345407.318740] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:03:48 s1lp14 kernel: [345407.318741] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:03:48 s1lp14 kernel: [345407.318743] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:03:48 s1lp14 kernel: [345407.318746] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:03:48 s1lp14 kernel: [345407.318749] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:03:48 s1lp14 kernel: [345407.318751] [<0000000000325bd8>] __read_swap_cache_async+0x180/0x270 Mar 20 07:03:48 s1lp14 kernel: [345407.318753] [<0000000000325cfa>] read_swap_cache_async+0x32/0x60 Mar 20 07:03:48 s1lp14 kernel: [345407.318754] [<0000000000325f74>] swapin_readahead+0x24c/0x290 Mar 20 07:03:48 s1lp14 kernel: [345407.318758] [<0000000000309f6a>] do_swap_page+0x5c2/0x8d8 Mar 20 07:03:48 s1lp14 kernel: [345407.318761] [<000000000030cd8c>] __handle_mm_fault+0x8ac/0xd78 Mar 20 07:03:48 s1lp14 kernel: [345407.318762] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:03:48 s1lp14 kernel: [345407.318766] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:03:48 s1lp14 kernel: [345407.318769] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:03:48 s1lp14 kernel: [345407.318769] Mem-Info: Mar 20 07:03:48 s1lp14 kernel: [345407.318774] active_anon:4562138 inactive_anon:351641 isolated_anon:0 Mar 20 07:03:48 s1lp14 kernel: [345407.318774] active_file:152 inactive_file:29 isolated_file:2 Mar 20 07:03:48 s1lp14 kernel: [345407.318774] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 07:03:48 s1lp14 kernel: [345407.318774] slab_reclaimable:17311 slab_unreclaimable:40908 Mar 20 07:03:48 s1lp14 kernel: [345407.318774] mapped:2968 shmem:1012 pagetables:21178 bounce:0 Mar 20 07:03:48 s1lp14 kernel: [345407.318774] free:23377 free_pcp:23 free_cma:0 Mar 20 07:03:48 s1lp14 kernel: [345407.318779] Node 0 active_anon:18248552kB inactive_anon:1406564kB active_file:608kB inactive_file:116kB unevictable:28396kB isolated(anon):0kB isolated(file):8kB mapped:11872kB dirty:0kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:03:48 s1lp14 kernel: [345407.318780] Node 0 DMA free:73608kB min:2280kB low:4344kB high:6408kB active_anon:1897420kB inactive_anon:97844kB active_file:128kB inactive_file:0kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:8208kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:03:48 s1lp14 kernel: [345407.318785] lowmem_reserve[]: 0 17889 17889 Mar 20 07:03:48 s1lp14 kernel: [345407.318788] Node 0 Normal free:19900kB min:20244kB low:38560kB high:56876kB active_anon:16350640kB inactive_anon:1308412kB active_file:280kB inactive_file:800kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7952kB pagetables:76504kB bounce:0kB free_pcp:92kB local_pcp:0kB free_cma:0kB Mar 20 07:03:48 s1lp14 kernel: [345407.318792] lowmem_reserve[]: 0 0 0 Mar 20 07:03:48 s1lp14 kernel: [345407.318794] Node 0 DMA: 176*4kB (UM) 105*8kB (UME) 48*16kB (UM) 35*32kB (UM) 27*64kB (UM) 10*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74280kB Mar 20 07:03:48 s1lp14 kernel: [345407.318807] Node 0 Normal: 809*4kB (UME) 600*8kB (UME) 291*16kB (UME) 269*32kB (UM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB = 21300kB Mar 20 07:03:48 s1lp14 kernel: [345407.318817] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:03:48 s1lp14 kernel: [345407.318818] 19648 total pagecache pages Mar 20 07:03:48 s1lp14 kernel: [345407.318819] 16485 pages in swap cache Mar 20 07:03:48 s1lp14 kernel: [345407.318820] Swap cache stats: add 3908810, delete 3892144, find 20384/32336 Mar 20 07:03:48 s1lp14 kernel: [345407.318821] Free swap = 0kB Mar 20 07:03:48 s1lp14 kernel: [345407.318821] Total swap = 640412kB Mar 20 07:03:48 s1lp14 kernel: [345407.318822] 5242880 pages RAM Mar 20 07:03:48 s1lp14 kernel: [345407.318823] 0 pages HighMem/MovableOnly Mar 20 07:03:48 s1lp14 kernel: [345407.318824] 142387 pages reserved Mar 20 07:03:48 s1lp14 kernel: [345407.318824] 0 pages cma reserved Mar 20 07:03:48 s1lp14 kernel: [345407.318825] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:03:48 s1lp14 kernel: [345407.318828] [ 551] 0 551 12750 550 135168 269 0 systemd-journal Mar 20 07:03:48 s1lp14 kernel: [345407.318831] [ 635] 0 635 3774 462 86016 574 -1000 systemd-udevd Mar 20 07:03:48 s1lp14 kernel: [345407.318833] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:03:48 s1lp14 kernel: [345407.318835] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:03:48 s1lp14 kernel: [345407.318836] [ 1078] 100 1078 20782 566 100352 166 0 systemd-timesyn Mar 20 07:03:48 s1lp14 kernel: [345407.318838] [ 1132] 102 1132 2482 461 98304 201 0 systemd-resolve Mar 20 07:03:48 s1lp14 kernel: [345407.318840] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:03:48 s1lp14 kernel: [345407.318841] [ 1226] 0 1226 1547 405 79872 83 0 cron Mar 20 07:03:48 s1lp14 kernel: [345407.318843] [ 1229] 0 1229 2444 550 98304 200 0 systemd-logind Mar 20 07:03:48 s1lp14 kernel: [345407.318844] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:03:48 s1lp14 kernel: [345407.318846] [ 1255] 0 1255 58495 599 131072 216 0 accounts-daemon Mar 20 07:03:48 s1lp14 kernel: [345407.318848] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:03:48 s1lp14 kernel: [345407.318850] [ 1259] 0 1259 20060 457 83968 58 0 irqbalance Mar 20 07:03:48 s1lp14 kernel: [345407.318852] [ 1265] 0 1265 2673 1226 83968 308 0 pkcsslotd Mar 20 07:03:48 s1lp14 kernel: [345407.318853] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:03:48 s1lp14 kernel: [345407.318855] [ 1433] 0 1433 1125 448 73728 48 0 iscsid Mar 20 07:03:48 s1lp14 kernel: [345407.318857] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:03:48 s1lp14 kernel: [345407.318858] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:03:48 s1lp14 kernel: [345407.318860] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:03:48 s1lp14 kernel: [345407.318862] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:03:48 s1lp14 kernel: [345407.318864] [ 7772] 101 7772 2793 601 100352 193 0 systemd-network Mar 20 07:03:48 s1lp14 kernel: [345407.318866] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:03:48 s1lp14 kernel: [345407.318868] [66598] 0 66598 394264 16 253952 2265 -900 snapd Mar 20 07:03:48 s1lp14 kernel: [345407.318870] [113723] 0 113723 2359 520 88064 118 0 wpa_supplicant Mar 20 07:03:48 s1lp14 kernel: [345407.318871] [116349] 0 116349 8972 352 83968 117 0 master Mar 20 07:03:48 s1lp14 kernel: [345407.318873] [116354] 111 116354 9056 391 92160 110 0 qmgr Mar 20 07:03:48 s1lp14 kernel: [345407.318875] [116878] 0 116878 95644 513 139264 471 0 udisksd Mar 20 07:03:48 s1lp14 kernel: [345407.318877] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:03:48 s1lp14 kernel: [345407.318879] [117440] 103 117440 54882 143 98304 146 0 rsyslogd Mar 20 07:03:48 s1lp14 kernel: [345407.318881] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:03:48 s1lp14 kernel: [345407.318883] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:03:48 s1lp14 kernel: [345407.318884] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:03:48 s1lp14 kernel: [345407.318887] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:03:48 s1lp14 kernel: [345407.318888] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:03:48 s1lp14 kernel: [345407.318890] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:03:48 s1lp14 kernel: [345407.318892] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:03:48 s1lp14 kernel: [345407.318894] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:03:48 s1lp14 kernel: [345407.318895] [70732] 111 70732 9042 347 88064 120 0 pickup Mar 20 07:03:48 s1lp14 kernel: [345407.318897] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:03:48 s1lp14 kernel: [345407.318899] [190296] 0 190296 3262 425 104448 65 -1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318901] [190297] 0 190297 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318903] [190298] 0 190298 3262 313 102400 52 -1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318905] [190299] 0 190299 3262 297 102400 68 -1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318907] [190300] 0 190300 3262 267 102400 62 -1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318909] [190302] 0 190302 3262 296 102400 69 -1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318911] [190304] 0 190304 3262 278 102400 51 -1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318913] [190307] 0 190307 3262 270 102400 64 -1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318914] [190308] 0 190308 3262 237 102400 54 -1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318916] [190476] 0 190476 1147909 1021119 9293824 123662 1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318918] [190478] 0 190478 1111929 1095152 9005056 13649 1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318920] [190488] 0 190488 624048 620811 5085184 52 1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318922] [190493] 0 190493 1066245 1063068 8640512 51 1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318924] [190495] 0 190495 551729 548498 4507648 50 1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318926] [190500] 0 190500 358675 355492 2963456 51 1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318928] [190501] 0 190501 183034 179857 1540096 51 1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318930] [190502] 0 190502 15419 12242 200704 51 1000 stress-ng Mar 20 07:03:48 s1lp14 kernel: [345407.318931] Out of memory: Kill process 190476 (stress-ng) score 1211 or sacrifice child Mar 20 07:03:48 s1lp14 kernel: [345407.318939] Killed process 190476 (stress-ng) total-vm:4591636kB, anon-rss:4084236kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:03:49 s1lp14 kernel: [345408.394995] oom_reaper: reaped process 190476 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:03:56 s1lp14 stress-ng: memory (MB): total 19923.80, free 102.96, shared 1.54, buffer 0.32, swap 625.40, free swap 466.69 Mar 20 07:04:01 s1lp14 kernel: [345420.704744] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:04:01 s1lp14 kernel: [345420.704746] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:04:01 s1lp14 kernel: [345420.704752] CPU: 5 PID: 190504 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:04:01 s1lp14 kernel: [345420.704753] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:04:01 s1lp14 kernel: [345420.704754] Call Trace: Mar 20 07:04:01 s1lp14 kernel: [345420.704763] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:04:01 s1lp14 kernel: [345420.704768] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:04:01 s1lp14 kernel: [345420.704772] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:04:01 s1lp14 kernel: [345420.704773] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:04:01 s1lp14 kernel: [345420.704775] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:04:01 s1lp14 kernel: [345420.704778] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:04:01 s1lp14 kernel: [345420.704781] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:04:01 s1lp14 kernel: [345420.704786] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:04:01 s1lp14 kernel: [345420.704787] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:04:01 s1lp14 kernel: [345420.704789] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:04:01 s1lp14 kernel: [345420.704792] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:04:01 s1lp14 kernel: [345420.704795] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:04:01 s1lp14 kernel: [345420.704796] Mem-Info: Mar 20 07:04:01 s1lp14 kernel: [345420.704801] active_anon:4562218 inactive_anon:351935 isolated_anon:66 Mar 20 07:04:01 s1lp14 kernel: [345420.704801] active_file:95 inactive_file:95 isolated_file:2 Mar 20 07:04:01 s1lp14 kernel: [345420.704801] unevictable:7099 dirty:5 writeback:222 unstable:0 Mar 20 07:04:01 s1lp14 kernel: [345420.704801] slab_reclaimable:17311 slab_unreclaimable:40942 Mar 20 07:04:01 s1lp14 kernel: [345420.704801] mapped:2666 shmem:749 pagetables:21097 bounce:0 Mar 20 07:04:01 s1lp14 kernel: [345420.704801] free:23447 free_pcp:256 free_cma:0 Mar 20 07:04:01 s1lp14 kernel: [345420.704804] Node 0 active_anon:18248872kB inactive_anon:1407740kB active_file:380kB inactive_file:380kB unevictable:28396kB isolated(anon):264kB isolated(file):8kB mapped:10664kB dirty:20kB writeback:888kB shmem:2996kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:04:01 s1lp14 kernel: [345420.704805] Node 0 DMA free:73960kB min:2280kB low:4344kB high:6408kB active_anon:1881536kB inactive_anon:114320kB active_file:4kB inactive_file:60kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:8232kB bounce:0kB free_pcp:372kB local_pcp:4kB free_cma:0kB Mar 20 07:04:01 s1lp14 kernel: [345420.704810] lowmem_reserve[]: 0 17889 17889 Mar 20 07:04:01 s1lp14 kernel: [345420.704813] Node 0 Normal free:19828kB min:20244kB low:38560kB high:56876kB active_anon:16367308kB inactive_anon:1293420kB active_file:192kB inactive_file:636kB unevictable:28396kB writepending:1032kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7968kB pagetables:76156kB bounce:0kB free_pcp:652kB local_pcp:60kB free_cma:0kB Mar 20 07:04:01 s1lp14 kernel: [345420.704817] lowmem_reserve[]: 0 0 0 Mar 20 07:04:01 s1lp14 kernel: [345420.704819] Node 0 DMA: 152*4kB (UM) 95*8kB (UME) 50*16kB (UM) 22*32kB (UM) 26*64kB (UM) 10*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73656kB Mar 20 07:04:01 s1lp14 kernel: [345420.704830] Node 0 Normal: 405*4kB (UE) 478*8kB (UE) 220*16kB (UME) 328*32kB (UM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB = 19460kB Mar 20 07:04:01 s1lp14 kernel: [345420.704841] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:04:01 s1lp14 kernel: [345420.704842] 17695 total pagecache pages Mar 20 07:04:01 s1lp14 kernel: [345420.704843] 14832 pages in swap cache Mar 20 07:04:01 s1lp14 kernel: [345420.704844] Swap cache stats: add 4035057, delete 4020044, find 21274/33424 Mar 20 07:04:01 s1lp14 kernel: [345420.704845] Free swap = 0kB Mar 20 07:04:01 s1lp14 kernel: [345420.704845] Total swap = 640412kB Mar 20 07:04:01 s1lp14 kernel: [345420.704846] 5242880 pages RAM Mar 20 07:04:01 s1lp14 kernel: [345420.704847] 0 pages HighMem/MovableOnly Mar 20 07:04:01 s1lp14 kernel: [345420.704847] 142387 pages reserved Mar 20 07:04:01 s1lp14 kernel: [345420.704848] 0 pages cma reserved Mar 20 07:04:01 s1lp14 kernel: [345420.704848] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:04:01 s1lp14 kernel: [345420.704852] [ 551] 0 551 12750 546 135168 269 0 systemd-journal Mar 20 07:04:01 s1lp14 kernel: [345420.704855] [ 635] 0 635 3774 462 86016 574 -1000 systemd-udevd Mar 20 07:04:01 s1lp14 kernel: [345420.704857] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:04:01 s1lp14 kernel: [345420.704859] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:04:01 s1lp14 kernel: [345420.704861] [ 1078] 100 1078 20782 566 100352 166 0 systemd-timesyn Mar 20 07:04:01 s1lp14 kernel: [345420.704863] [ 1132] 102 1132 2482 461 98304 201 0 systemd-resolve Mar 20 07:04:01 s1lp14 kernel: [345420.704864] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:04:01 s1lp14 kernel: [345420.704866] [ 1226] 0 1226 1547 405 79872 83 0 cron Mar 20 07:04:01 s1lp14 kernel: [345420.704868] [ 1229] 0 1229 2444 550 98304 200 0 systemd-logind Mar 20 07:04:01 s1lp14 kernel: [345420.704870] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:04:01 s1lp14 kernel: [345420.704871] [ 1255] 0 1255 58495 585 131072 218 0 accounts-daemon Mar 20 07:04:01 s1lp14 kernel: [345420.704873] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:04:01 s1lp14 kernel: [345420.704875] [ 1259] 0 1259 20060 500 83968 67 0 irqbalance Mar 20 07:04:01 s1lp14 kernel: [345420.704877] [ 1265] 0 1265 2673 945 83968 310 0 pkcsslotd Mar 20 07:04:01 s1lp14 kernel: [345420.704878] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:04:01 s1lp14 kernel: [345420.704880] [ 1433] 0 1433 1125 461 73728 35 0 iscsid Mar 20 07:04:01 s1lp14 kernel: [345420.704882] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:04:01 s1lp14 kernel: [345420.704884] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:04:01 s1lp14 kernel: [345420.704886] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:04:01 s1lp14 kernel: [345420.704887] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:04:01 s1lp14 kernel: [345420.704888] [ 7772] 101 7772 2793 588 100352 209 0 systemd-network Mar 20 07:04:01 s1lp14 kernel: [345420.704890] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:04:01 s1lp14 kernel: [345420.704891] [66598] 0 66598 394264 0 253952 2543 -900 snapd Mar 20 07:04:01 s1lp14 kernel: [345420.704893] [113723] 0 113723 2359 387 88064 133 0 wpa_supplicant Mar 20 07:04:01 s1lp14 kernel: [345420.704895] [116349] 0 116349 8972 342 83968 139 0 master Mar 20 07:04:01 s1lp14 kernel: [345420.704897] [116354] 111 116354 9056 373 92160 135 0 qmgr Mar 20 07:04:01 s1lp14 kernel: [345420.704900] [116878] 0 116878 95644 661 139264 400 0 udisksd Mar 20 07:04:01 s1lp14 kernel: [345420.704901] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:04:01 s1lp14 kernel: [345420.704904] [117440] 103 117440 54882 632 98304 153 0 rsyslogd Mar 20 07:04:01 s1lp14 kernel: [345420.704906] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:04:01 s1lp14 kernel: [345420.704907] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:04:01 s1lp14 kernel: [345420.704909] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:04:01 s1lp14 kernel: [345420.704911] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:04:01 s1lp14 kernel: [345420.704912] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:04:01 s1lp14 kernel: [345420.704914] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:04:01 s1lp14 kernel: [345420.704916] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:04:01 s1lp14 kernel: [345420.704918] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:04:01 s1lp14 kernel: [345420.704919] [70732] 111 70732 9042 343 88064 134 0 pickup Mar 20 07:04:01 s1lp14 kernel: [345420.704921] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:04:01 s1lp14 kernel: [345420.704923] [190296] 0 190296 3262 444 104448 65 -1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704925] [190297] 0 190297 3262 313 102400 52 -1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704927] [190298] 0 190298 3262 313 102400 52 -1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704928] [190299] 0 190299 3262 223 102400 67 -1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704930] [190300] 0 190300 3262 267 102400 62 -1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704932] [190302] 0 190302 3262 296 102400 69 -1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704934] [190304] 0 190304 3262 278 102400 51 -1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704936] [190307] 0 190307 3262 270 102400 64 -1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704938] [190308] 0 190308 3262 237 102400 54 -1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704940] [190478] 0 190478 1175195 1035412 9510912 136655 1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704942] [190488] 0 190488 781159 777978 6342656 52 1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704944] [190493] 0 190493 1279706 1276526 10346496 51 1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704945] [190495] 0 190495 729308 726131 5926912 50 1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704947] [190500] 0 190500 577541 574363 4714496 51 1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704949] [190501] 0 190501 316834 313655 2627584 51 1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704951] [190502] 0 190502 176133 172955 1486848 51 1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704953] [190504] 0 190504 24985 21811 276480 51 1000 stress-ng Mar 20 07:04:01 s1lp14 kernel: [345420.704954] Out of memory: Kill process 190493 (stress-ng) score 1235 or sacrifice child Mar 20 07:04:01 s1lp14 kernel: [345420.704962] Killed process 190493 (stress-ng) total-vm:5118824kB, anon-rss:5105864kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:04:02 s1lp14 kernel: [345421.822871] oom_reaper: reaped process 190493 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:04:02 s1lp14 kernel: [345421.832032] stress-ng invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null), order=0, oom_score_adj=1000 Mar 20 07:04:02 s1lp14 kernel: [345421.832033] stress-ng cpuset=/ mems_allowed=0 Mar 20 07:04:02 s1lp14 kernel: [345421.832037] CPU: 2 PID: 190500 Comm: stress-ng Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:04:02 s1lp14 kernel: [345421.832038] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:04:02 s1lp14 kernel: [345421.832039] Call Trace: Mar 20 07:04:02 s1lp14 kernel: [345421.832048] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:04:02 s1lp14 kernel: [345421.832051] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:04:02 s1lp14 kernel: [345421.832055] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:04:02 s1lp14 kernel: [345421.832056] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:04:02 s1lp14 kernel: [345421.832057] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:04:02 s1lp14 kernel: [345421.832059] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:04:02 s1lp14 kernel: [345421.832062] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:04:02 s1lp14 kernel: [345421.832066] [<000000000030731c>] do_anonymous_page+0x1dc/0x5b0 Mar 20 07:04:02 s1lp14 kernel: [345421.832066] [<000000000030cd44>] __handle_mm_fault+0x864/0xd78 Mar 20 07:04:02 s1lp14 kernel: [345421.832067] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:04:02 s1lp14 kernel: [345421.832070] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:04:02 s1lp14 kernel: [345421.832072] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:04:02 s1lp14 kernel: [345421.832073] Mem-Info: Mar 20 07:04:02 s1lp14 kernel: [345421.832076] active_anon:4557354 inactive_anon:351722 isolated_anon:0 Mar 20 07:04:02 s1lp14 kernel: [345421.832076] active_file:143 inactive_file:76 isolated_file:2 Mar 20 07:04:02 s1lp14 kernel: [345421.832076] unevictable:7099 dirty:0 writeback:68 unstable:0 Mar 20 07:04:02 s1lp14 kernel: [345421.832076] slab_reclaimable:17311 slab_unreclaimable:40934 Mar 20 07:04:02 s1lp14 kernel: [345421.832076] mapped:2974 shmem:1002 pagetables:25638 bounce:0 Mar 20 07:04:02 s1lp14 kernel: [345421.832076] free:23406 free_pcp:238 free_cma:0 Mar 20 07:04:02 s1lp14 kernel: [345421.832078] Node 0 active_anon:18229416kB inactive_anon:1406888kB active_file:572kB inactive_file:304kB unevictable:28396kB isolated(anon):0kB isolated(file):8kB mapped:11896kB dirty:0kB writeback:272kB shmem:4008kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:04:02 s1lp14 kernel: [345421.832079] Node 0 DMA free:73756kB min:2280kB low:4344kB high:6408kB active_anon:1881036kB inactive_anon:112092kB active_file:28kB inactive_file:48kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:9892kB bounce:0kB free_pcp:428kB local_pcp:0kB free_cma:0kB Mar 20 07:04:02 s1lp14 kernel: [345421.832081] lowmem_reserve[]: 0 17889 17889 Mar 20 07:04:02 s1lp14 kernel: [345421.832083] Node 0 Normal free:19868kB min:20244kB low:38560kB high:56876kB active_anon:16347612kB inactive_anon:1294796kB active_file:252kB inactive_file:896kB unevictable:28396kB writepending:272kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7968kB pagetables:92660kB bounce:0kB free_pcp:524kB local_pcp:4kB free_cma:0kB Mar 20 07:04:02 s1lp14 kernel: [345421.832085] lowmem_reserve[]: 0 0 0 Mar 20 07:04:02 s1lp14 kernel: [345421.832086] Node 0 DMA: 5*4kB (UM) 12*8kB (UME) 10*16kB (UM) 84*32kB (M) 26*64kB (UM) 10*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73748kB Mar 20 07:04:02 s1lp14 kernel: [345421.832092] Node 0 Normal: 10*4kB (ME) 169*8kB (UE) 135*16kB (ME) 510*32kB (UM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB = 19872kB Mar 20 07:04:02 s1lp14 kernel: [345421.832098] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:04:02 s1lp14 kernel: [345421.832099] 17490 total pagecache pages Mar 20 07:04:02 s1lp14 kernel: [345421.832099] 14295 pages in swap cache Mar 20 07:04:02 s1lp14 kernel: [345421.832100] Swap cache stats: add 4035755, delete 4021279, find 21471/33724 Mar 20 07:04:02 s1lp14 kernel: [345421.832100] Free swap = 0kB Mar 20 07:04:02 s1lp14 kernel: [345421.832101] Total swap = 640412kB Mar 20 07:04:02 s1lp14 kernel: [345421.832101] 5242880 pages RAM Mar 20 07:04:02 s1lp14 kernel: [345421.832101] 0 pages HighMem/MovableOnly Mar 20 07:04:02 s1lp14 kernel: [345421.832102] 142387 pages reserved Mar 20 07:04:02 s1lp14 kernel: [345421.832102] 0 pages cma reserved Mar 20 07:04:02 s1lp14 kernel: [345421.832102] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:04:02 s1lp14 kernel: [345421.832104] [ 551] 0 551 12750 575 135168 269 0 systemd-journal Mar 20 07:04:02 s1lp14 kernel: [345421.832106] [ 635] 0 635 3774 462 86016 574 -1000 systemd-udevd Mar 20 07:04:02 s1lp14 kernel: [345421.832107] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:04:02 s1lp14 kernel: [345421.832108] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:04:02 s1lp14 kernel: [345421.832109] [ 1078] 100 1078 20782 566 100352 166 0 systemd-timesyn Mar 20 07:04:02 s1lp14 kernel: [345421.832110] [ 1132] 102 1132 2482 461 98304 201 0 systemd-resolve Mar 20 07:04:02 s1lp14 kernel: [345421.832111] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:04:02 s1lp14 kernel: [345421.832111] [ 1226] 0 1226 1547 430 79872 57 0 cron Mar 20 07:04:02 s1lp14 kernel: [345421.832112] [ 1229] 0 1229 2444 550 98304 200 0 systemd-logind Mar 20 07:04:02 s1lp14 kernel: [345421.832113] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:04:02 s1lp14 kernel: [345421.832114] [ 1255] 0 1255 58495 425 131072 218 0 accounts-daemon Mar 20 07:04:02 s1lp14 kernel: [345421.832115] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:04:02 s1lp14 kernel: [345421.832116] [ 1259] 0 1259 20060 496 83968 71 0 irqbalance Mar 20 07:04:02 s1lp14 kernel: [345421.832116] [ 1265] 0 1265 2673 1196 83968 310 0 pkcsslotd Mar 20 07:04:02 s1lp14 kernel: [345421.832117] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:04:02 s1lp14 kernel: [345421.832118] [ 1433] 0 1433 1125 460 73728 36 0 iscsid Mar 20 07:04:02 s1lp14 kernel: [345421.832119] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:04:02 s1lp14 kernel: [345421.832120] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:04:02 s1lp14 kernel: [345421.832121] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:04:02 s1lp14 kernel: [345421.832122] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:04:02 s1lp14 kernel: [345421.832123] [ 7772] 101 7772 2793 588 100352 209 0 systemd-network Mar 20 07:04:02 s1lp14 kernel: [345421.832124] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:04:02 s1lp14 kernel: [345421.832125] [66598] 0 66598 394264 0 253952 2543 -900 snapd Mar 20 07:04:02 s1lp14 kernel: [345421.832126] [113723] 0 113723 2359 387 88064 133 0 wpa_supplicant Mar 20 07:04:02 s1lp14 kernel: [345421.832126] [116349] 0 116349 8972 342 83968 139 0 master Mar 20 07:04:02 s1lp14 kernel: [345421.832127] [116354] 111 116354 9056 373 92160 135 0 qmgr Mar 20 07:04:02 s1lp14 kernel: [345421.832128] [116878] 0 116878 95644 645 139264 416 0 udisksd Mar 20 07:04:02 s1lp14 kernel: [345421.832129] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:04:02 s1lp14 kernel: [345421.832130] [117440] 103 117440 54882 484 98304 153 0 rsyslogd Mar 20 07:04:02 s1lp14 kernel: [345421.832131] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:04:02 s1lp14 kernel: [345421.832132] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:04:02 s1lp14 kernel: [345421.832132] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:04:02 s1lp14 kernel: [345421.832133] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:04:02 s1lp14 kernel: [345421.832134] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:04:02 s1lp14 kernel: [345421.832135] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:04:02 s1lp14 kernel: [345421.832136] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:04:02 s1lp14 kernel: [345421.832137] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:04:02 s1lp14 kernel: [345421.832138] [70732] 111 70732 9042 343 88064 134 0 pickup Mar 20 07:04:02 s1lp14 kernel: [345421.832139] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:04:02 s1lp14 kernel: [345421.832140] [190296] 0 190296 3262 424 104448 65 -1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832141] [190297] 0 190297 3262 302 102400 52 -1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832142] [190298] 0 190298 3262 313 102400 52 -1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832143] [190299] 0 190299 3262 223 102400 67 -1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832144] [190300] 0 190300 3262 267 102400 62 -1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832145] [190302] 0 190302 3262 296 102400 69 -1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832145] [190304] 0 190304 3262 278 102400 51 -1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832146] [190307] 0 190307 3262 270 102400 64 -1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832147] [190308] 0 190308 3262 237 102400 54 -1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832148] [190478] 0 190478 1339103 1199063 10838016 136923 1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832149] [190488] 0 190488 937198 934028 7606272 52 1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832150] [190495] 0 190495 907868 904701 7372800 50 1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832151] [190500] 0 190500 730476 727306 5937152 51 1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832152] [190501] 0 190501 497265 494094 4071424 51 1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832153] [190502] 0 190502 349772 346604 2891776 51 1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832154] [190504] 0 190504 291255 288084 2422784 51 1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832154] [190509] 0 190509 3369 221 104448 50 1000 stress-ng Mar 20 07:04:02 s1lp14 kernel: [345421.832155] Out of memory: Kill process 190478 (stress-ng) score 1246 or sacrifice child Mar 20 07:04:02 s1lp14 kernel: [345421.832162] Killed process 190478 (stress-ng) total-vm:5356412kB, anon-rss:4795984kB, file-rss:264kB, shmem-rss:4kB Mar 20 07:04:02 s1lp14 stress-ng: memory (MB): total 19923.80, free 94.91, shared 3.91, buffer 0.34, swap 625.40, free swap 0.00 Mar 20 07:04:03 s1lp14 kernel: [345422.940470] oom_reaper: reaped process 190478 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:04:18 s1lp14 kernel: [345437.703483] pkcsslotd invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:04:18 s1lp14 kernel: [345437.703485] pkcsslotd cpuset=/ mems_allowed=0 Mar 20 07:04:18 s1lp14 kernel: [345437.703492] CPU: 7 PID: 1265 Comm: pkcsslotd Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:04:18 s1lp14 kernel: [345437.703493] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:04:18 s1lp14 kernel: [345437.703494] Call Trace: Mar 20 07:04:18 s1lp14 kernel: [345437.703503] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:04:18 s1lp14 kernel: [345437.703507] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:04:18 s1lp14 kernel: [345437.703512] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:04:18 s1lp14 kernel: [345437.703515] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:04:18 s1lp14 kernel: [345437.703517] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:04:18 s1lp14 kernel: [345437.703520] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:04:18 s1lp14 kernel: [345437.703523] [<0000000000339ce6>] alloc_pages_vma+0x9e/0x248 Mar 20 07:04:18 s1lp14 kernel: [345437.703525] [<0000000000325bd8>] __read_swap_cache_async+0x180/0x270 Mar 20 07:04:18 s1lp14 kernel: [345437.703527] [<0000000000325eac>] swapin_readahead+0x184/0x290 Mar 20 07:04:18 s1lp14 kernel: [345437.703531] [<00000000002e5932>] shmem_swapin+0x72/0xb8 Mar 20 07:04:18 s1lp14 kernel: [345437.703533] [<00000000002e74ca>] shmem_getpage_gfp+0x682/0xeb0 Mar 20 07:04:18 s1lp14 kernel: [345437.703534] [<00000000002e7fca>] shmem_fault+0x9a/0x230 Mar 20 07:04:18 s1lp14 kernel: [345437.703538] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:04:18 s1lp14 kernel: [345437.703540] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:04:18 s1lp14 kernel: [345437.703542] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:04:18 s1lp14 kernel: [345437.703545] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:04:18 s1lp14 kernel: [345437.703548] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:04:18 s1lp14 kernel: [345437.703549] Mem-Info: Mar 20 07:04:18 s1lp14 kernel: [345437.703555] active_anon:4615630 inactive_anon:298246 isolated_anon:32 Mar 20 07:04:18 s1lp14 kernel: [345437.703555] active_file:114 inactive_file:91 isolated_file:0 Mar 20 07:04:18 s1lp14 kernel: [345437.703555] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 07:04:18 s1lp14 kernel: [345437.703555] slab_reclaimable:17303 slab_unreclaimable:40905 Mar 20 07:04:18 s1lp14 kernel: [345437.703555] mapped:2669 shmem:684 pagetables:21133 bounce:0 Mar 20 07:04:18 s1lp14 kernel: [345437.703555] free:23584 free_pcp:63 free_cma:0 Mar 20 07:04:18 s1lp14 kernel: [345437.703559] Node 0 active_anon:18462520kB inactive_anon:1192984kB active_file:456kB inactive_file:364kB unevictable:28396kB isolated(anon):128kB isolated(file):0kB mapped:10676kB dirty:0kB writeback:0kB shmem:2736kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:04:18 s1lp14 kernel: [345437.703560] Node 0 DMA free:73712kB min:2280kB low:4344kB high:6408kB active_anon:1803416kB inactive_anon:191624kB active_file:64kB inactive_file:0kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:8432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:04:18 s1lp14 kernel: [345437.703565] lowmem_reserve[]: 0 17889 17889 Mar 20 07:04:18 s1lp14 kernel: [345437.703568] Node 0 Normal free:20624kB min:20244kB low:38560kB high:56876kB active_anon:16658872kB inactive_anon:1001260kB active_file:212kB inactive_file:676kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7952kB pagetables:76100kB bounce:0kB free_pcp:252kB local_pcp:0kB free_cma:0kB Mar 20 07:04:18 s1lp14 kernel: [345437.703573] lowmem_reserve[]: 0 0 0 Mar 20 07:04:18 s1lp14 kernel: [345437.703575] Node 0 DMA: 143*4kB (UM) 133*8kB (UME) 47*16kB (UM) 17*32kB (UM) 28*64kB (UM) 10*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 73844kB Mar 20 07:04:18 s1lp14 kernel: [345437.703587] Node 0 Normal: 672*4kB (UME) 550*8kB (UME) 218*16kB (UME) 337*32kB (UM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB = 21360kB Mar 20 07:04:18 s1lp14 kernel: [345437.703597] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:04:18 s1lp14 kernel: [345437.703598] 6451 total pagecache pages Mar 20 07:04:18 s1lp14 kernel: [345437.703599] 3681 pages in swap cache Mar 20 07:04:18 s1lp14 kernel: [345437.703600] Swap cache stats: add 4177653, delete 4173797, find 22237/34691 Mar 20 07:04:18 s1lp14 kernel: [345437.703600] Free swap = 0kB Mar 20 07:04:18 s1lp14 kernel: [345437.703600] Total swap = 640412kB Mar 20 07:04:18 s1lp14 kernel: [345437.703601] 5242880 pages RAM Mar 20 07:04:18 s1lp14 kernel: [345437.703602] 0 pages HighMem/MovableOnly Mar 20 07:04:18 s1lp14 kernel: [345437.703602] 142387 pages reserved Mar 20 07:04:18 s1lp14 kernel: [345437.703603] 0 pages cma reserved Mar 20 07:04:18 s1lp14 kernel: [345437.703603] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:04:18 s1lp14 kernel: [345437.703606] [ 551] 0 551 12750 418 135168 322 0 systemd-journal Mar 20 07:04:18 s1lp14 kernel: [345437.703608] [ 635] 0 635 3774 462 86016 574 -1000 systemd-udevd Mar 20 07:04:18 s1lp14 kernel: [345437.703610] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:04:18 s1lp14 kernel: [345437.703612] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:04:18 s1lp14 kernel: [345437.703614] [ 1078] 100 1078 20782 566 100352 166 0 systemd-timesyn Mar 20 07:04:18 s1lp14 kernel: [345437.703615] [ 1132] 102 1132 2482 461 98304 201 0 systemd-resolve Mar 20 07:04:18 s1lp14 kernel: [345437.703617] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:04:18 s1lp14 kernel: [345437.703619] [ 1226] 0 1226 1547 417 79872 79 0 cron Mar 20 07:04:18 s1lp14 kernel: [345437.703620] [ 1229] 0 1229 2444 550 98304 200 0 systemd-logind Mar 20 07:04:18 s1lp14 kernel: [345437.703622] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:04:18 s1lp14 kernel: [345437.703623] [ 1255] 0 1255 58495 577 131072 231 0 accounts-daemon Mar 20 07:04:18 s1lp14 kernel: [345437.703625] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:04:18 s1lp14 kernel: [345437.703626] [ 1259] 0 1259 20060 526 83968 71 0 irqbalance Mar 20 07:04:18 s1lp14 kernel: [345437.703628] [ 1265] 0 1265 2673 888 83968 310 0 pkcsslotd Mar 20 07:04:18 s1lp14 kernel: [345437.703629] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:04:18 s1lp14 kernel: [345437.703630] [ 1433] 0 1433 1125 450 73728 46 0 iscsid Mar 20 07:04:18 s1lp14 kernel: [345437.703631] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:04:18 s1lp14 kernel: [345437.703633] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:04:18 s1lp14 kernel: [345437.703634] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:04:18 s1lp14 kernel: [345437.703636] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:04:18 s1lp14 kernel: [345437.703638] [ 7772] 101 7772 2793 588 100352 209 0 systemd-network Mar 20 07:04:18 s1lp14 kernel: [345437.703639] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:04:18 s1lp14 kernel: [345437.703641] [66598] 0 66598 394264 0 253952 2545 -900 snapd Mar 20 07:04:18 s1lp14 kernel: [345437.703642] [113723] 0 113723 2359 466 88064 126 0 wpa_supplicant Mar 20 07:04:18 s1lp14 kernel: [345437.703644] [116349] 0 116349 8972 342 83968 140 0 master Mar 20 07:04:18 s1lp14 kernel: [345437.703645] [116354] 111 116354 9056 373 92160 135 0 qmgr Mar 20 07:04:18 s1lp14 kernel: [345437.703647] [116878] 0 116878 95644 595 139264 466 0 udisksd Mar 20 07:04:18 s1lp14 kernel: [345437.703648] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:04:18 s1lp14 kernel: [345437.703650] [117440] 103 117440 54882 566 98304 269 0 rsyslogd Mar 20 07:04:18 s1lp14 kernel: [345437.703651] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:04:18 s1lp14 kernel: [345437.703653] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:04:18 s1lp14 kernel: [345437.703654] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:04:18 s1lp14 kernel: [345437.703656] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:04:18 s1lp14 kernel: [345437.703657] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:04:18 s1lp14 kernel: [345437.703659] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:04:18 s1lp14 kernel: [345437.703660] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:04:18 s1lp14 kernel: [345437.703662] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:04:18 s1lp14 kernel: [345437.703664] [70732] 111 70732 9042 343 88064 141 0 pickup Mar 20 07:04:18 s1lp14 kernel: [345437.703666] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:04:18 s1lp14 kernel: [345437.703667] [190296] 0 190296 3262 373 104448 65 -1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703669] [190297] 0 190297 3262 272 102400 58 -1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703671] [190298] 0 190298 3262 293 102400 72 -1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703673] [190299] 0 190299 3262 217 102400 73 -1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703675] [190300] 0 190300 3262 261 102400 68 -1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703676] [190302] 0 190302 3262 300 102400 60 -1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703678] [190304] 0 190304 3262 271 102400 58 -1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703680] [190307] 0 190307 3262 264 102400 70 -1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703682] [190308] 0 190308 3262 220 102400 71 -1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703684] [190488] 0 190488 998622 859176 8097792 136323 1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703685] [190495] 0 190495 1166092 1162931 9439232 56 1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703687] [190500] 0 190500 941449 938208 7641088 56 1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703689] [190501] 0 190501 633603 630439 5160960 58 1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703691] [190502] 0 190502 537027 533788 4388864 66 1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703693] [190504] 0 190504 528383 525204 4319232 56 1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703695] [190509] 0 190509 222525 219346 1857536 56 1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703697] [190510] 0 190510 43952 40769 428032 56 1000 stress-ng Mar 20 07:04:18 s1lp14 kernel: [345437.703698] Out of memory: Kill process 190495 (stress-ng) score 1214 or sacrifice child Mar 20 07:04:18 s1lp14 kernel: [345437.703706] Killed process 190495 (stress-ng) total-vm:4664368kB, anon-rss:4651404kB, file-rss:316kB, shmem-rss:4kB Mar 20 07:04:18 s1lp14 stress-ng: memory (MB): total 19923.80, free 97.61, shared 1.01, buffer 0.33, swap 625.40, free swap 514.81 Mar 20 07:04:19 s1lp14 kernel: [345438.809191] oom_reaper: reaped process 190495 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:04:19 s1lp14 kernel: [345438.932577] in:imklog invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Mar 20 07:04:19 s1lp14 kernel: [345438.932581] in:imklog cpuset=/ mems_allowed=0 Mar 20 07:04:19 s1lp14 kernel: [345438.932588] CPU: 3 PID: 117442 Comm: in:imklog Not tainted 4.15.0-12-generic #13-Ubuntu Mar 20 07:04:19 s1lp14 kernel: [345438.932589] Hardware name: IBM 2964 N63 400 (LPAR) Mar 20 07:04:19 s1lp14 kernel: [345438.932590] Call Trace: Mar 20 07:04:19 s1lp14 kernel: [345438.932600] ([<00000000001138fe>] show_stack+0x56/0x80) Mar 20 07:04:19 s1lp14 kernel: [345438.932604] [<00000000008a362a>] dump_stack+0x82/0xb0 Mar 20 07:04:19 s1lp14 kernel: [345438.932608] [<00000000002c84de>] dump_header+0x8e/0x300 Mar 20 07:04:19 s1lp14 kernel: [345438.932610] [<00000000002c7a1e>] oom_kill_process+0x2e6/0x4e8 Mar 20 07:04:19 s1lp14 kernel: [345438.932612] [<00000000002c80ec>] out_of_memory+0x29c/0x588 Mar 20 07:04:19 s1lp14 kernel: [345438.932615] [<00000000002cf188>] __alloc_pages_nodemask+0xf90/0x1020 Mar 20 07:04:19 s1lp14 kernel: [345438.932616] [<00000000002c3e40>] filemap_fault+0x220/0x630 Mar 20 07:04:19 s1lp14 kernel: [345438.932620] [<0000000000443a64>] ext4_filemap_fault+0x54/0x78 Mar 20 07:04:19 s1lp14 kernel: [345438.932625] [<0000000000305cec>] __do_fault+0x3c/0xb8 Mar 20 07:04:19 s1lp14 kernel: [345438.932630] [<000000000030ce3a>] __handle_mm_fault+0x95a/0xd78 Mar 20 07:04:19 s1lp14 kernel: [345438.932632] [<000000000030d32a>] handle_mm_fault+0xd2/0x170 Mar 20 07:04:19 s1lp14 kernel: [345438.932635] [<000000000012472a>] do_dat_exception+0x182/0x3b8 Mar 20 07:04:19 s1lp14 kernel: [345438.932639] [<00000000008c1fc0>] pgm_check_handler+0x16c/0x1c0 Mar 20 07:04:19 s1lp14 kernel: [345438.932640] Mem-Info: Mar 20 07:04:19 s1lp14 kernel: [345438.932645] active_anon:4788083 inactive_anon:125648 isolated_anon:128 Mar 20 07:04:19 s1lp14 kernel: [345438.932645] active_file:20 inactive_file:86 isolated_file:0 Mar 20 07:04:19 s1lp14 kernel: [345438.932645] unevictable:7099 dirty:0 writeback:0 unstable:0 Mar 20 07:04:19 s1lp14 kernel: [345438.932645] slab_reclaimable:17303 slab_unreclaimable:40905 Mar 20 07:04:19 s1lp14 kernel: [345438.932645] mapped:2972 shmem:1012 pagetables:21152 bounce:0 Mar 20 07:04:19 s1lp14 kernel: [345438.932645] free:23458 free_pcp:0 free_cma:0 Mar 20 07:04:19 s1lp14 kernel: [345438.932650] Node 0 active_anon:19152332kB inactive_anon:502592kB active_file:80kB inactive_file:344kB unevictable:28396kB isolated(anon):512kB isolated(file):0kB mapped:11888kB dirty:0kB writeback:0kB shmem:4048kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 20 07:04:19 s1lp14 kernel: [345438.932651] Node 0 DMA free:73612kB min:2280kB low:4344kB high:6408kB active_anon:1916936kB inactive_anon:78360kB active_file:12kB inactive_file:324kB unevictable:0kB writepending:0kB present:2097152kB managed:2083368kB mlocked:0kB kernel_stack:80kB pagetables:8100kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:04:19 s1lp14 kernel: [345438.932655] lowmem_reserve[]: 0 17889 17889 Mar 20 07:04:19 s1lp14 kernel: [345438.932658] Node 0 Normal free:20220kB min:20244kB low:38560kB high:56876kB active_anon:17236876kB inactive_anon:422680kB active_file:0kB inactive_file:0kB unevictable:28396kB writepending:0kB present:18874368kB managed:18318604kB mlocked:28396kB kernel_stack:7952kB pagetables:76508kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 20 07:04:19 s1lp14 kernel: [345438.932663] lowmem_reserve[]: 0 0 0 Mar 20 07:04:19 s1lp14 kernel: [345438.932666] Node 0 DMA: 206*4kB (UM) 115*8kB (UME) 38*16kB (UM) 42*32kB (UM) 28*64kB (UM) 10*128kB (UME) 3*256kB (UME) 1*512kB (E) 65*1024kB (UM) = 74608kB Mar 20 07:04:19 s1lp14 kernel: [345438.932678] Node 0 Normal: 961*4kB (UME) 672*8kB (UME) 224*16kB (UME) 285*32kB (UM) 1*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB = 21988kB Mar 20 07:04:19 s1lp14 kernel: [345438.932690] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1024kB Mar 20 07:04:19 s1lp14 kernel: [345438.932690] 7278 total pagecache pages Mar 20 07:04:19 s1lp14 kernel: [345438.932691] 3995 pages in swap cache Mar 20 07:04:19 s1lp14 kernel: [345438.932692] Swap cache stats: add 4178901, delete 4174731, find 22747/35342 Mar 20 07:04:19 s1lp14 kernel: [345438.932693] Free swap = 0kB Mar 20 07:04:19 s1lp14 kernel: [345438.932694] Total swap = 640412kB Mar 20 07:04:19 s1lp14 kernel: [345438.932695] 5242880 pages RAM Mar 20 07:04:19 s1lp14 kernel: [345438.932695] 0 pages HighMem/MovableOnly Mar 20 07:04:19 s1lp14 kernel: [345438.932696] 142387 pages reserved Mar 20 07:04:19 s1lp14 kernel: [345438.932697] 0 pages cma reserved Mar 20 07:04:19 s1lp14 kernel: [345438.932698] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Mar 20 07:04:19 s1lp14 kernel: [345438.932701] [ 551] 0 551 12750 611 135168 273 0 systemd-journal Mar 20 07:04:19 s1lp14 kernel: [345438.932702] [ 635] 0 635 3774 462 86016 574 -1000 systemd-udevd Mar 20 07:04:19 s1lp14 kernel: [345438.932705] [ 863] 0 863 120912 6143 157696 0 -1000 multipathd Mar 20 07:04:19 s1lp14 kernel: [345438.932707] [ 938] 0 938 21536 226 77824 56 0 lvmetad Mar 20 07:04:19 s1lp14 kernel: [345438.932709] [ 1078] 100 1078 20782 566 100352 166 0 systemd-timesyn Mar 20 07:04:19 s1lp14 kernel: [345438.932710] [ 1132] 102 1132 2482 461 98304 201 0 systemd-resolve Mar 20 07:04:19 s1lp14 kernel: [345438.932713] [ 1213] 104 1213 1735 612 88064 285 -900 dbus-daemon Mar 20 07:04:19 s1lp14 kernel: [345438.932715] [ 1226] 0 1226 1547 417 79872 79 0 cron Mar 20 07:04:19 s1lp14 kernel: [345438.932717] [ 1229] 0 1229 2444 550 98304 200 0 systemd-logind Mar 20 07:04:19 s1lp14 kernel: [345438.932719] [ 1237] 0 1237 93035 247 83968 142 0 lxcfs Mar 20 07:04:19 s1lp14 kernel: [345438.932721] [ 1255] 0 1255 58495 512 131072 220 0 accounts-daemon Mar 20 07:04:19 s1lp14 kernel: [345438.932722] [ 1258] 0 1258 800 352 73728 50 0 atd Mar 20 07:04:19 s1lp14 kernel: [345438.932724] [ 1259] 0 1259 20060 525 83968 72 0 irqbalance Mar 20 07:04:19 s1lp14 kernel: [345438.932726] [ 1265] 0 1265 2673 1215 83968 310 0 pkcsslotd Mar 20 07:04:19 s1lp14 kernel: [345438.932728] [ 1305] 0 1305 58840 603 137216 558 0 polkitd Mar 20 07:04:19 s1lp14 kernel: [345438.932730] [ 1433] 0 1433 1125 450 73728 46 0 iscsid Mar 20 07:04:19 s1lp14 kernel: [345438.932732] [ 1436] 0 1436 1251 1217 73728 0 -17 iscsid Mar 20 07:04:19 s1lp14 kernel: [345438.932734] [ 1475] 0 1475 1355 342 71680 38 0 agetty Mar 20 07:04:19 s1lp14 kernel: [345438.932736] [ 1517] 0 1517 2476 628 98304 183 -1000 sshd Mar 20 07:04:19 s1lp14 kernel: [345438.932738] [ 7604] 0 7604 1355 342 71680 38 0 agetty Mar 20 07:04:19 s1lp14 kernel: [345438.932740] [ 7772] 101 7772 2793 588 100352 209 0 systemd-network Mar 20 07:04:19 s1lp14 kernel: [345438.932742] [66522] 108 66522 1760 117 79872 52 0 uuidd Mar 20 07:04:19 s1lp14 kernel: [345438.932744] [66598] 0 66598 394264 0 253952 2545 -900 snapd Mar 20 07:04:19 s1lp14 kernel: [345438.932746] [113723] 0 113723 2359 466 88064 126 0 wpa_supplicant Mar 20 07:04:19 s1lp14 kernel: [345438.932749] [116349] 0 116349 8972 342 83968 140 0 master Mar 20 07:04:19 s1lp14 kernel: [345438.932750] [116354] 111 116354 9056 373 92160 135 0 qmgr Mar 20 07:04:19 s1lp14 kernel: [345438.932752] [116878] 0 116878 95644 588 139264 473 0 udisksd Mar 20 07:04:19 s1lp14 kernel: [345438.932754] [117327] 0 117327 77616 546 163840 331 0 ModemManager Mar 20 07:04:19 s1lp14 kernel: [345438.932756] [117440] 103 117440 54882 568 98304 182 0 rsyslogd Mar 20 07:04:19 s1lp14 kernel: [345438.932758] [10364] 0 10364 2719 564 114688 248 0 sshd Mar 20 07:04:19 s1lp14 kernel: [345438.932759] [10366] 1000 10366 2966 516 102400 287 0 systemd Mar 20 07:04:19 s1lp14 kernel: [345438.932761] [10367] 1000 10367 3607 235 120832 661 0 (sd-pam) Mar 20 07:04:19 s1lp14 kernel: [345438.932763] [10488] 1000 10488 2719 204 114688 248 0 sshd Mar 20 07:04:19 s1lp14 kernel: [345438.932764] [10489] 1000 10489 2084 400 79872 462 0 bash Mar 20 07:04:19 s1lp14 kernel: [345438.932766] [10520] 1000 10520 71836 564 229376 12707 0 checkbox-cli Mar 20 07:04:19 s1lp14 kernel: [345438.932768] [69451] 0 69451 1967 460 92160 124 0 sudo Mar 20 07:04:19 s1lp14 kernel: [345438.932770] [69455] 0 69455 2087 361 81920 95 0 memory_stress_n Mar 20 07:04:19 s1lp14 kernel: [345438.932771] [70732] 111 70732 9042 343 88064 141 0 pickup Mar 20 07:04:19 s1lp14 kernel: [345438.932773] [190295] 0 190295 1758 41 79872 31 0 timeout Mar 20 07:04:19 s1lp14 kernel: [345438.932775] [190296] 0 190296 3262 389 104448 65 -1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932777] [190297] 0 190297 3262 272 102400 58 -1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932779] [190298] 0 190298 3262 293 102400 72 -1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932781] [190299] 0 190299 3262 217 102400 73 -1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932783] [190300] 0 190300 3262 261 102400 68 -1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932785] [190302] 0 190302 3262 301 102400 59 -1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932787] [190304] 0 190304 3262 271 102400 58 -1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932789] [190307] 0 190307 3262 236 102400 55 -1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932791] [190308] 0 190308 3262 220 102400 71 -1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932793] [190488] 0 190488 1172264 1032283 9488384 136858 1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932795] [190500] 0 190500 979655 976473 7946240 56 1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932797] [190501] 0 190501 801300 798061 6504448 58 1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932799] [190502] 0 190502 737984 734795 5996544 66 1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932800] [190504] 0 190504 721931 718747 5869568 56 1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932802] [190509] 0 190509 411742 408563 3387392 56 1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932804] [190510] 0 190510 243116 239881 2021376 56 1000 stress-ng Mar 20 07:04:19 s1lp14 kernel: [345438.932805] Out of memory: Kill process 190488 (stress-ng) score 1215 or sacrifice child Mar 20 07:04:19 s1lp14 kernel: [345438.932814] Killed process 190488 (stress-ng) total-vm:4689056kB, anon-rss:4128892kB, file-rss:236kB, shmem-rss:4kB Mar 20 07:04:19 s1lp14 stress-ng: memory (MB): total 19923.80, free 91.71, shared 3.95, buffer 0.33, swap 625.40, free swap 0.00 Mar 20 07:04:20 s1lp14 stress-ng: memory (MB): total 19923.80, free 544.31, shared 1.72, buffer 0.32, swap 625.40, free swap 519.61 Mar 20 07:04:20 s1lp14 kernel: [345439.704520] oom_reaper: reaped process 190488 (stress-ng), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Mar 20 07:04:37 s1lp14 memory_stress_ng: Running stress-ng mmap stressor for 500 seconds... Mar 20 07:04:37 s1lp14 stress-ng: invoked with 'stress-ng -k --aggressive --verify --timeout 500 --mmap 0' by user 0 Mar 20 07:04:37 s1lp14 stress-ng: system: 's1lp14' Linux 4.15.0-12-generic #13-Ubuntu SMP Wed Mar 7 21:36:36 UTC 2018 s390x Mar 20 07:04:37 s1lp14 stress-ng: memory (MB): total 19923.80, free 19340.00, shared 3.93, buffer 2.29, swap 625.40, free swap 535.78 Mar 20 07:05:02 s1lp14 CRON[190546]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 07:15:01 s1lp14 CRON[190674]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 07:17:01 s1lp14 CRON[190701]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Mar 20 07:20:01 s1lp14 stress-ng: invoked with 'stress-ng --aggressive --verify --timeout 7200 --metrics-brief --tz --times --af-alg 0 --bsearch 0 --context 0 --cpu 0 --crypt 0 --hsearch 0 --longjmp 0 --lsearch 0 --matrix 0 --qsort 0 --str 0 --stream 0 --tsearch 0 --vecmath 0 --wcs 0' by user 0 Mar 20 07:20:01 s1lp14 stress-ng: system: 's1lp14' Linux 4.15.0-12-generic #13-Ubuntu SMP Wed Mar 7 21:36:36 UTC 2018 s390x Mar 20 07:20:01 s1lp14 stress-ng: memory (MB): total 19923.80, free 19286.03, shared 3.95, buffer 7.01, swap 625.40, free swap 550.28 Mar 20 07:20:01 s1lp14 kernel: [346380.792440] NET: Registered protocol family 38 Mar 20 07:25:01 s1lp14 CRON[219596]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 07:26:28 s1lp14 systemd[1]: Starting Cleanup of Temporary Directories... Mar 20 07:26:29 s1lp14 systemd-tmpfiles[227859]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring. Mar 20 07:26:29 s1lp14 systemd[1]: Started Cleanup of Temporary Directories. Mar 20 07:35:01 s1lp14 CRON[14408]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 07:45:01 s1lp14 CRON[71110]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 07:55:01 s1lp14 CRON[127448]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 08:05:01 s1lp14 CRON[183998]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 08:15:01 s1lp14 CRON[240517]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 08:17:01 s1lp14 CRON[251675]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Mar 20 08:25:01 s1lp14 CRON[34987]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 08:35:01 s1lp14 CRON[91836]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 08:42:01 s1lp14 CRON[131467]: (root) CMD ( test -x /etc/cron.daily/popularity-contest && /etc/cron.daily/popularity-contest --crond) Mar 20 08:45:01 s1lp14 CRON[148414]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 08:55:01 s1lp14 CRON[204995]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 09:05:01 s1lp14 CRON[261407]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 09:15:01 s1lp14 CRON[56203]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 09:17:01 s1lp14 CRON[67368]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Mar 20 09:25:01 s1lp14 CRON[84289]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 09:34:40 s1lp14 systemd[1]: Starting LXD - main daemon... Mar 20 09:34:40 s1lp14 kernel: [354459.965496] audit: type=1400 audit(1521552880.882:36): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="/usr/bin/lxc-start" pid=84458 comm="apparmor_parser" Mar 20 09:34:41 s1lp14 kernel: [354460.076029] audit: type=1400 audit(1521552880.992:37): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="lxc-container-default" pid=84462 comm="apparmor_parser" Mar 20 09:34:41 s1lp14 kernel: [354460.076031] audit: type=1400 audit(1521552880.992:38): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="lxc-container-default-cgns" pid=84462 comm="apparmor_parser" Mar 20 09:34:41 s1lp14 kernel: [354460.076032] audit: type=1400 audit(1521552880.992:39): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="lxc-container-default-with-mounting" pid=84462 comm="apparmor_parser" Mar 20 09:34:41 s1lp14 kernel: [354460.076034] audit: type=1400 audit(1521552880.992:40): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="lxc-container-default-with-nesting" pid=84462 comm="apparmor_parser" Mar 20 09:34:41 s1lp14 lxd[84463]: lvl=warn msg="CGroup memory swap accounting is disabled, swap limits will be ignored." t=2018-03-20T09:34:41-0400 Mar 20 09:34:44 s1lp14 systemd[1]: Started LXD - main daemon. Mar 20 09:35:01 s1lp14 CRON[84581]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 20 09:37:13 s1lp14 kernel: [354612.605384] sdd: sdd1 Mar 20 09:37:13 s1lp14 kernel: [354612.774712] sdb: sdb1 Mar 20 09:37:13 s1lp14 kernel: [354613.025795] sdc: sdc1 Mar 20 09:37:14 s1lp14 kernel: [354613.195833] sda: sda1 Mar 20 09:37:14 s1lp14 kernel: [354613.286412] sda: sda1 Mar 20 09:37:14 s1lp14 multipath: dm-0: usable paths found Mar 20 09:37:17 s1lp14 crontab[84997]: (root) LIST (root) Mar 20 09:37:22 s1lp14 systemd[1]: proc-sys-fs-binfmt_misc.automount: Got automount request for /proc/sys/fs/binfmt_misc, triggered by 85171 (sysctl) Mar 20 09:37:22 s1lp14 systemd[1]: Mounting Arbitrary Executable File Formats File System... Mar 20 09:37:22 s1lp14 systemd[1]: Mounted Arbitrary Executable File Formats File System. Mar 20 09:37:27 s1lp14 kernel: [354626.349052] DCCP: Activated CCID 2 (TCP-like) Mar 20 09:37:27 s1lp14 kernel: [354626.349057] DCCP: Activated CCID 3 (TCP-Friendly Rate Control) Mar 20 09:37:27 s1lp14 kernel: [354626.387041] sctp: Hash tables configured (bind 512/512) Mar 20 09:37:27 s1lp14 kernel: [354626.534317] MACsec IEEE 802.1AE Mar 20 09:37:37 s1lp14 dbus-daemon[1213]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service' requested by ':1.62' (uid=0 pid=85697 comm="timedatectl " label="unconfined") Mar 20 09:37:37 s1lp14 systemd[1]: Starting Time & Date Service... Mar 20 09:37:38 s1lp14 dbus-daemon[1213]: [system] Successfully activated service 'org.freedesktop.timedate1' Mar 20 09:37:38 s1lp14 systemd[1]: Started Time & Date Service. ------------------------------------------------------------------------- >8 --- Outcome: job passed ☑ : Collect information about system memory (/proc/meminfo) ☒ : Collect information about kernel modules ☑ : Collect information about the running kernel ☑ : Collect information about installed software packages ☐ : Attaches json dumps of installed dkms package information. ☑ : Resource to detect if dmi data is present ☐ : Collect information about hardware devices (DMI) ☑ : Collect information about dpkg version ☑ : Collect information about installation media (casper) ☑ : Collect information about the CPU ☐ : Attach a copy of /sys/class/dmi/id/* ☑ : Enumerate available system executables ☐ : Attaches json dumps of udev_resource raw dmi devices ☑ : Collect information about installed snap packages ☑ : efi ☑ : Collect model assertions on the device ☑ : Attach detailed sysfs property output from udev ☑ : requirements ☑ : Attach the contents of /etc/modprobe.* ☑ : environment ☑ : Attach info block devices and their mount points ☑ : Attach PCI configuration space hex dump ☑ : Attach dump of udev database ☑ : udev_json ☑ : Collect information about installed system (lsb-release) ☐ : Check that data for a complete result are present ☑ : Attach a copy of /etc/xdg/canonical-certification.conf ☑ : Attach a copy of /proc/cpuinfo ☐ : Attaches json dumps of installed dkms package information. ☑ : Attach a copy of dmesg ☐ : Attach output of dmidecode ☑ : Attaches firmware version info ☑ : Attach a list of PCI devices ☑ : Attach lshw output ☑ : Attach output of lsusb ☑ : Attach copy of /proc/meminfo ☑ : Attach the contents of /etc/modprobe.* ☑ : Attach modinfo information ☑ : Attach the contents of /etc/modules ☑ : Attach sysctl configuration files. ☑ : Attach a summary of udev devices ☑ : Attach a list of currently running kernel modules ☐ : Gather info on the SUT's make and model ☒ : Verify MAAS version used to deploy the SUT ☐ : Test that system booted in EFI mode ☐ : Test that system booted with Secure Boot active ☐ : Test that system booted from the network ☐ : Test DMI data for CPUs ☐ : Test DMI identification data (servers) ☑ : Attaches info about disk partitions ☑ : info/network_devices ☑ : Attach a copy of /proc/cmdline ☑ : block_device ☑ : Attaches info from hdparm about dm-0 ☑ : Attaches info from hdparm about dm-1 ☐ : Test IPMI in-band communications ☐ : Gather BMC identification info ☐ : Check for firmware update support. ☑ : Raw read timing benchmark of dm-0 using hdparm ☑ : Raw read timing benchmark of dm-1 using hdparm ☑ : Cached read timing benchmark of dm-0 using hdparm ☑ : Cached read timing benchmark of dm-1 using hdparm ☑ : cpu/purley_id ☑ : Tests the CPU for clock jitter ☑ : Test the CPU scaling capabilities ☑ : Attach CPU scaling capabilities log ☐ : Test that the CPU can run at its max frequency ☐ : Attach CPU max frequency log ☒ : Check CPU topology for accuracy between proc and sysfs ☑ : Gathers information about each disk detected ☑ : Disk statistics for dm-0 ☑ : Disk statistics for dm-1 ☑ : Disk performance test for dm-0 ☑ : Disk performance test for dm-1 ☐ : Test SMART capabilities for dm-0 ☐ : Test SMART capabilities for dm-1 ☑ : Disk stress_ng test for dm-0 ☑ : Disk stress_ng test for dm-1 ☑ : Check of CPU load imposed by dm-0 ☑ : Check of CPU load imposed by dm-1 ☑ : Report info about available network devices ☑ : Collect information about hardware devices (udev) ☑ : Gather info on current state of network devices ☑ : ethtool check for NIC enP1p0s0 ☑ : ethtool check for NIC enP1p0s0d1 ☑ : ethtool check for NIC enP2p0s0 ☑ : ethtool check for NIC enP2p0s0d1 ☑ : ethtool check for NIC encc000 ☑ : ethtool check for NIC encc006 ☒ : Multi-NIC Iperf3 stress testing for NIC enP1p0s0 ☒ : Multi-NIC Iperf3 stress testing for NIC enP1p0s0d1 ☒ : Multi-NIC Iperf3 stress testing for NIC enP2p0s0 ☒ : Multi-NIC Iperf3 stress testing for NIC enP2p0s0d1 ☒ : Multi-NIC Iperf3 stress testing for NIC encc000 ☒ : Multi-NIC Iperf3 stress testing for NIC encc006 ☑ : Hardware Manifest ☐ : mediacard/sd-preinserted ☑ : Check amount of memory reported by meminfo against DMI ☑ : Stress test of system memory ☐ : Displays discovered optical drives ☑ : rtc ☐ : Test that RTC functions properly (if present) ☑ : Stress of CPUs (very long runtime) ☐ : Display USB devices attached to SUT ☐ : Test USB 2.0 or 1.1 ports ☑ : Collect information about supported types of USB ☐ : Test USB 3.0 or 3.1 ports ☒ : Verify LXD container launches ☑ : virtualization ☑ : Verify KVM guest boots ☑ : Attaches console log from the kvm_check_vm test ☑ : Generate baseline sosreport ☑ : Attach the baseline sosreport file ☒ : Check syslog for call traces ☑ : Attach syslog if Call Trace appears file:///home/ubuntu/.local/share/checkbox-ng/submission_2018-03-20T13.40.52.534933.html file:///home/ubuntu/.local/share/checkbox-ng/submission_2018-03-20T13.40.52.534933.junit.xml file:///home/ubuntu/.local/share/checkbox-ng/submission_2018-03-20T13.40.52.534933.tar.xz file:///home/ubuntu/.local/share/checkbox-ng/submission_2018-03-20T13.40.52.534933.xlsx Do you want to submit 'upload to certification' report? y => yes n => no [yn]: y WARNING:checkbox-ng.launcher.subcommands:Invalid secure_id Do you want to retry? y => yes n => no [yn]: y Enter secure-id:a00D000000feN6tIAE WARNING:checkbox-ng.launcher.subcommands:Problem occured when submitting upload to certification report: 400 Client Error: BAD REQUEST for url: https://certification.canonical.com/api/v1/submission/a00D000000feN6tIAE/ Do you want to retry? y => yes n => no [yn]: Y Do you want to retry? y => yes n => no [yn]: n ubuntu@s1lp14:~$ # sumbitting manually ...