oom-killer macht keinen reboot - limit für oom-killer nicht optimal #131

Closed
opened 2021-02-25 16:48:24 +01:00 by fwiessner · 7 comments

Der oom-killer sollte das System komplett rebooten, sonst bleibt ein node kaputt online und kann eventuell je nach dem welcher service vom oom-killer erwischt wurde nicht mehr remote verwaltet werden.

Weiterhin ist das limit nicht optimal gesetzt, auf einem tl-wr1043n-v4 waren noch etwas unter 8MB frei (Normal free:7924kB min:8192kB), aber der oom-killer hat den node unbrauchbar zurückgelassen:

[177689.552528] fastd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177689.565363] CPU: 0 PID: 3822 Comm: fastd Not tainted 4.14.215 #0
[177689.571776] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 8320fb84 8399b57c 804f1987
[177689.580702]         804b4c30 00000eee 80643670 00200000 ffffffff 00000001 8320fb38 9592129f
[177689.589680]         00000000 00000000 80640000 00006f40 00000000 00000000 00000007 00000000
[177689.598721]         00000199 a4d154d0 00000198 6d3a2066 80000000 83975680 8320fd20 804bcd98
[177689.607872]         00000003 00200000 ffffffff 00000028 00000000 8026a754 00000000 80640000
[177689.616955]         ...
[177689.619621] Call Trace:
[177689.622405] [<8006aa9c>] show_stack+0x58/0x100
[177689.627165] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177689.632948] [<800f6e24>] oom_kill_process+0xd0/0x460
[177689.638255] [<800f79ec>] out_of_memory+0x3b0/0x420
[177689.643364] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177689.649497] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177689.654646] [<8011b1c0>] __do_fault+0x110/0x18c
[177689.659779] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177689.665322] [<80071d40>] __do_page_fault+0x120/0x468
[177689.670763] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177689.676342] Mem-Info:
[177689.679035] active_anon:418 inactive_anon:5 isolated_anon:0
[177689.679035]  active_file:48 inactive_file:121 isolated_file:0
[177689.679035]  unevictable:0 dirty:0 writeback:0 unstable:0
[177689.679035]  slab_reclaimable:214 slab_unreclaimable:1765
[177689.679035]  mapped:9 shmem:24 pagetables:74 bounce:0
[177689.679035]  free:1991 free_pcp:0 free_cma:0
[177689.712727] Node 0 active_anon:1672kB inactive_anon:20kB active_file:192kB inactive_file:484kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:36kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177689.735951] Normal free:7924kB min:8192kB low:10240kB high:12288kB active_anon:1672kB inactive_anon:20kB active_file:192kB inactive_file:484kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:368kB pagetables:296kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[177689.764452] lowmem_reserve[]: 0 0
[177689.768078] Normal: 154*4kB (U) 190*8kB (UM) 119*16kB (U) 16*32kB (UM) 8*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 7880kB
[177689.782969] 193 total pagecache pages
[177689.787095] 0 pages in swap cache
[177689.790753] Swap cache stats: add 0, delete 0, find 0/0
[177689.796474] Free swap  = 0kB
[177689.799697] Total swap = 0kB
[177689.802805] 16384 pages RAM
[177689.805832] 0 pages HighMem/MovableOnly
[177689.809953] 1513 pages reserved
[177689.813398] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177689.822734] [  524]     0   524      305       19       3       0        0             0 ubusd
[177689.831886] [  525]     0   525      230       10       3       0        0             0 askfirst
[177689.841359] [  542]     0   542      256       12       4       0        0             0 urngd
[177689.850655] [ 1042]     0  1042      311       33       3       0        0             0 logd
[177689.859682] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177689.869078] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177689.878336] [ 1574]     0  1574      330       24       5       0        0             0 uhttpd
[177689.887664] [ 1575]     0  1575      330       22       5       0        0             0 uhttpd
[177689.897191] [ 1576]     0  1576      514       53       4       0        0             0 uhttpd
[177689.906869] [ 3076]     0  3076      436       41       3       0        0             0 netifd
[177689.916164] [ 3317]     0  3317      301       10       4       0        0             0 udhcpc
[177689.925405] [ 3319]     0  3319      262       14       4       0        0             0 odhcp6c
[177689.934799] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177689.944025] [ 3661]     0  3661      259       13       4       0        0             0 alfred
[177689.953275] [ 3822]     0  3822      302       29       5       0        0             0 fastd
[177689.962456] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177689.971620] [ 4660]     0  4660      355       22       3       0        0             0 macnock
[177689.981057] [ 4876]     0  4876      394       36       5       0        0             0 hostapd
[177689.990499] Out of memory: Kill process 1576 (uhttpd) score 3 or sacrifice child
[177689.998404] Killed process 1576 (uhttpd) total-vm:2056kB, anon-rss:208kB, file-rss:4kB, shmem-rss:0kB
[177690.161017] macnock invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177690.174115] CPU: 0 PID: 4663 Comm: macnock Not tainted 4.14.215 #0
[177690.180704] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dc3b84 8391195c 804f1987
[177690.189679]         804b4c30 00001237 80643670 00200000 ffffffff 00000001 82dc3b38 71c854f1
[177690.198617]         00000000 00000000 80640000 00008288 00000000 00000000 00000007 00000000
[177690.207764]         000001cf f510e8af 000001ce 6d3a206d 80000000 83999680 82dc3d20 804bcd98
[177690.217031]         00000003 00200000 ffffffff 00000028 00000010 8026a754 00000000 80640000
[177690.226149]         ...
[177690.228911] Call Trace:
[177690.231788] [<8006aa9c>] show_stack+0x58/0x100
[177690.236609] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177690.242274] [<800f6e24>] oom_kill_process+0xd0/0x460
[177690.247495] [<800f79ec>] out_of_memory+0x3b0/0x420
[177690.252573] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177690.258716] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177690.263782] [<8011b1c0>] __do_fault+0x110/0x18c
[177690.268702] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177690.274164] [<80071d40>] __do_page_fault+0x120/0x468
[177690.279605] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177690.285396] Mem-Info:
[177690.287917] active_anon:366 inactive_anon:5 isolated_anon:0
[177690.287917]  active_file:50 inactive_file:64 isolated_file:0
[177690.287917]  unevictable:0 dirty:0 writeback:0 unstable:0
[177690.287917]  slab_reclaimable:212 slab_unreclaimable:1790
[177690.287917]  mapped:16 shmem:24 pagetables:70 bounce:0
[177690.287917]  free:2049 free_pcp:15 free_cma:0
[177690.321581] Node 0 active_anon:1464kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:64kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177690.345166] Normal free:8164kB min:8192kB low:10240kB high:12288kB active_anon:1464kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:368kB pagetables:280kB bounce:0kB free_pcp:60kB local_pcp:60kB free_cma:0kB
[177690.373658] lowmem_reserve[]: 0 0
[177690.377330] Normal: 175*4kB (UM) 207*8kB (UM) 125*16kB (UM) 13*32kB (UM) 9*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8164kB
[177690.392543] 138 total pagecache pages
[177690.396737] 0 pages in swap cache
[177690.400452] Swap cache stats: add 0, delete 0, find 0/0
[177690.406080] Free swap  = 0kB
[177690.409289] Total swap = 0kB
[177690.412399] 16384 pages RAM
[177690.415438] 0 pages HighMem/MovableOnly
[177690.419518] 1513 pages reserved
[177690.422877] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177690.432084] [  524]     0   524      305       19       3       0        0             0 ubusd
[177690.441486] [  525]     0   525      230       10       3       0        0             0 askfirst
[177690.450952] [  542]     0   542      256       12       4       0        0             0 urngd
[177690.460061] [ 1042]     0  1042      311       40       3       0        0             0 logd
[177690.469058] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177690.478563] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177690.488108] [ 1574]     0  1574      330       24       5       0        0             0 uhttpd
[177690.497570] [ 1575]     0  1575      330       22       5       0        0             0 uhttpd
[177690.506895] [ 3076]     0  3076      436       50       3       0        0             0 netifd
[177690.516198] [ 3317]     0  3317      301       10       4       0        0             0 udhcpc
[177690.525629] [ 3319]     0  3319      262       14       4       0        0             0 odhcp6c
[177690.535095] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177690.544335] [ 3661]     0  3661      259       13       4       0        0             0 alfred
[177690.553642] [ 3822]     0  3822      302       29       5       0        0             0 fastd
[177690.562815] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177690.571924] [ 4660]     0  4660      355       23       3       0        0             0 macnock
[177690.581288] [ 4876]     0  4876      394       36       5       0        0             0 hostapd
[177690.590723] Out of memory: Kill process 3076 (netifd) score 3 or sacrifice child
[177690.598789] Killed process 3319 (odhcp6c) total-vm:1048kB, anon-rss:52kB, file-rss:4kB, shmem-rss:0kB
[177690.660800] macnock invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177690.673767] CPU: 0 PID: 4662 Comm: macnock Not tainted 4.14.215 #0
[177690.680370] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82ed7b84 82ea595c 804f1987
[177690.689264]         804b4c30 00001236 80643670 00200000 ffffffff 00000001 82ed7b38 b8cac7fa
[177690.698323]         00000000 00000000 80640000 00009578 00000000 00000000 00000007 00000000
[177690.707353]         00000204 91ea14cb 00000203 6d3a206d 80000000 83999680 82ed7d20 804bcd98
[177690.716467]         00000003 00200000 ffffffff 00000028 00000010 8026a754 00000000 80640000
[177690.725628]         ...
[177690.728256] Call Trace:
[177690.731073] [<8006aa9c>] show_stack+0x58/0x100
[177690.735941] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177690.741823] [<800f6e24>] oom_kill_process+0xd0/0x460
[177690.747347] [<800f79ec>] out_of_memory+0x3b0/0x420
[177690.752727] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177690.758974] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177690.764070] [<8011b1c0>] __do_fault+0x110/0x18c
[177690.769052] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177690.774377] [<80071d40>] __do_page_fault+0x120/0x468
[177690.779710] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177690.785357] Mem-Info:
[177690.787816] active_anon:353 inactive_anon:5 isolated_anon:0
[177690.787816]  active_file:50 inactive_file:64 isolated_file:0
[177690.787816]  unevictable:0 dirty:0 writeback:0 unstable:0
[177690.787816]  slab_reclaimable:212 slab_unreclaimable:1824
[177690.787816]  mapped:16 shmem:24 pagetables:66 bounce:0
[177690.787816]  free:2006 free_pcp:17 free_cma:0
[177690.821386] Node 0 active_anon:1412kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:64kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177690.844846] Normal free:7992kB min:8192kB low:10240kB high:12288kB active_anon:1412kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:368kB pagetables:264kB bounce:0kB free_pcp:68kB local_pcp:68kB free_cma:0kB
[177690.873628] lowmem_reserve[]: 0 0
[177690.877154] Normal: 184*4kB (UM) 209*8kB (UM) 125*16kB (UM) 8*32kB (UM) 8*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 7992kB
[177690.892126] 138 total pagecache pages
[177690.895997] 0 pages in swap cache
[177690.899712] Swap cache stats: add 0, delete 0, find 0/0
[177690.905198] Free swap  = 0kB
[177690.908261] Total swap = 0kB
[177690.911569] 16384 pages RAM
[177690.914543] 0 pages HighMem/MovableOnly
[177690.918689] 1513 pages reserved
[177690.922025] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177690.931235] [  524]     0   524      305       19       3       0        0             0 ubusd
[177690.940460] [  525]     0   525      230       10       3       0        0             0 askfirst
[177690.949937] [  542]     0   542      256       12       4       0        0             0 urngd
[177690.959019] [ 1042]     0  1042      311       40       3       0        0             0 logd
[177690.967928] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177690.977382] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177690.986592] [ 1574]     0  1574      330       24       5       0        0             0 uhttpd
[177690.995798] [ 1575]     0  1575      330       22       5       0        0             0 uhttpd
[177691.005171] [ 3076]     0  3076      436       50       3       0        0             0 netifd
[177691.014519] [ 3317]     0  3317      301       10       4       0        0             0 udhcpc
[177691.023977] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177691.033213] [ 3661]     0  3661      259       13       4       0        0             0 alfred
[177691.042425] [ 3822]     0  3822      302       29       5       0        0             0 fastd
[177691.051689] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177691.060843] [ 4660]     0  4660      355       23       3       0        0             0 macnock
[177691.070214] [ 4876]     0  4876      394       36       5       0        0             0 hostapd
[177691.079610] Out of memory: Kill process 3076 (netifd) score 3 or sacrifice child
[177691.087382] Killed process 3317 (udhcpc) total-vm:1204kB, anon-rss:36kB, file-rss:4kB, shmem-rss:0kB
[177691.115686] macnock invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177691.128784] CPU: 0 PID: 4662 Comm: macnock Not tainted 4.14.215 #0
[177691.135457] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82ed7b84 82ea595c 804f1987
[177691.144442]         804b4c30 00001236 80643670 00200000 ffffffff 00000001 82ed7b38 b8cac7fa
[177691.153470]         00000000 00000000 80640000 0000a7f0 00000000 00000000 00000007 00000000
[177691.162508]         00000238 fc69b0f8 00000237 6d3a206d 80000000 83999680 82ed7d20 804bcd98
[177691.171497]         00000003 00200000 ffffffff 00000028 00000010 8026a754 00000000 80640000
[177691.180490]         ...
[177691.183119] Call Trace:
[177691.186055] [<8006aa9c>] show_stack+0x58/0x100
[177691.191509] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177691.197004] [<800f6e24>] oom_kill_process+0xd0/0x460
[177691.202298] [<800f79ec>] out_of_memory+0x3b0/0x420
[177691.207340] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177691.213411] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177691.218461] [<8011b1c0>] __do_fault+0x110/0x18c
[177691.223352] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177691.228579] [<80071d40>] __do_page_fault+0x120/0x468
[177691.234589] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177691.240571] Mem-Info:
[177691.243032] active_anon:344 inactive_anon:5 isolated_anon:0
[177691.243032]  active_file:50 inactive_file:64 isolated_file:0
[177691.243032]  unevictable:0 dirty:0 writeback:0 unstable:0
[177691.243032]  slab_reclaimable:212 slab_unreclaimable:1824
[177691.243032]  mapped:16 shmem:24 pagetables:62 bounce:0
[177691.243032]  free:1997 free_pcp:15 free_cma:0
[177691.276797] Node 0 active_anon:1376kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:64kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177691.300051] Normal free:7988kB min:8192kB low:10240kB high:12288kB active_anon:1376kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:368kB pagetables:248kB bounce:0kB free_pcp:60kB local_pcp:60kB free_cma:0kB
[177691.329091] lowmem_reserve[]: 0 0
[177691.332881] Normal: 189*4kB (UM) 208*8kB (UM) 126*16kB (UM) 14*32kB (UM) 8*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8212kB
[177691.348006] 138 total pagecache pages
[177691.352005] 0 pages in swap cache
[177691.355718] Swap cache stats: add 0, delete 0, find 0/0
[177691.361759] Free swap  = 0kB
[177691.364896] Total swap = 0kB
[177691.368205] 16384 pages RAM
[177691.371371] 0 pages HighMem/MovableOnly
[177691.375428] 1513 pages reserved
[177691.378814] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177691.387848] [  524]     0   524      305       19       3       0        0             0 ubusd
[177691.397021] [  525]     0   525      230       10       3       0        0             0 askfirst
[177691.406458] [  542]     0   542      256       12       4       0        0             0 urngd
[177691.415654] [ 1042]     0  1042      311       40       3       0        0             0 logd
[177691.425127] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177691.434834] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177691.444282] [ 1574]     0  1574      330       24       5       0        0             0 uhttpd
[177691.453646] [ 1575]     0  1575      330       22       5       0        0             0 uhttpd
[177691.462933] [ 3076]     0  3076      436       50       3       0        0             0 netifd
[177691.472387] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177691.481712] [ 3661]     0  3661      259       13       4       0        0             0 alfred
[177691.491054] [ 3822]     0  3822      302       29       5       0        0             0 fastd
[177691.500211] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177691.509424] [ 4660]     0  4660      355       23       3       0        0             0 macnock
[177691.519068] [ 4876]     0  4876      394       36       5       0        0             0 hostapd
[177691.528362] Out of memory: Kill process 3076 (netifd) score 3 or sacrifice child
[177691.536247] Killed process 3076 (netifd) total-vm:1744kB, anon-rss:160kB, file-rss:40kB, shmem-rss:0kB
[177691.740793] procd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177691.753710] CPU: 0 PID: 1 Comm: procd Not tainted 4.14.215 #0
[177691.760124] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 83825b84 838202dc 804f1987
[177691.769057]         804b4c30 00000001 80643670 00200000 ffffffff 00000001 83825b38 e9938325
[177691.777793]         00000000 00000000 80640000 0000ba10 00000000 00000000 00000007 00000000
[177691.786904]         0000026b a1b29e5e 0000026a 70726f63 80000000 83998b40 83825d20 804bcd98
[177691.796029]         00000002 00200000 ffffffff 00000028 00000001 8026a754 8806e018 00000010
[177691.804959]         ...
[177691.807586] Call Trace:
[177691.810442] [<8006aa9c>] show_stack+0x58/0x100
[177691.815135] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177691.820687] [<800f6e24>] oom_kill_process+0xd0/0x460
[177691.826011] [<800f79ec>] out_of_memory+0x3b0/0x420
[177691.831284] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177691.837356] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177691.842617] [<8011b1c0>] __do_fault+0x110/0x18c
[177691.847395] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177691.852704] [<80071d40>] __do_page_fault+0x120/0x468
[177691.858043] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177691.863678] Mem-Info:
[177691.866210] active_anon:304 inactive_anon:5 isolated_anon:0
[177691.866210]  active_file:65 inactive_file:97 isolated_file:0
[177691.866210]  unevictable:0 dirty:0 writeback:0 unstable:0
[177691.866210]  slab_reclaimable:206 slab_unreclaimable:1818
[177691.866210]  mapped:4 shmem:24 pagetables:59 bounce:0
[177691.866210]  free:2030 free_pcp:15 free_cma:0
[177691.899495] Node 0 active_anon:1216kB inactive_anon:20kB active_file:260kB inactive_file:388kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:16kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177691.922551] Normal free:8120kB min:8192kB low:10240kB high:12288kB active_anon:1216kB inactive_anon:20kB active_file:260kB inactive_file:388kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:368kB pagetables:236kB bounce:0kB free_pcp:60kB local_pcp:60kB free_cma:0kB
[177691.951077] lowmem_reserve[]: 0 0
[177691.954603] Normal: 200*4kB (UM) 181*8kB (UM) 125*16kB (UM) 15*32kB (UM) 9*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8120kB
[177691.969800] 186 total pagecache pages
[177691.973934] 0 pages in swap cache
[177691.977509] Swap cache stats: add 0, delete 0, find 0/0
[177691.983121] Free swap  = 0kB
[177691.986191] Total swap = 0kB
[177691.989277] 16384 pages RAM
[177691.992251] 0 pages HighMem/MovableOnly
[177691.996463] 1513 pages reserved
[177691.999900] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177692.008893] [  524]     0   524      305       21       3       0        0             0 ubusd
[177692.017967] [  525]     0   525      230       10       3       0        0             0 askfirst
[177692.027321] [  542]     0   542      256       12       4       0        0             0 urngd
[177692.036437] [ 1042]     0  1042      311       33       3       0        0             0 logd
[177692.045582] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177692.054969] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177692.064335] [ 1574]     0  1574      330       24       5       0        0             0 uhttpd
[177692.073599] [ 1575]     0  1575      330       22       5       0        0             0 uhttpd
[177692.082773] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177692.092201] [ 3661]     0  3661      259       13       4       0        0             0 alfred
[177692.101502] [ 3822]     0  3822      302       27       5       0        0             0 fastd
[177692.110828] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177692.119966] [ 4660]     0  4660      355       17       3       0        0             0 macnock
[177692.129270] [ 4876]     0  4876      394       36       5       0        0             0 hostapd
[177692.138484] Out of memory: Kill process 4876 (hostapd) score 2 or sacrifice child
[177692.146417] Killed process 4876 (hostapd) total-vm:1576kB, anon-rss:140kB, file-rss:4kB, shmem-rss:0kB
[177692.837114] oom_reaper: reaped process 4876 (hostapd), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
[177692.974359] kthreadd invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null),  order=1, oom_score_adj=0
[177692.987175] CPU: 0 PID: 2 Comm: kthreadd Not tainted 4.14.215 #0
[177692.993576] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 83831c14 8382087c 804f1987
[177693.002532]         804b4c30 00000002 80643670 00200000 ffffffff 00000001 83831bc8 16409e7f
[177693.011485]         00000000 00000000 80640000 0000cc28 00000000 00000000 00000007 00000000
[177693.020349]         0000029e 636ce020 0000029d 6b746872 00000000 8399ad00 83831db0 804bcd98
[177693.029170]         00000002 00200000 ffffffff 00000014 00000000 8026a754 00000000 80640000
[177693.038039]         ...
[177693.040700] Call Trace:
[177693.043343] [<8006aa9c>] show_stack+0x58/0x100
[177693.048045] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177693.053758] [<800f6e24>] oom_kill_process+0xd0/0x460
[177693.059091] [<800f79ec>] out_of_memory+0x3b0/0x420
[177693.064283] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177693.071775] [<80083098>] copy_process.part.94+0xe8/0x144c
[177693.077450] [<800845b0>] _do_fork+0x100/0x2f8
[177693.082109] [<800847d8>] kernel_thread+0x30/0x3c
[177693.086997] [<800a0bf0>] kthreadd+0xc8/0x120
[177693.091521] [<80065558>] ret_from_kernel_thread+0x14/0x1c
[177693.097487] Mem-Info:
[177693.099984] active_anon:269 inactive_anon:5 isolated_anon:0
[177693.099984]  active_file:45 inactive_file:130 isolated_file:0
[177693.099984]  unevictable:0 dirty:0 writeback:0 unstable:0
[177693.099984]  slab_reclaimable:203 slab_unreclaimable:1787
[177693.099984]  mapped:2 shmem:24 pagetables:54 bounce:0
[177693.099984]  free:2045 free_pcp:15 free_cma:0
[177693.133516] Node 0 active_anon:1076kB inactive_anon:20kB active_file:180kB inactive_file:520kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:8kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177693.156666] Normal free:8212kB min:8192kB low:10240kB high:12288kB active_anon:1076kB inactive_anon:20kB active_file:180kB inactive_file:520kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:376kB pagetables:216kB bounce:0kB free_pcp:60kB local_pcp:60kB free_cma:0kB
[177693.185030] lowmem_reserve[]: 0 0
[177693.188598] Normal: 221*4kB (UE) 194*8kB (UE) 125*16kB (UE) 11*32kB (UME) 9*64kB (UE) 6*128kB (ME) 2*256kB (M) 3*512kB (ME) 0*1024kB 0*2048kB 0*4096kB = 8180kB
[177693.203827] 199 total pagecache pages
[177693.207728] 0 pages in swap cache
[177693.211404] Swap cache stats: add 0, delete 0, find 0/0
[177693.217011] Free swap  = 0kB
[177693.220115] Total swap = 0kB
[177693.223246] 16384 pages RAM
[177693.226344] 0 pages HighMem/MovableOnly
[177693.230619] 1513 pages reserved
[177693.233957] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177693.243308] [  524]     0   524      305       19       3       0        0             0 ubusd
[177693.252595] [  525]     0   525      230       10       3       0        0             0 askfirst
[177693.262808] [  542]     0   542      256       12       4       0        0             0 urngd
[177693.271924] [ 1042]     0  1042      311       33       3       0        0             0 logd
[177693.280899] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177693.290293] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177693.299573] [ 1574]     0  1574      330       24       5       0        0             0 uhttpd
[177693.309194] [ 1575]     0  1575      330       22       5       0        0             0 uhttpd
[177693.318735] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177693.327921] [ 3661]     0  3661      259       13       4       0        0             0 alfred
[177693.337219] [ 3822]     0  3822      302       27       5       0        0             0 fastd
[177693.346427] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177693.355518] [ 4660]     0  4660      355       17       3       0        0             0 macnock
[177693.365019] Out of memory: Kill process 1042 (logd) score 2 or sacrifice child
[177693.372975] Killed process 1042 (logd) total-vm:1244kB, anon-rss:128kB, file-rss:4kB, shmem-rss:0kB
[177694.024404] macnock invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177694.038948] CPU: 0 PID: 4663 Comm: macnock Not tainted 4.14.215 #0
[177694.045484] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dc3b84 8391195c 804f1987
[177694.054433]         804b4c30 00001237 80643670 00200000 ffffffff 00000001 82dc3b38 71c854f1
[177694.063290]         00000000 00000000 80640000 0000dd70 00000000 00000000 00000007 00000000
[177694.072175]         000002cf 329a8e28 000002ce 6d3a206d 80000000 8399b2a0 82dc3d20 804bcd98
[177694.081100]         00000002 00200000 ffffffff 00000014 00000010 8026a754 00000000 80640000
[177694.090024]         ...
[177694.092734] Call Trace:
[177694.095381] [<8006aa9c>] show_stack+0x58/0x100
[177694.100168] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177694.105738] [<800f6e24>] oom_kill_process+0xd0/0x460
[177694.111000] [<800f79ec>] out_of_memory+0x3b0/0x420
[177694.116043] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177694.121996] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177694.127086] [<8011b1c0>] __do_fault+0x110/0x18c
[177694.131908] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177694.137187] [<80071d40>] __do_page_fault+0x120/0x468
[177694.142744] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177694.148497] Mem-Info:
[177694.150985] active_anon:237 inactive_anon:5 isolated_anon:0
[177694.150985]  active_file:61 inactive_file:131 isolated_file:0
[177694.150985]  unevictable:0 dirty:0 writeback:0 unstable:0
[177694.150985]  slab_reclaimable:202 slab_unreclaimable:1814
[177694.150985]  mapped:2 shmem:24 pagetables:51 bounce:0
[177694.150985]  free:2032 free_pcp:6 free_cma:0
[177694.184462] Node 0 active_anon:948kB inactive_anon:20kB active_file:244kB inactive_file:524kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:8kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177694.207643] Normal free:8096kB min:8192kB low:10240kB high:12288kB active_anon:948kB inactive_anon:20kB active_file:244kB inactive_file:524kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:400kB pagetables:204kB bounce:0kB free_pcp:24kB local_pcp:24kB free_cma:0kB
[177694.235887] lowmem_reserve[]: 0 0
[177694.239645] Normal: 222*4kB (UM) 187*8kB (UM) 119*16kB (U) 16*32kB (UM) 8*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8128kB
[177694.254340] 216 total pagecache pages
[177694.258215] 0 pages in swap cache
[177694.261744] Swap cache stats: add 0, delete 0, find 0/0
[177694.267405] Free swap  = 0kB
[177694.270558] Total swap = 0kB
[177694.273621] 16384 pages RAM
[177694.276693] 0 pages HighMem/MovableOnly
[177694.280858] 1513 pages reserved
[177694.284241] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177694.293422] [  524]     0   524      305       19       3       0        0             0 ubusd
[177694.302669] [  525]     0   525      230       10       3       0        0             0 askfirst
[177694.312206] [  542]     0   542      256       12       4       0        0             0 urngd
[177694.321291] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177694.330664] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177694.339981] [ 1574]     0  1574      330       24       5       0        0             0 uhttpd
[177694.349224] [ 1575]     0  1575      330       22       5       0        0             0 uhttpd
[177694.358373] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177694.367725] [ 3661]     0  3661      259       13       4       0        0             0 alfred
[177694.376974] [ 3822]     0  3822      302       27       5       0        0             0 fastd
[177694.386378] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177694.395494] [ 4660]     0  4660      355       17       3       0        0             0 macnock
[177694.405009] Out of memory: Kill process 3822 (fastd) score 2 or sacrifice child
[177694.413096] Killed process 3822 (fastd) total-vm:1208kB, anon-rss:104kB, file-rss:4kB, shmem-rss:0kB
[177695.322738] oom_reaper: reaped process 3822 (fastd), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
[177695.349141] batman_adv: bat0: Interface deactivated: fffVPN
[177695.417919] batman_adv: bat0: Removing interface: fffVPN
[177702.636697] procd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177702.649849] CPU: 0 PID: 1 Comm: procd Not tainted 4.14.215 #0
[177702.656606] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 83825b84 838202dc 804f1987
[177702.665710]         804b4c30 00000001 80643670 00200000 ffffffff 00000001 83825b38 e9938325
[177702.675134]         00000000 00000000 80640000 0000ef28 00000000 00000000 00000007 00000000
[177702.684350]         00000302 fd6db7c1 00000301 70726f63 80000000 839750e0 83825d20 804bcd98
[177702.693533]         00000001 00200000 ffffffff 00000014 00000001 8026a754 00000000 80640000
[177702.702459]         ...
[177702.705264] Call Trace:
[177702.708917] [<8006aa9c>] show_stack+0x58/0x100
[177702.713985] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177702.719903] [<800f6e24>] oom_kill_process+0xd0/0x460
[177702.725437] [<800f79ec>] out_of_memory+0x3b0/0x420
[177702.730814] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177702.736875] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177702.742214] [<8011b1c0>] __do_fault+0x110/0x18c
[177702.747059] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177702.752471] [<80071d40>] __do_page_fault+0x120/0x468
[177702.758032] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177702.763759] Mem-Info:
[177702.766260] active_anon:211 inactive_anon:5 isolated_anon:0
[177702.766260]  active_file:21 inactive_file:81 isolated_file:0
[177702.766260]  unevictable:0 dirty:0 writeback:0 unstable:0
[177702.766260]  slab_reclaimable:200 slab_unreclaimable:1682
[177702.766260]  mapped:2 shmem:24 pagetables:46 bounce:0
[177702.766260]  free:2009 free_pcp:2 free_cma:0
[177702.799969] Node 0 active_anon:844kB inactive_anon:20kB active_file:84kB inactive_file:324kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:8kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177702.823114] Normal free:7972kB min:8192kB low:10240kB high:12288kB active_anon:844kB inactive_anon:20kB active_file:84kB inactive_file:324kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:344kB pagetables:184kB bounce:0kB free_pcp:8kB local_pcp:8kB free_cma:0kB
[177702.851535] lowmem_reserve[]: 0 0
[177702.855102] Normal: 241*4kB (U) 198*8kB (U) 125*16kB (U) 6*32kB (M) 4*64kB (UM) 9*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 7940kB
[177702.869929] 126 total pagecache pages
[177702.874068] 0 pages in swap cache
[177702.877587] Swap cache stats: add 0, delete 0, find 0/0
[177702.883232] Free swap  = 0kB
[177702.886413] Total swap = 0kB
[177702.889525] 16384 pages RAM
[177702.892501] 0 pages HighMem/MovableOnly
[177702.896586] 1513 pages reserved
[177702.900096] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177702.909125] [  524]     0   524      305       19       3       0        0             0 ubusd
[177702.918278] [  525]     0   525      230       10       3       0        0             0 askfirst
[177702.927904] [  542]     0   542      256       12       4       0        0             0 urngd
[177702.937459] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177702.946894] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177702.956361] [ 1574]     0  1574      330       24       5       0        0             0 uhttpd
[177702.965806] [ 1575]     0  1575      330       22       5       0        0             0 uhttpd
[177702.975046] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177702.984309] [ 3661]     0  3661      259       13       4       0        0             0 alfred
[177702.993673] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177703.002678] [ 4660]     0  4660      355       17       3       0        0             0 macnock
[177703.012206] Out of memory: Kill process 1574 (uhttpd) score 1 or sacrifice child
[177703.020034] Killed process 1574 (uhttpd) total-vm:1320kB, anon-rss:92kB, file-rss:4kB, shmem-rss:0kB
[177703.120099] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177703.132881] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0
[177703.139346] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987
[177703.148345]         804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af
[177703.157452]         00000000 00000000 80640000 0000ff88 00000000 00000000 00000007 00000000
[177703.166358]         00000331 5646395e 00000330 6d3a206e 80000000 839772a0 82dffd20 804bcd98
[177703.175419]         00000001 00200000 ffffffff 00000015 00000003 8026a754 00000000 80640000
[177703.184687]         ...
[177703.187631] Call Trace:
[177703.190378] [<8006aa9c>] show_stack+0x58/0x100
[177703.195127] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177703.201334] [<800f6e24>] oom_kill_process+0xd0/0x460
[177703.206670] [<800f79ec>] out_of_memory+0x3b0/0x420
[177703.211837] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177703.217829] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177703.222939] [<8011b1c0>] __do_fault+0x110/0x18c
[177703.227943] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177703.233348] [<80071d40>] __do_page_fault+0x120/0x468
[177703.238654] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177703.244487] Mem-Info:
[177703.246966] active_anon:188 inactive_anon:5 isolated_anon:0
[177703.246966]  active_file:26 inactive_file:27 isolated_file:0
[177703.246966]  unevictable:0 dirty:0 writeback:0 unstable:0
[177703.246966]  slab_reclaimable:200 slab_unreclaimable:1691
[177703.246966]  mapped:4 shmem:24 pagetables:41 bounce:0
[177703.246966]  free:2040 free_pcp:6 free_cma:0
[177703.280738] Node 0 active_anon:752kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:16kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177703.304004] Normal free:8128kB min:8192kB low:10240kB high:12288kB active_anon:752kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:344kB pagetables:164kB bounce:0kB free_pcp:24kB local_pcp:24kB free_cma:0kB
[177703.332453] lowmem_reserve[]: 0 0
[177703.335980] Normal: 242*4kB (UM) 197*8kB (UM) 133*16kB (UM) 8*32kB (UM) 5*64kB (UM) 8*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8064kB
[177703.351054] 77 total pagecache pages
[177703.354840] 0 pages in swap cache
[177703.358353] Swap cache stats: add 0, delete 0, find 0/0
[177703.364058] Free swap  = 0kB
[177703.367123] Total swap = 0kB
[177703.370230] 16384 pages RAM
[177703.373198] 0 pages HighMem/MovableOnly
[177703.377239] 1513 pages reserved
[177703.380850] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177703.390121] [  524]     0   524      305       19       3       0        0             0 ubusd
[177703.399446] [  525]     0   525      230       10       3       0        0             0 askfirst
[177703.408858] [  542]     0   542      256       12       4       0        0             0 urngd
[177703.418158] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177703.427560] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177703.437025] [ 1575]     0  1575      330       22       5       0        0             0 uhttpd
[177703.446402] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177703.455809] [ 3661]     0  3661      259       14       4       0        0             0 alfred
[177703.465471] [ 3982]     0  3982      302       11       4       0        0             0 ntpd
[177703.474740] [ 4660]     0  4660      355       18       3       0        0             0 macnock
[177703.484303] Out of memory: Kill process 1575 (uhttpd) score 1 or sacrifice child
[177703.492477] Killed process 1575 (uhttpd) total-vm:1320kB, anon-rss:84kB, file-rss:4kB, shmem-rss:0kB
[177703.551957] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177703.564507] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0
[177703.570833] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987
[177703.580103]         804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af
[177703.589116]         00000000 00000000 80640000 00010f80 00000000 00000000 00000007 00000000
[177703.598144]         0000035f 54056e94 0000035e 6d3a206e 80000000 83912760 82dffd20 804bcd98
[177703.607267]         00000001 00200000 ffffffff 00000015 00000003 8026a754 00000000 80640000
[177703.616488]         ...
[177703.619225] Call Trace:
[177703.621867] [<8006aa9c>] show_stack+0x58/0x100
[177703.626555] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177703.632171] [<800f6e24>] oom_kill_process+0xd0/0x460
[177703.637535] [<800f79ec>] out_of_memory+0x3b0/0x420
[177703.642736] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177703.648649] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177703.653756] [<8011b1c0>] __do_fault+0x110/0x18c
[177703.658904] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177703.664135] [<80071d40>] __do_page_fault+0x120/0x468
[177703.669574] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177703.675325] Mem-Info:
[177703.677782] active_anon:167 inactive_anon:5 isolated_anon:0
[177703.677782]  active_file:26 inactive_file:27 isolated_file:0
[177703.677782]  unevictable:0 dirty:0 writeback:0 unstable:0
[177703.677782]  slab_reclaimable:200 slab_unreclaimable:1699
[177703.677782]  mapped:4 shmem:24 pagetables:36 bounce:0
[177703.677782]  free:1999 free_pcp:17 free_cma:0
[177703.711398] Node 0 active_anon:668kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:16kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177703.734898] Normal free:7932kB min:8192kB low:10240kB high:12288kB active_anon:668kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:344kB pagetables:144kB bounce:0kB free_pcp:68kB local_pcp:68kB free_cma:0kB
[177703.763868] lowmem_reserve[]: 0 0
[177703.767404] Normal: 243*4kB (UM) 196*8kB (UM) 137*16kB (UM) 8*32kB (UM) 4*64kB (M) 7*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 7932kB
[177703.782433] 77 total pagecache pages
[177703.786464] 0 pages in swap cache
[177703.790134] Swap cache stats: add 0, delete 0, find 0/0
[177703.795972] Free swap  = 0kB
[177703.799177] Total swap = 0kB
[177703.802286] 16384 pages RAM
[177703.805258] 0 pages HighMem/MovableOnly
[177703.809405] 1513 pages reserved
[177703.812779] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177703.821883] [  524]     0   524      305       19       3       0        0             0 ubusd
[177703.831369] [  525]     0   525      230       10       3       0        0             0 askfirst
[177703.840999] [  542]     0   542      256       12       4       0        0             0 urngd
[177703.850217] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177703.859588] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177703.869048] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177703.878396] [ 3661]     0  3661      259       14       4       0        0             0 alfred
[177703.887626] [ 3982]     0  3982      302       11       4       0        0             0 ntpd
[177703.896632] [ 4660]     0  4660      355       18       3       0        0             0 macnock
[177703.906095] Out of memory: Kill process 524 (ubusd) score 1 or sacrifice child
[177703.913950] Killed process 524 (ubusd) total-vm:1220kB, anon-rss:72kB, file-rss:4kB, shmem-rss:0kB
[177704.000357] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177704.013048] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0
[177704.019342] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987
[177704.028106]         804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af
[177704.037190]         00000000 00000000 80640000 00011f08 00000000 00000000 00000007 00000000
[177704.046003]         0000038c 35306150 0000038b 6d3a206e 80000000 82ea50e0 82dffd20 804bcd98
[177704.054809]         00000001 00200000 ffffffff 00000015 00000003 8026a754 00000000 80640000
[177704.063900]         ...
[177704.066533] Call Trace:
[177704.069363] [<8006aa9c>] show_stack+0x58/0x100
[177704.074072] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177704.079592] [<800f6e24>] oom_kill_process+0xd0/0x460
[177704.085144] [<800f79ec>] out_of_memory+0x3b0/0x420
[177704.090239] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177704.096166] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177704.101291] [<8011b1c0>] __do_fault+0x110/0x18c
[177704.106204] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177704.111890] [<80071d40>] __do_page_fault+0x120/0x468
[177704.117197] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177704.122921] Mem-Info:
[177704.125442] active_anon:149 inactive_anon:5 isolated_anon:0
[177704.125442]  active_file:26 inactive_file:27 isolated_file:0
[177704.125442]  unevictable:0 dirty:0 writeback:0 unstable:0
[177704.125442]  slab_reclaimable:198 slab_unreclaimable:1699
[177704.125442]  mapped:4 shmem:24 pagetables:33 bounce:0
[177704.125442]  free:1991 free_pcp:16 free_cma:0
[177704.158774] Node 0 active_anon:596kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:16kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177704.181998] Normal free:7932kB min:8192kB low:10240kB high:12288kB active_anon:596kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:344kB pagetables:132kB bounce:0kB free_pcp:64kB local_pcp:64kB free_cma:0kB
[177704.210723] lowmem_reserve[]: 0 0
[177704.214291] Normal: 239*4kB (UM) 198*8kB (UM) 131*16kB (UM) 14*32kB (UM) 5*64kB (UM) 6*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 7964kB
[177704.229993] 77 total pagecache pages
[177704.234111] 0 pages in swap cache
[177704.237994] Swap cache stats: add 0, delete 0, find 0/0
[177704.243888] Free swap  = 0kB
[177704.246951] Total swap = 0kB
[177704.250112] 16384 pages RAM
[177704.253867] 0 pages HighMem/MovableOnly
[177704.257918] 1513 pages reserved
[177704.261490] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177704.270781] [  525]     0   525      230       10       3       0        0             0 askfirst
[177704.280482] [  542]     0   542      256       12       4       0        0             0 urngd
[177704.289882] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177704.299487] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177704.309092] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177704.318723] [ 3661]     0  3661      259       14       4       0        0             0 alfred
[177704.328105] [ 3982]     0  3982      302       11       4       0        0             0 ntpd
[177704.337120] [ 4660]     0  4660      355       18       3       0        0             0 macnock
[177704.346386] Out of memory: Kill process 4660 (macnock) score 1 or sacrifice child
[177704.354270] Killed process 4660 (macnock) total-vm:1420kB, anon-rss:64kB, file-rss:8kB, shmem-rss:0kB
[177704.431182] oom_reaper: reaped process 4660 (macnock), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
[177704.444850] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177704.457877] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0
[177704.464360] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987
[177704.473623]         804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af
[177704.482475]         00000000 00000000 80640000 00012ea0 00000000 00000000 00000007 00000000
[177704.491246]         000003b9 e27fe668 000003b8 6d3a206e 80000000 83910000 82dffd20 804bcd98
[177704.500252]         00000001 00200000 ffffffff 0000000e 00000003 8026a754 00000000 80640000
[177704.509152]         ...
[177704.511924] Call Trace:
[177704.514748] [<8006aa9c>] show_stack+0x58/0x100
[177704.519578] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177704.525207] [<800f6e24>] oom_kill_process+0xd0/0x460
[177704.530700] [<800f79ec>] out_of_memory+0x3b0/0x420
[177704.536199] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177704.542287] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177704.547702] [<8011b1c0>] __do_fault+0x110/0x18c
[177704.552829] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177704.558066] [<80071d40>] __do_page_fault+0x120/0x468
[177704.563548] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177704.569428] Mem-Info:
[177704.571964] active_anon:133 inactive_anon:5 isolated_anon:0
[177704.571964]  active_file:25 inactive_file:65 isolated_file:0
[177704.571964]  unevictable:0 dirty:0 writeback:0 unstable:0
[177704.571964]  slab_reclaimable:198 slab_unreclaimable:1683
[177704.571964]  mapped:2 shmem:24 pagetables:33 bounce:0
[177704.571964]  free:2044 free_pcp:16 free_cma:0
[177704.605723] Node 0 active_anon:532kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:8kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177704.629277] Normal free:8176kB min:8192kB low:10240kB high:12288kB active_anon:532kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:328kB pagetables:132kB bounce:0kB free_pcp:60kB local_pcp:60kB free_cma:0kB
[177704.659346] lowmem_reserve[]: 0 0
[177704.662875] Normal: 246*4kB (UM) 201*8kB (UM) 129*16kB (UM) 18*32kB (UM) 5*64kB (UM) 6*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8112kB
[177704.677921] 114 total pagecache pages
[177704.681924] 0 pages in swap cache
[177704.685538] Swap cache stats: add 0, delete 0, find 0/0
[177704.691064] Free swap  = 0kB
[177704.694672] Total swap = 0kB
[177704.697832] 16384 pages RAM
[177704.700841] 0 pages HighMem/MovableOnly
[177704.704887] 1513 pages reserved
[177704.708261] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177704.717683] [  525]     0   525      230       10       3       0        0             0 askfirst
[177704.727015] [  542]     0   542      256       12       4       0        0             0 urngd
[177704.736079] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177704.745532] [ 1374]     0  1374      250       14       3       0        0             0 micrond
[177704.755029] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177704.764198] [ 3661]     0  3661      259       13       4       0        0             0 alfred
[177704.773573] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177704.782646] [ 4662]     0  4660      355        0       3       0        0             0 macnock
[177704.792283] Out of memory: Kill process 1374 (micrond) score 1 or sacrifice child
[177704.800429] Killed process 1374 (micrond) total-vm:1000kB, anon-rss:48kB, file-rss:4kB, shmem-rss:4kB
[177704.870551] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177704.883340] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0
[177704.889799] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987
[177704.899796]         804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af
[177704.908840]         00000000 00000000 80640000 00013dd8 00000000 00000000 00000007 00000000
[177704.917627]         000003e5 929b53aa 000003e4 6d3a206e 80000000 82ea61c0 82dffd20 804bcd98
[177704.926449]         00000001 00200000 ffffffff 0000000e 00000003 8026a754 00000000 80640000
[177704.935278]         ...
[177704.938116] Call Trace:
[177704.940798] [<8006aa9c>] show_stack+0x58/0x100
[177704.945779] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177704.951462] [<800f6e24>] oom_kill_process+0xd0/0x460
[177704.956992] [<800f79ec>] out_of_memory+0x3b0/0x420
[177704.962508] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177704.968729] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177704.973780] [<8011b1c0>] __do_fault+0x110/0x18c
[177704.978653] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177704.984790] [<80071d40>] __do_page_fault+0x120/0x468
[177704.990254] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177704.995967] Mem-Info:
[177704.998553] active_anon:121 inactive_anon:5 isolated_anon:0
[177704.998553]  active_file:25 inactive_file:65 isolated_file:0
[177704.998553]  unevictable:0 dirty:0 writeback:0 unstable:0
[177704.998553]  slab_reclaimable:198 slab_unreclaimable:1690
[177704.998553]  mapped:1 shmem:24 pagetables:30 bounce:0
[177704.998553]  free:2011 free_pcp:17 free_cma:0
[177705.032257] Node 0 active_anon:484kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:4kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177705.055715] Normal free:8044kB min:8192kB low:10240kB high:12288kB active_anon:484kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:328kB pagetables:120kB bounce:0kB free_pcp:68kB local_pcp:68kB free_cma:0kB
[177705.083993] lowmem_reserve[]: 0 0
[177705.089224] Normal: 241*4kB (UM) 197*8kB (UM) 128*16kB (UM) 15*32kB (UM) 6*64kB (UM) 6*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8012kB
[177705.104520] 114 total pagecache pages
[177705.108394] 0 pages in swap cache
[177705.112059] Swap cache stats: add 0, delete 0, find 0/0
[177705.117762] Free swap  = 0kB
[177705.120890] Total swap = 0kB
[177705.124043] 16384 pages RAM
[177705.127020] 0 pages HighMem/MovableOnly
[177705.131104] 1513 pages reserved
[177705.134430] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177705.143582] [  525]     0   525      230       10       3       0        0             0 askfirst
[177705.153177] [  542]     0   542      256       12       4       0        0             0 urngd
[177705.162679] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177705.172291] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177705.182230] [ 3661]     0  3661      259       13       4       0        0             0 alfred
[177705.191591] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177705.200642] [ 4662]     0  4660      355        0       3       0        0             0 macnock
[177705.209906] Out of memory: Kill process 3661 (alfred) score 1 or sacrifice child
[177705.217819] Killed process 3661 (alfred) total-vm:1036kB, anon-rss:48kB, file-rss:4kB, shmem-rss:0kB
[177705.248665] oom_reaper: reaped process 3661 (alfred), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
[177705.263932] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177705.276875] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0
[177705.283383] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987
[177705.292286]         804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af
[177705.301296]         00000000 00000000 80640000 00014d08 00000000 00000000 00000007 00000000
[177705.310069]         00000411 99a826ae 00000410 6d3a206e 80000000 839110e0 82dffd20 804bcd98
[177705.318879]         00000001 00200000 ffffffff 0000000e 00000003 8026a754 00000000 80640000
[177705.328553]         ...
[177705.331183] Call Trace:
[177705.333827] [<8006aa9c>] show_stack+0x58/0x100
[177705.340003] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177705.345765] [<800f6e24>] oom_kill_process+0xd0/0x460
[177705.351174] [<800f79ec>] out_of_memory+0x3b0/0x420
[177705.356300] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177705.362237] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177705.367531] [<8011b1c0>] __do_fault+0x110/0x18c
[177705.372744] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177705.378079] [<80071d40>] __do_page_fault+0x120/0x468
[177705.383344] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177705.389108] Mem-Info:
[177705.391560] active_anon:109 inactive_anon:5 isolated_anon:0
[177705.391560]  active_file:25 inactive_file:65 isolated_file:0
[177705.391560]  unevictable:0 dirty:0 writeback:0 unstable:0
[177705.391560]  slab_reclaimable:198 slab_unreclaimable:1695
[177705.391560]  mapped:1 shmem:24 pagetables:26 bounce:0
[177705.391560]  free:2014 free_pcp:17 free_cma:0
[177705.424923] Node 0 active_anon:436kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:4kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[177705.448177] Normal free:8024kB min:8192kB low:10240kB high:12288kB active_anon:436kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:328kB pagetables:104kB bounce:0kB free_pcp:68kB local_pcp:68kB free_cma:0kB
[177705.476560] lowmem_reserve[]: 0 0
[177705.480149] Normal: 238*4kB (UM) 198*8kB (UM) 125*16kB (UM) 13*32kB (UM) 8*64kB (UM) 6*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8024kB
[177705.496424] 114 total pagecache pages
[177705.500597] 0 pages in swap cache
[177705.504112] Swap cache stats: add 0, delete 0, find 0/0
[177705.509839] Free swap  = 0kB
[177705.512909] Total swap = 0kB
[177705.515965] 16384 pages RAM
[177705.519082] 0 pages HighMem/MovableOnly
[177705.523236] 1513 pages reserved
[177705.526578] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177705.535653] [  525]     0   525      230       10       3       0        0             0 askfirst
[177705.545192] [  542]     0   542      256       12       4       0        0             0 urngd
[177705.554564] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177705.564253] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177705.573769] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177705.582950] [ 4662]     0  4660      355        0       3       0        0             0 macnock
[177705.592505] Out of memory: Kill process 542 (urngd) score 1 or sacrifice child
[177705.600502] Killed process 542 (urngd) total-vm:1024kB, anon-rss:44kB, file-rss:4kB, shmem-rss:0kB
[177705.695403] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
[177705.708301] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0
[177705.715653] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987
[177705.725592]         804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af
[177705.735918]         00000000 00000000 80640000 00015b68 00000000 00000000 00000007 00000000
[177705.744939]         0000043b 7c90d744 0000043a 6d3a206e 80000000 82ea6760 82dffd20 804bcd98
[177705.753858]         00000001 00200000 ffffffff 0000000e 00000003 8026a754 00000000 80640000
[177705.762897]         ...
[177705.765767] Call Trace:
[177705.768506] [<8006aa9c>] show_stack+0x58/0x100
[177705.773243] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0
[177705.779015] [<800f6e24>] oom_kill_process+0xd0/0x460
[177705.784539] [<800f79ec>] out_of_memory+0x3b0/0x420
[177705.789789] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80
[177705.795757] [<800f46fc>] filemap_fault+0x3ec/0x6c0
[177705.801008] [<8011b1c0>] __do_fault+0x110/0x18c
[177705.805801] [<8011f63c>] handle_mm_fault+0x6f0/0xa98
[177705.811187] [<80071d40>] __do_page_fault+0x120/0x468
[177705.816428] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114
[177705.822303] Mem-Info:
[177705.824787] active_anon:98 inactive_anon:5 isolated_anon:0
[177705.824787]  active_file:6 inactive_file:22 isolated_file:0
[177705.824787]  unevictable:0 dirty:0 writeback:0 unstable:0
[177705.824787]  slab_reclaimable:195 slab_unreclaimable:1694
[177705.824787]  mapped:2 shmem:24 pagetables:22 bounce:0
[177705.824787]  free:2040 free_pcp:17 free_cma:0
[177705.858377] Node 0 active_anon:392kB inactive_anon:20kB active_file:24kB inactive_file:88kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:8kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[177705.881262] Normal free:8128kB min:8192kB low:10240kB high:12288kB active_anon:392kB inactive_anon:20kB active_file:24kB inactive_file:88kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:328kB pagetables:88kB bounce:0kB free_pcp:68kB local_pcp:68kB free_cma:0kB
[177705.909627] lowmem_reserve[]: 0 0
[177705.913163] Normal: 222*4kB (UM) 191*8kB (UM) 125*16kB (UM) 15*32kB (UM) 10*64kB (UM) 6*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8096kB
[177705.928593] 52 total pagecache pages
[177705.932382] 0 pages in swap cache
[177705.935894] Swap cache stats: add 0, delete 0, find 0/0
[177705.941760] Free swap  = 0kB
[177705.944826] Total swap = 0kB
[177705.947890] 16384 pages RAM
[177705.951258] 0 pages HighMem/MovableOnly
[177705.955308] 1513 pages reserved
[177705.959135] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[177705.968051] [  525]     0   525      230       10       3       0        0             0 askfirst
[177705.978053] [ 1081]     0  1081      267       10       3       0        0             0 dropbear
[177705.987805] [ 3534]     0  3534      232       12       4       0        0             0 uradvd
[177705.997507] [ 3982]     0  3982      302       10       4       0        0             0 ntpd
[177706.006506] [ 4662]     0  4660      355        0       3       0        0             0 macnock
[177706.016070] Out of memory: Kill process 3534 (uradvd) score 1 or sacrifice child
[177706.023985] Killed process 3534 (uradvd) total-vm:928kB, anon-rss:44kB, file-rss:4kB, shmem-rss:0kB

Der oom-killer sollte das System komplett rebooten, sonst bleibt ein node kaputt online und kann eventuell je nach dem welcher service vom oom-killer erwischt wurde nicht mehr remote verwaltet werden. Weiterhin ist das limit nicht optimal gesetzt, auf einem tl-wr1043n-v4 waren noch etwas unter 8MB frei (Normal free:7924kB min:8192kB), aber der oom-killer hat den node unbrauchbar zurückgelassen: ``` [177689.552528] fastd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177689.565363] CPU: 0 PID: 3822 Comm: fastd Not tainted 4.14.215 #0 [177689.571776] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 8320fb84 8399b57c 804f1987 [177689.580702] 804b4c30 00000eee 80643670 00200000 ffffffff 00000001 8320fb38 9592129f [177689.589680] 00000000 00000000 80640000 00006f40 00000000 00000000 00000007 00000000 [177689.598721] 00000199 a4d154d0 00000198 6d3a2066 80000000 83975680 8320fd20 804bcd98 [177689.607872] 00000003 00200000 ffffffff 00000028 00000000 8026a754 00000000 80640000 [177689.616955] ... [177689.619621] Call Trace: [177689.622405] [<8006aa9c>] show_stack+0x58/0x100 [177689.627165] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177689.632948] [<800f6e24>] oom_kill_process+0xd0/0x460 [177689.638255] [<800f79ec>] out_of_memory+0x3b0/0x420 [177689.643364] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177689.649497] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177689.654646] [<8011b1c0>] __do_fault+0x110/0x18c [177689.659779] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177689.665322] [<80071d40>] __do_page_fault+0x120/0x468 [177689.670763] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177689.676342] Mem-Info: [177689.679035] active_anon:418 inactive_anon:5 isolated_anon:0 [177689.679035] active_file:48 inactive_file:121 isolated_file:0 [177689.679035] unevictable:0 dirty:0 writeback:0 unstable:0 [177689.679035] slab_reclaimable:214 slab_unreclaimable:1765 [177689.679035] mapped:9 shmem:24 pagetables:74 bounce:0 [177689.679035] free:1991 free_pcp:0 free_cma:0 [177689.712727] Node 0 active_anon:1672kB inactive_anon:20kB active_file:192kB inactive_file:484kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:36kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177689.735951] Normal free:7924kB min:8192kB low:10240kB high:12288kB active_anon:1672kB inactive_anon:20kB active_file:192kB inactive_file:484kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:368kB pagetables:296kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [177689.764452] lowmem_reserve[]: 0 0 [177689.768078] Normal: 154*4kB (U) 190*8kB (UM) 119*16kB (U) 16*32kB (UM) 8*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 7880kB [177689.782969] 193 total pagecache pages [177689.787095] 0 pages in swap cache [177689.790753] Swap cache stats: add 0, delete 0, find 0/0 [177689.796474] Free swap = 0kB [177689.799697] Total swap = 0kB [177689.802805] 16384 pages RAM [177689.805832] 0 pages HighMem/MovableOnly [177689.809953] 1513 pages reserved [177689.813398] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177689.822734] [ 524] 0 524 305 19 3 0 0 0 ubusd [177689.831886] [ 525] 0 525 230 10 3 0 0 0 askfirst [177689.841359] [ 542] 0 542 256 12 4 0 0 0 urngd [177689.850655] [ 1042] 0 1042 311 33 3 0 0 0 logd [177689.859682] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177689.869078] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177689.878336] [ 1574] 0 1574 330 24 5 0 0 0 uhttpd [177689.887664] [ 1575] 0 1575 330 22 5 0 0 0 uhttpd [177689.897191] [ 1576] 0 1576 514 53 4 0 0 0 uhttpd [177689.906869] [ 3076] 0 3076 436 41 3 0 0 0 netifd [177689.916164] [ 3317] 0 3317 301 10 4 0 0 0 udhcpc [177689.925405] [ 3319] 0 3319 262 14 4 0 0 0 odhcp6c [177689.934799] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177689.944025] [ 3661] 0 3661 259 13 4 0 0 0 alfred [177689.953275] [ 3822] 0 3822 302 29 5 0 0 0 fastd [177689.962456] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177689.971620] [ 4660] 0 4660 355 22 3 0 0 0 macnock [177689.981057] [ 4876] 0 4876 394 36 5 0 0 0 hostapd [177689.990499] Out of memory: Kill process 1576 (uhttpd) score 3 or sacrifice child [177689.998404] Killed process 1576 (uhttpd) total-vm:2056kB, anon-rss:208kB, file-rss:4kB, shmem-rss:0kB [177690.161017] macnock invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177690.174115] CPU: 0 PID: 4663 Comm: macnock Not tainted 4.14.215 #0 [177690.180704] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dc3b84 8391195c 804f1987 [177690.189679] 804b4c30 00001237 80643670 00200000 ffffffff 00000001 82dc3b38 71c854f1 [177690.198617] 00000000 00000000 80640000 00008288 00000000 00000000 00000007 00000000 [177690.207764] 000001cf f510e8af 000001ce 6d3a206d 80000000 83999680 82dc3d20 804bcd98 [177690.217031] 00000003 00200000 ffffffff 00000028 00000010 8026a754 00000000 80640000 [177690.226149] ... [177690.228911] Call Trace: [177690.231788] [<8006aa9c>] show_stack+0x58/0x100 [177690.236609] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177690.242274] [<800f6e24>] oom_kill_process+0xd0/0x460 [177690.247495] [<800f79ec>] out_of_memory+0x3b0/0x420 [177690.252573] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177690.258716] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177690.263782] [<8011b1c0>] __do_fault+0x110/0x18c [177690.268702] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177690.274164] [<80071d40>] __do_page_fault+0x120/0x468 [177690.279605] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177690.285396] Mem-Info: [177690.287917] active_anon:366 inactive_anon:5 isolated_anon:0 [177690.287917] active_file:50 inactive_file:64 isolated_file:0 [177690.287917] unevictable:0 dirty:0 writeback:0 unstable:0 [177690.287917] slab_reclaimable:212 slab_unreclaimable:1790 [177690.287917] mapped:16 shmem:24 pagetables:70 bounce:0 [177690.287917] free:2049 free_pcp:15 free_cma:0 [177690.321581] Node 0 active_anon:1464kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:64kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177690.345166] Normal free:8164kB min:8192kB low:10240kB high:12288kB active_anon:1464kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:368kB pagetables:280kB bounce:0kB free_pcp:60kB local_pcp:60kB free_cma:0kB [177690.373658] lowmem_reserve[]: 0 0 [177690.377330] Normal: 175*4kB (UM) 207*8kB (UM) 125*16kB (UM) 13*32kB (UM) 9*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8164kB [177690.392543] 138 total pagecache pages [177690.396737] 0 pages in swap cache [177690.400452] Swap cache stats: add 0, delete 0, find 0/0 [177690.406080] Free swap = 0kB [177690.409289] Total swap = 0kB [177690.412399] 16384 pages RAM [177690.415438] 0 pages HighMem/MovableOnly [177690.419518] 1513 pages reserved [177690.422877] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177690.432084] [ 524] 0 524 305 19 3 0 0 0 ubusd [177690.441486] [ 525] 0 525 230 10 3 0 0 0 askfirst [177690.450952] [ 542] 0 542 256 12 4 0 0 0 urngd [177690.460061] [ 1042] 0 1042 311 40 3 0 0 0 logd [177690.469058] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177690.478563] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177690.488108] [ 1574] 0 1574 330 24 5 0 0 0 uhttpd [177690.497570] [ 1575] 0 1575 330 22 5 0 0 0 uhttpd [177690.506895] [ 3076] 0 3076 436 50 3 0 0 0 netifd [177690.516198] [ 3317] 0 3317 301 10 4 0 0 0 udhcpc [177690.525629] [ 3319] 0 3319 262 14 4 0 0 0 odhcp6c [177690.535095] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177690.544335] [ 3661] 0 3661 259 13 4 0 0 0 alfred [177690.553642] [ 3822] 0 3822 302 29 5 0 0 0 fastd [177690.562815] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177690.571924] [ 4660] 0 4660 355 23 3 0 0 0 macnock [177690.581288] [ 4876] 0 4876 394 36 5 0 0 0 hostapd [177690.590723] Out of memory: Kill process 3076 (netifd) score 3 or sacrifice child [177690.598789] Killed process 3319 (odhcp6c) total-vm:1048kB, anon-rss:52kB, file-rss:4kB, shmem-rss:0kB [177690.660800] macnock invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177690.673767] CPU: 0 PID: 4662 Comm: macnock Not tainted 4.14.215 #0 [177690.680370] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82ed7b84 82ea595c 804f1987 [177690.689264] 804b4c30 00001236 80643670 00200000 ffffffff 00000001 82ed7b38 b8cac7fa [177690.698323] 00000000 00000000 80640000 00009578 00000000 00000000 00000007 00000000 [177690.707353] 00000204 91ea14cb 00000203 6d3a206d 80000000 83999680 82ed7d20 804bcd98 [177690.716467] 00000003 00200000 ffffffff 00000028 00000010 8026a754 00000000 80640000 [177690.725628] ... [177690.728256] Call Trace: [177690.731073] [<8006aa9c>] show_stack+0x58/0x100 [177690.735941] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177690.741823] [<800f6e24>] oom_kill_process+0xd0/0x460 [177690.747347] [<800f79ec>] out_of_memory+0x3b0/0x420 [177690.752727] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177690.758974] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177690.764070] [<8011b1c0>] __do_fault+0x110/0x18c [177690.769052] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177690.774377] [<80071d40>] __do_page_fault+0x120/0x468 [177690.779710] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177690.785357] Mem-Info: [177690.787816] active_anon:353 inactive_anon:5 isolated_anon:0 [177690.787816] active_file:50 inactive_file:64 isolated_file:0 [177690.787816] unevictable:0 dirty:0 writeback:0 unstable:0 [177690.787816] slab_reclaimable:212 slab_unreclaimable:1824 [177690.787816] mapped:16 shmem:24 pagetables:66 bounce:0 [177690.787816] free:2006 free_pcp:17 free_cma:0 [177690.821386] Node 0 active_anon:1412kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:64kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177690.844846] Normal free:7992kB min:8192kB low:10240kB high:12288kB active_anon:1412kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:368kB pagetables:264kB bounce:0kB free_pcp:68kB local_pcp:68kB free_cma:0kB [177690.873628] lowmem_reserve[]: 0 0 [177690.877154] Normal: 184*4kB (UM) 209*8kB (UM) 125*16kB (UM) 8*32kB (UM) 8*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 7992kB [177690.892126] 138 total pagecache pages [177690.895997] 0 pages in swap cache [177690.899712] Swap cache stats: add 0, delete 0, find 0/0 [177690.905198] Free swap = 0kB [177690.908261] Total swap = 0kB [177690.911569] 16384 pages RAM [177690.914543] 0 pages HighMem/MovableOnly [177690.918689] 1513 pages reserved [177690.922025] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177690.931235] [ 524] 0 524 305 19 3 0 0 0 ubusd [177690.940460] [ 525] 0 525 230 10 3 0 0 0 askfirst [177690.949937] [ 542] 0 542 256 12 4 0 0 0 urngd [177690.959019] [ 1042] 0 1042 311 40 3 0 0 0 logd [177690.967928] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177690.977382] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177690.986592] [ 1574] 0 1574 330 24 5 0 0 0 uhttpd [177690.995798] [ 1575] 0 1575 330 22 5 0 0 0 uhttpd [177691.005171] [ 3076] 0 3076 436 50 3 0 0 0 netifd [177691.014519] [ 3317] 0 3317 301 10 4 0 0 0 udhcpc [177691.023977] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177691.033213] [ 3661] 0 3661 259 13 4 0 0 0 alfred [177691.042425] [ 3822] 0 3822 302 29 5 0 0 0 fastd [177691.051689] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177691.060843] [ 4660] 0 4660 355 23 3 0 0 0 macnock [177691.070214] [ 4876] 0 4876 394 36 5 0 0 0 hostapd [177691.079610] Out of memory: Kill process 3076 (netifd) score 3 or sacrifice child [177691.087382] Killed process 3317 (udhcpc) total-vm:1204kB, anon-rss:36kB, file-rss:4kB, shmem-rss:0kB [177691.115686] macnock invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177691.128784] CPU: 0 PID: 4662 Comm: macnock Not tainted 4.14.215 #0 [177691.135457] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82ed7b84 82ea595c 804f1987 [177691.144442] 804b4c30 00001236 80643670 00200000 ffffffff 00000001 82ed7b38 b8cac7fa [177691.153470] 00000000 00000000 80640000 0000a7f0 00000000 00000000 00000007 00000000 [177691.162508] 00000238 fc69b0f8 00000237 6d3a206d 80000000 83999680 82ed7d20 804bcd98 [177691.171497] 00000003 00200000 ffffffff 00000028 00000010 8026a754 00000000 80640000 [177691.180490] ... [177691.183119] Call Trace: [177691.186055] [<8006aa9c>] show_stack+0x58/0x100 [177691.191509] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177691.197004] [<800f6e24>] oom_kill_process+0xd0/0x460 [177691.202298] [<800f79ec>] out_of_memory+0x3b0/0x420 [177691.207340] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177691.213411] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177691.218461] [<8011b1c0>] __do_fault+0x110/0x18c [177691.223352] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177691.228579] [<80071d40>] __do_page_fault+0x120/0x468 [177691.234589] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177691.240571] Mem-Info: [177691.243032] active_anon:344 inactive_anon:5 isolated_anon:0 [177691.243032] active_file:50 inactive_file:64 isolated_file:0 [177691.243032] unevictable:0 dirty:0 writeback:0 unstable:0 [177691.243032] slab_reclaimable:212 slab_unreclaimable:1824 [177691.243032] mapped:16 shmem:24 pagetables:62 bounce:0 [177691.243032] free:1997 free_pcp:15 free_cma:0 [177691.276797] Node 0 active_anon:1376kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:64kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177691.300051] Normal free:7988kB min:8192kB low:10240kB high:12288kB active_anon:1376kB inactive_anon:20kB active_file:200kB inactive_file:256kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:368kB pagetables:248kB bounce:0kB free_pcp:60kB local_pcp:60kB free_cma:0kB [177691.329091] lowmem_reserve[]: 0 0 [177691.332881] Normal: 189*4kB (UM) 208*8kB (UM) 126*16kB (UM) 14*32kB (UM) 8*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8212kB [177691.348006] 138 total pagecache pages [177691.352005] 0 pages in swap cache [177691.355718] Swap cache stats: add 0, delete 0, find 0/0 [177691.361759] Free swap = 0kB [177691.364896] Total swap = 0kB [177691.368205] 16384 pages RAM [177691.371371] 0 pages HighMem/MovableOnly [177691.375428] 1513 pages reserved [177691.378814] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177691.387848] [ 524] 0 524 305 19 3 0 0 0 ubusd [177691.397021] [ 525] 0 525 230 10 3 0 0 0 askfirst [177691.406458] [ 542] 0 542 256 12 4 0 0 0 urngd [177691.415654] [ 1042] 0 1042 311 40 3 0 0 0 logd [177691.425127] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177691.434834] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177691.444282] [ 1574] 0 1574 330 24 5 0 0 0 uhttpd [177691.453646] [ 1575] 0 1575 330 22 5 0 0 0 uhttpd [177691.462933] [ 3076] 0 3076 436 50 3 0 0 0 netifd [177691.472387] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177691.481712] [ 3661] 0 3661 259 13 4 0 0 0 alfred [177691.491054] [ 3822] 0 3822 302 29 5 0 0 0 fastd [177691.500211] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177691.509424] [ 4660] 0 4660 355 23 3 0 0 0 macnock [177691.519068] [ 4876] 0 4876 394 36 5 0 0 0 hostapd [177691.528362] Out of memory: Kill process 3076 (netifd) score 3 or sacrifice child [177691.536247] Killed process 3076 (netifd) total-vm:1744kB, anon-rss:160kB, file-rss:40kB, shmem-rss:0kB [177691.740793] procd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177691.753710] CPU: 0 PID: 1 Comm: procd Not tainted 4.14.215 #0 [177691.760124] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 83825b84 838202dc 804f1987 [177691.769057] 804b4c30 00000001 80643670 00200000 ffffffff 00000001 83825b38 e9938325 [177691.777793] 00000000 00000000 80640000 0000ba10 00000000 00000000 00000007 00000000 [177691.786904] 0000026b a1b29e5e 0000026a 70726f63 80000000 83998b40 83825d20 804bcd98 [177691.796029] 00000002 00200000 ffffffff 00000028 00000001 8026a754 8806e018 00000010 [177691.804959] ... [177691.807586] Call Trace: [177691.810442] [<8006aa9c>] show_stack+0x58/0x100 [177691.815135] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177691.820687] [<800f6e24>] oom_kill_process+0xd0/0x460 [177691.826011] [<800f79ec>] out_of_memory+0x3b0/0x420 [177691.831284] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177691.837356] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177691.842617] [<8011b1c0>] __do_fault+0x110/0x18c [177691.847395] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177691.852704] [<80071d40>] __do_page_fault+0x120/0x468 [177691.858043] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177691.863678] Mem-Info: [177691.866210] active_anon:304 inactive_anon:5 isolated_anon:0 [177691.866210] active_file:65 inactive_file:97 isolated_file:0 [177691.866210] unevictable:0 dirty:0 writeback:0 unstable:0 [177691.866210] slab_reclaimable:206 slab_unreclaimable:1818 [177691.866210] mapped:4 shmem:24 pagetables:59 bounce:0 [177691.866210] free:2030 free_pcp:15 free_cma:0 [177691.899495] Node 0 active_anon:1216kB inactive_anon:20kB active_file:260kB inactive_file:388kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:16kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177691.922551] Normal free:8120kB min:8192kB low:10240kB high:12288kB active_anon:1216kB inactive_anon:20kB active_file:260kB inactive_file:388kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:368kB pagetables:236kB bounce:0kB free_pcp:60kB local_pcp:60kB free_cma:0kB [177691.951077] lowmem_reserve[]: 0 0 [177691.954603] Normal: 200*4kB (UM) 181*8kB (UM) 125*16kB (UM) 15*32kB (UM) 9*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8120kB [177691.969800] 186 total pagecache pages [177691.973934] 0 pages in swap cache [177691.977509] Swap cache stats: add 0, delete 0, find 0/0 [177691.983121] Free swap = 0kB [177691.986191] Total swap = 0kB [177691.989277] 16384 pages RAM [177691.992251] 0 pages HighMem/MovableOnly [177691.996463] 1513 pages reserved [177691.999900] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177692.008893] [ 524] 0 524 305 21 3 0 0 0 ubusd [177692.017967] [ 525] 0 525 230 10 3 0 0 0 askfirst [177692.027321] [ 542] 0 542 256 12 4 0 0 0 urngd [177692.036437] [ 1042] 0 1042 311 33 3 0 0 0 logd [177692.045582] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177692.054969] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177692.064335] [ 1574] 0 1574 330 24 5 0 0 0 uhttpd [177692.073599] [ 1575] 0 1575 330 22 5 0 0 0 uhttpd [177692.082773] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177692.092201] [ 3661] 0 3661 259 13 4 0 0 0 alfred [177692.101502] [ 3822] 0 3822 302 27 5 0 0 0 fastd [177692.110828] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177692.119966] [ 4660] 0 4660 355 17 3 0 0 0 macnock [177692.129270] [ 4876] 0 4876 394 36 5 0 0 0 hostapd [177692.138484] Out of memory: Kill process 4876 (hostapd) score 2 or sacrifice child [177692.146417] Killed process 4876 (hostapd) total-vm:1576kB, anon-rss:140kB, file-rss:4kB, shmem-rss:0kB [177692.837114] oom_reaper: reaped process 4876 (hostapd), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB [177692.974359] kthreadd invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null), order=1, oom_score_adj=0 [177692.987175] CPU: 0 PID: 2 Comm: kthreadd Not tainted 4.14.215 #0 [177692.993576] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 83831c14 8382087c 804f1987 [177693.002532] 804b4c30 00000002 80643670 00200000 ffffffff 00000001 83831bc8 16409e7f [177693.011485] 00000000 00000000 80640000 0000cc28 00000000 00000000 00000007 00000000 [177693.020349] 0000029e 636ce020 0000029d 6b746872 00000000 8399ad00 83831db0 804bcd98 [177693.029170] 00000002 00200000 ffffffff 00000014 00000000 8026a754 00000000 80640000 [177693.038039] ... [177693.040700] Call Trace: [177693.043343] [<8006aa9c>] show_stack+0x58/0x100 [177693.048045] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177693.053758] [<800f6e24>] oom_kill_process+0xd0/0x460 [177693.059091] [<800f79ec>] out_of_memory+0x3b0/0x420 [177693.064283] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177693.071775] [<80083098>] copy_process.part.94+0xe8/0x144c [177693.077450] [<800845b0>] _do_fork+0x100/0x2f8 [177693.082109] [<800847d8>] kernel_thread+0x30/0x3c [177693.086997] [<800a0bf0>] kthreadd+0xc8/0x120 [177693.091521] [<80065558>] ret_from_kernel_thread+0x14/0x1c [177693.097487] Mem-Info: [177693.099984] active_anon:269 inactive_anon:5 isolated_anon:0 [177693.099984] active_file:45 inactive_file:130 isolated_file:0 [177693.099984] unevictable:0 dirty:0 writeback:0 unstable:0 [177693.099984] slab_reclaimable:203 slab_unreclaimable:1787 [177693.099984] mapped:2 shmem:24 pagetables:54 bounce:0 [177693.099984] free:2045 free_pcp:15 free_cma:0 [177693.133516] Node 0 active_anon:1076kB inactive_anon:20kB active_file:180kB inactive_file:520kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:8kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177693.156666] Normal free:8212kB min:8192kB low:10240kB high:12288kB active_anon:1076kB inactive_anon:20kB active_file:180kB inactive_file:520kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:376kB pagetables:216kB bounce:0kB free_pcp:60kB local_pcp:60kB free_cma:0kB [177693.185030] lowmem_reserve[]: 0 0 [177693.188598] Normal: 221*4kB (UE) 194*8kB (UE) 125*16kB (UE) 11*32kB (UME) 9*64kB (UE) 6*128kB (ME) 2*256kB (M) 3*512kB (ME) 0*1024kB 0*2048kB 0*4096kB = 8180kB [177693.203827] 199 total pagecache pages [177693.207728] 0 pages in swap cache [177693.211404] Swap cache stats: add 0, delete 0, find 0/0 [177693.217011] Free swap = 0kB [177693.220115] Total swap = 0kB [177693.223246] 16384 pages RAM [177693.226344] 0 pages HighMem/MovableOnly [177693.230619] 1513 pages reserved [177693.233957] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177693.243308] [ 524] 0 524 305 19 3 0 0 0 ubusd [177693.252595] [ 525] 0 525 230 10 3 0 0 0 askfirst [177693.262808] [ 542] 0 542 256 12 4 0 0 0 urngd [177693.271924] [ 1042] 0 1042 311 33 3 0 0 0 logd [177693.280899] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177693.290293] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177693.299573] [ 1574] 0 1574 330 24 5 0 0 0 uhttpd [177693.309194] [ 1575] 0 1575 330 22 5 0 0 0 uhttpd [177693.318735] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177693.327921] [ 3661] 0 3661 259 13 4 0 0 0 alfred [177693.337219] [ 3822] 0 3822 302 27 5 0 0 0 fastd [177693.346427] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177693.355518] [ 4660] 0 4660 355 17 3 0 0 0 macnock [177693.365019] Out of memory: Kill process 1042 (logd) score 2 or sacrifice child [177693.372975] Killed process 1042 (logd) total-vm:1244kB, anon-rss:128kB, file-rss:4kB, shmem-rss:0kB [177694.024404] macnock invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177694.038948] CPU: 0 PID: 4663 Comm: macnock Not tainted 4.14.215 #0 [177694.045484] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dc3b84 8391195c 804f1987 [177694.054433] 804b4c30 00001237 80643670 00200000 ffffffff 00000001 82dc3b38 71c854f1 [177694.063290] 00000000 00000000 80640000 0000dd70 00000000 00000000 00000007 00000000 [177694.072175] 000002cf 329a8e28 000002ce 6d3a206d 80000000 8399b2a0 82dc3d20 804bcd98 [177694.081100] 00000002 00200000 ffffffff 00000014 00000010 8026a754 00000000 80640000 [177694.090024] ... [177694.092734] Call Trace: [177694.095381] [<8006aa9c>] show_stack+0x58/0x100 [177694.100168] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177694.105738] [<800f6e24>] oom_kill_process+0xd0/0x460 [177694.111000] [<800f79ec>] out_of_memory+0x3b0/0x420 [177694.116043] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177694.121996] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177694.127086] [<8011b1c0>] __do_fault+0x110/0x18c [177694.131908] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177694.137187] [<80071d40>] __do_page_fault+0x120/0x468 [177694.142744] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177694.148497] Mem-Info: [177694.150985] active_anon:237 inactive_anon:5 isolated_anon:0 [177694.150985] active_file:61 inactive_file:131 isolated_file:0 [177694.150985] unevictable:0 dirty:0 writeback:0 unstable:0 [177694.150985] slab_reclaimable:202 slab_unreclaimable:1814 [177694.150985] mapped:2 shmem:24 pagetables:51 bounce:0 [177694.150985] free:2032 free_pcp:6 free_cma:0 [177694.184462] Node 0 active_anon:948kB inactive_anon:20kB active_file:244kB inactive_file:524kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:8kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177694.207643] Normal free:8096kB min:8192kB low:10240kB high:12288kB active_anon:948kB inactive_anon:20kB active_file:244kB inactive_file:524kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:400kB pagetables:204kB bounce:0kB free_pcp:24kB local_pcp:24kB free_cma:0kB [177694.235887] lowmem_reserve[]: 0 0 [177694.239645] Normal: 222*4kB (UM) 187*8kB (UM) 119*16kB (U) 16*32kB (UM) 8*64kB (U) 6*128kB (UM) 2*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8128kB [177694.254340] 216 total pagecache pages [177694.258215] 0 pages in swap cache [177694.261744] Swap cache stats: add 0, delete 0, find 0/0 [177694.267405] Free swap = 0kB [177694.270558] Total swap = 0kB [177694.273621] 16384 pages RAM [177694.276693] 0 pages HighMem/MovableOnly [177694.280858] 1513 pages reserved [177694.284241] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177694.293422] [ 524] 0 524 305 19 3 0 0 0 ubusd [177694.302669] [ 525] 0 525 230 10 3 0 0 0 askfirst [177694.312206] [ 542] 0 542 256 12 4 0 0 0 urngd [177694.321291] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177694.330664] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177694.339981] [ 1574] 0 1574 330 24 5 0 0 0 uhttpd [177694.349224] [ 1575] 0 1575 330 22 5 0 0 0 uhttpd [177694.358373] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177694.367725] [ 3661] 0 3661 259 13 4 0 0 0 alfred [177694.376974] [ 3822] 0 3822 302 27 5 0 0 0 fastd [177694.386378] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177694.395494] [ 4660] 0 4660 355 17 3 0 0 0 macnock [177694.405009] Out of memory: Kill process 3822 (fastd) score 2 or sacrifice child [177694.413096] Killed process 3822 (fastd) total-vm:1208kB, anon-rss:104kB, file-rss:4kB, shmem-rss:0kB [177695.322738] oom_reaper: reaped process 3822 (fastd), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB [177695.349141] batman_adv: bat0: Interface deactivated: fffVPN [177695.417919] batman_adv: bat0: Removing interface: fffVPN [177702.636697] procd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177702.649849] CPU: 0 PID: 1 Comm: procd Not tainted 4.14.215 #0 [177702.656606] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 83825b84 838202dc 804f1987 [177702.665710] 804b4c30 00000001 80643670 00200000 ffffffff 00000001 83825b38 e9938325 [177702.675134] 00000000 00000000 80640000 0000ef28 00000000 00000000 00000007 00000000 [177702.684350] 00000302 fd6db7c1 00000301 70726f63 80000000 839750e0 83825d20 804bcd98 [177702.693533] 00000001 00200000 ffffffff 00000014 00000001 8026a754 00000000 80640000 [177702.702459] ... [177702.705264] Call Trace: [177702.708917] [<8006aa9c>] show_stack+0x58/0x100 [177702.713985] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177702.719903] [<800f6e24>] oom_kill_process+0xd0/0x460 [177702.725437] [<800f79ec>] out_of_memory+0x3b0/0x420 [177702.730814] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177702.736875] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177702.742214] [<8011b1c0>] __do_fault+0x110/0x18c [177702.747059] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177702.752471] [<80071d40>] __do_page_fault+0x120/0x468 [177702.758032] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177702.763759] Mem-Info: [177702.766260] active_anon:211 inactive_anon:5 isolated_anon:0 [177702.766260] active_file:21 inactive_file:81 isolated_file:0 [177702.766260] unevictable:0 dirty:0 writeback:0 unstable:0 [177702.766260] slab_reclaimable:200 slab_unreclaimable:1682 [177702.766260] mapped:2 shmem:24 pagetables:46 bounce:0 [177702.766260] free:2009 free_pcp:2 free_cma:0 [177702.799969] Node 0 active_anon:844kB inactive_anon:20kB active_file:84kB inactive_file:324kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:8kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177702.823114] Normal free:7972kB min:8192kB low:10240kB high:12288kB active_anon:844kB inactive_anon:20kB active_file:84kB inactive_file:324kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:344kB pagetables:184kB bounce:0kB free_pcp:8kB local_pcp:8kB free_cma:0kB [177702.851535] lowmem_reserve[]: 0 0 [177702.855102] Normal: 241*4kB (U) 198*8kB (U) 125*16kB (U) 6*32kB (M) 4*64kB (UM) 9*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 7940kB [177702.869929] 126 total pagecache pages [177702.874068] 0 pages in swap cache [177702.877587] Swap cache stats: add 0, delete 0, find 0/0 [177702.883232] Free swap = 0kB [177702.886413] Total swap = 0kB [177702.889525] 16384 pages RAM [177702.892501] 0 pages HighMem/MovableOnly [177702.896586] 1513 pages reserved [177702.900096] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177702.909125] [ 524] 0 524 305 19 3 0 0 0 ubusd [177702.918278] [ 525] 0 525 230 10 3 0 0 0 askfirst [177702.927904] [ 542] 0 542 256 12 4 0 0 0 urngd [177702.937459] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177702.946894] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177702.956361] [ 1574] 0 1574 330 24 5 0 0 0 uhttpd [177702.965806] [ 1575] 0 1575 330 22 5 0 0 0 uhttpd [177702.975046] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177702.984309] [ 3661] 0 3661 259 13 4 0 0 0 alfred [177702.993673] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177703.002678] [ 4660] 0 4660 355 17 3 0 0 0 macnock [177703.012206] Out of memory: Kill process 1574 (uhttpd) score 1 or sacrifice child [177703.020034] Killed process 1574 (uhttpd) total-vm:1320kB, anon-rss:92kB, file-rss:4kB, shmem-rss:0kB [177703.120099] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177703.132881] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0 [177703.139346] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987 [177703.148345] 804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af [177703.157452] 00000000 00000000 80640000 0000ff88 00000000 00000000 00000007 00000000 [177703.166358] 00000331 5646395e 00000330 6d3a206e 80000000 839772a0 82dffd20 804bcd98 [177703.175419] 00000001 00200000 ffffffff 00000015 00000003 8026a754 00000000 80640000 [177703.184687] ... [177703.187631] Call Trace: [177703.190378] [<8006aa9c>] show_stack+0x58/0x100 [177703.195127] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177703.201334] [<800f6e24>] oom_kill_process+0xd0/0x460 [177703.206670] [<800f79ec>] out_of_memory+0x3b0/0x420 [177703.211837] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177703.217829] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177703.222939] [<8011b1c0>] __do_fault+0x110/0x18c [177703.227943] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177703.233348] [<80071d40>] __do_page_fault+0x120/0x468 [177703.238654] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177703.244487] Mem-Info: [177703.246966] active_anon:188 inactive_anon:5 isolated_anon:0 [177703.246966] active_file:26 inactive_file:27 isolated_file:0 [177703.246966] unevictable:0 dirty:0 writeback:0 unstable:0 [177703.246966] slab_reclaimable:200 slab_unreclaimable:1691 [177703.246966] mapped:4 shmem:24 pagetables:41 bounce:0 [177703.246966] free:2040 free_pcp:6 free_cma:0 [177703.280738] Node 0 active_anon:752kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:16kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177703.304004] Normal free:8128kB min:8192kB low:10240kB high:12288kB active_anon:752kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:344kB pagetables:164kB bounce:0kB free_pcp:24kB local_pcp:24kB free_cma:0kB [177703.332453] lowmem_reserve[]: 0 0 [177703.335980] Normal: 242*4kB (UM) 197*8kB (UM) 133*16kB (UM) 8*32kB (UM) 5*64kB (UM) 8*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8064kB [177703.351054] 77 total pagecache pages [177703.354840] 0 pages in swap cache [177703.358353] Swap cache stats: add 0, delete 0, find 0/0 [177703.364058] Free swap = 0kB [177703.367123] Total swap = 0kB [177703.370230] 16384 pages RAM [177703.373198] 0 pages HighMem/MovableOnly [177703.377239] 1513 pages reserved [177703.380850] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177703.390121] [ 524] 0 524 305 19 3 0 0 0 ubusd [177703.399446] [ 525] 0 525 230 10 3 0 0 0 askfirst [177703.408858] [ 542] 0 542 256 12 4 0 0 0 urngd [177703.418158] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177703.427560] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177703.437025] [ 1575] 0 1575 330 22 5 0 0 0 uhttpd [177703.446402] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177703.455809] [ 3661] 0 3661 259 14 4 0 0 0 alfred [177703.465471] [ 3982] 0 3982 302 11 4 0 0 0 ntpd [177703.474740] [ 4660] 0 4660 355 18 3 0 0 0 macnock [177703.484303] Out of memory: Kill process 1575 (uhttpd) score 1 or sacrifice child [177703.492477] Killed process 1575 (uhttpd) total-vm:1320kB, anon-rss:84kB, file-rss:4kB, shmem-rss:0kB [177703.551957] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177703.564507] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0 [177703.570833] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987 [177703.580103] 804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af [177703.589116] 00000000 00000000 80640000 00010f80 00000000 00000000 00000007 00000000 [177703.598144] 0000035f 54056e94 0000035e 6d3a206e 80000000 83912760 82dffd20 804bcd98 [177703.607267] 00000001 00200000 ffffffff 00000015 00000003 8026a754 00000000 80640000 [177703.616488] ... [177703.619225] Call Trace: [177703.621867] [<8006aa9c>] show_stack+0x58/0x100 [177703.626555] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177703.632171] [<800f6e24>] oom_kill_process+0xd0/0x460 [177703.637535] [<800f79ec>] out_of_memory+0x3b0/0x420 [177703.642736] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177703.648649] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177703.653756] [<8011b1c0>] __do_fault+0x110/0x18c [177703.658904] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177703.664135] [<80071d40>] __do_page_fault+0x120/0x468 [177703.669574] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177703.675325] Mem-Info: [177703.677782] active_anon:167 inactive_anon:5 isolated_anon:0 [177703.677782] active_file:26 inactive_file:27 isolated_file:0 [177703.677782] unevictable:0 dirty:0 writeback:0 unstable:0 [177703.677782] slab_reclaimable:200 slab_unreclaimable:1699 [177703.677782] mapped:4 shmem:24 pagetables:36 bounce:0 [177703.677782] free:1999 free_pcp:17 free_cma:0 [177703.711398] Node 0 active_anon:668kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:16kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177703.734898] Normal free:7932kB min:8192kB low:10240kB high:12288kB active_anon:668kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:344kB pagetables:144kB bounce:0kB free_pcp:68kB local_pcp:68kB free_cma:0kB [177703.763868] lowmem_reserve[]: 0 0 [177703.767404] Normal: 243*4kB (UM) 196*8kB (UM) 137*16kB (UM) 8*32kB (UM) 4*64kB (M) 7*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 7932kB [177703.782433] 77 total pagecache pages [177703.786464] 0 pages in swap cache [177703.790134] Swap cache stats: add 0, delete 0, find 0/0 [177703.795972] Free swap = 0kB [177703.799177] Total swap = 0kB [177703.802286] 16384 pages RAM [177703.805258] 0 pages HighMem/MovableOnly [177703.809405] 1513 pages reserved [177703.812779] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177703.821883] [ 524] 0 524 305 19 3 0 0 0 ubusd [177703.831369] [ 525] 0 525 230 10 3 0 0 0 askfirst [177703.840999] [ 542] 0 542 256 12 4 0 0 0 urngd [177703.850217] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177703.859588] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177703.869048] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177703.878396] [ 3661] 0 3661 259 14 4 0 0 0 alfred [177703.887626] [ 3982] 0 3982 302 11 4 0 0 0 ntpd [177703.896632] [ 4660] 0 4660 355 18 3 0 0 0 macnock [177703.906095] Out of memory: Kill process 524 (ubusd) score 1 or sacrifice child [177703.913950] Killed process 524 (ubusd) total-vm:1220kB, anon-rss:72kB, file-rss:4kB, shmem-rss:0kB [177704.000357] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177704.013048] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0 [177704.019342] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987 [177704.028106] 804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af [177704.037190] 00000000 00000000 80640000 00011f08 00000000 00000000 00000007 00000000 [177704.046003] 0000038c 35306150 0000038b 6d3a206e 80000000 82ea50e0 82dffd20 804bcd98 [177704.054809] 00000001 00200000 ffffffff 00000015 00000003 8026a754 00000000 80640000 [177704.063900] ... [177704.066533] Call Trace: [177704.069363] [<8006aa9c>] show_stack+0x58/0x100 [177704.074072] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177704.079592] [<800f6e24>] oom_kill_process+0xd0/0x460 [177704.085144] [<800f79ec>] out_of_memory+0x3b0/0x420 [177704.090239] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177704.096166] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177704.101291] [<8011b1c0>] __do_fault+0x110/0x18c [177704.106204] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177704.111890] [<80071d40>] __do_page_fault+0x120/0x468 [177704.117197] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177704.122921] Mem-Info: [177704.125442] active_anon:149 inactive_anon:5 isolated_anon:0 [177704.125442] active_file:26 inactive_file:27 isolated_file:0 [177704.125442] unevictable:0 dirty:0 writeback:0 unstable:0 [177704.125442] slab_reclaimable:198 slab_unreclaimable:1699 [177704.125442] mapped:4 shmem:24 pagetables:33 bounce:0 [177704.125442] free:1991 free_pcp:16 free_cma:0 [177704.158774] Node 0 active_anon:596kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:16kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177704.181998] Normal free:7932kB min:8192kB low:10240kB high:12288kB active_anon:596kB inactive_anon:20kB active_file:104kB inactive_file:108kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:344kB pagetables:132kB bounce:0kB free_pcp:64kB local_pcp:64kB free_cma:0kB [177704.210723] lowmem_reserve[]: 0 0 [177704.214291] Normal: 239*4kB (UM) 198*8kB (UM) 131*16kB (UM) 14*32kB (UM) 5*64kB (UM) 6*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 7964kB [177704.229993] 77 total pagecache pages [177704.234111] 0 pages in swap cache [177704.237994] Swap cache stats: add 0, delete 0, find 0/0 [177704.243888] Free swap = 0kB [177704.246951] Total swap = 0kB [177704.250112] 16384 pages RAM [177704.253867] 0 pages HighMem/MovableOnly [177704.257918] 1513 pages reserved [177704.261490] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177704.270781] [ 525] 0 525 230 10 3 0 0 0 askfirst [177704.280482] [ 542] 0 542 256 12 4 0 0 0 urngd [177704.289882] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177704.299487] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177704.309092] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177704.318723] [ 3661] 0 3661 259 14 4 0 0 0 alfred [177704.328105] [ 3982] 0 3982 302 11 4 0 0 0 ntpd [177704.337120] [ 4660] 0 4660 355 18 3 0 0 0 macnock [177704.346386] Out of memory: Kill process 4660 (macnock) score 1 or sacrifice child [177704.354270] Killed process 4660 (macnock) total-vm:1420kB, anon-rss:64kB, file-rss:8kB, shmem-rss:0kB [177704.431182] oom_reaper: reaped process 4660 (macnock), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB [177704.444850] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177704.457877] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0 [177704.464360] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987 [177704.473623] 804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af [177704.482475] 00000000 00000000 80640000 00012ea0 00000000 00000000 00000007 00000000 [177704.491246] 000003b9 e27fe668 000003b8 6d3a206e 80000000 83910000 82dffd20 804bcd98 [177704.500252] 00000001 00200000 ffffffff 0000000e 00000003 8026a754 00000000 80640000 [177704.509152] ... [177704.511924] Call Trace: [177704.514748] [<8006aa9c>] show_stack+0x58/0x100 [177704.519578] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177704.525207] [<800f6e24>] oom_kill_process+0xd0/0x460 [177704.530700] [<800f79ec>] out_of_memory+0x3b0/0x420 [177704.536199] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177704.542287] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177704.547702] [<8011b1c0>] __do_fault+0x110/0x18c [177704.552829] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177704.558066] [<80071d40>] __do_page_fault+0x120/0x468 [177704.563548] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177704.569428] Mem-Info: [177704.571964] active_anon:133 inactive_anon:5 isolated_anon:0 [177704.571964] active_file:25 inactive_file:65 isolated_file:0 [177704.571964] unevictable:0 dirty:0 writeback:0 unstable:0 [177704.571964] slab_reclaimable:198 slab_unreclaimable:1683 [177704.571964] mapped:2 shmem:24 pagetables:33 bounce:0 [177704.571964] free:2044 free_pcp:16 free_cma:0 [177704.605723] Node 0 active_anon:532kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:8kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177704.629277] Normal free:8176kB min:8192kB low:10240kB high:12288kB active_anon:532kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:328kB pagetables:132kB bounce:0kB free_pcp:60kB local_pcp:60kB free_cma:0kB [177704.659346] lowmem_reserve[]: 0 0 [177704.662875] Normal: 246*4kB (UM) 201*8kB (UM) 129*16kB (UM) 18*32kB (UM) 5*64kB (UM) 6*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8112kB [177704.677921] 114 total pagecache pages [177704.681924] 0 pages in swap cache [177704.685538] Swap cache stats: add 0, delete 0, find 0/0 [177704.691064] Free swap = 0kB [177704.694672] Total swap = 0kB [177704.697832] 16384 pages RAM [177704.700841] 0 pages HighMem/MovableOnly [177704.704887] 1513 pages reserved [177704.708261] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177704.717683] [ 525] 0 525 230 10 3 0 0 0 askfirst [177704.727015] [ 542] 0 542 256 12 4 0 0 0 urngd [177704.736079] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177704.745532] [ 1374] 0 1374 250 14 3 0 0 0 micrond [177704.755029] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177704.764198] [ 3661] 0 3661 259 13 4 0 0 0 alfred [177704.773573] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177704.782646] [ 4662] 0 4660 355 0 3 0 0 0 macnock [177704.792283] Out of memory: Kill process 1374 (micrond) score 1 or sacrifice child [177704.800429] Killed process 1374 (micrond) total-vm:1000kB, anon-rss:48kB, file-rss:4kB, shmem-rss:4kB [177704.870551] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177704.883340] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0 [177704.889799] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987 [177704.899796] 804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af [177704.908840] 00000000 00000000 80640000 00013dd8 00000000 00000000 00000007 00000000 [177704.917627] 000003e5 929b53aa 000003e4 6d3a206e 80000000 82ea61c0 82dffd20 804bcd98 [177704.926449] 00000001 00200000 ffffffff 0000000e 00000003 8026a754 00000000 80640000 [177704.935278] ... [177704.938116] Call Trace: [177704.940798] [<8006aa9c>] show_stack+0x58/0x100 [177704.945779] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177704.951462] [<800f6e24>] oom_kill_process+0xd0/0x460 [177704.956992] [<800f79ec>] out_of_memory+0x3b0/0x420 [177704.962508] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177704.968729] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177704.973780] [<8011b1c0>] __do_fault+0x110/0x18c [177704.978653] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177704.984790] [<80071d40>] __do_page_fault+0x120/0x468 [177704.990254] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177704.995967] Mem-Info: [177704.998553] active_anon:121 inactive_anon:5 isolated_anon:0 [177704.998553] active_file:25 inactive_file:65 isolated_file:0 [177704.998553] unevictable:0 dirty:0 writeback:0 unstable:0 [177704.998553] slab_reclaimable:198 slab_unreclaimable:1690 [177704.998553] mapped:1 shmem:24 pagetables:30 bounce:0 [177704.998553] free:2011 free_pcp:17 free_cma:0 [177705.032257] Node 0 active_anon:484kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:4kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177705.055715] Normal free:8044kB min:8192kB low:10240kB high:12288kB active_anon:484kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:328kB pagetables:120kB bounce:0kB free_pcp:68kB local_pcp:68kB free_cma:0kB [177705.083993] lowmem_reserve[]: 0 0 [177705.089224] Normal: 241*4kB (UM) 197*8kB (UM) 128*16kB (UM) 15*32kB (UM) 6*64kB (UM) 6*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8012kB [177705.104520] 114 total pagecache pages [177705.108394] 0 pages in swap cache [177705.112059] Swap cache stats: add 0, delete 0, find 0/0 [177705.117762] Free swap = 0kB [177705.120890] Total swap = 0kB [177705.124043] 16384 pages RAM [177705.127020] 0 pages HighMem/MovableOnly [177705.131104] 1513 pages reserved [177705.134430] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177705.143582] [ 525] 0 525 230 10 3 0 0 0 askfirst [177705.153177] [ 542] 0 542 256 12 4 0 0 0 urngd [177705.162679] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177705.172291] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177705.182230] [ 3661] 0 3661 259 13 4 0 0 0 alfred [177705.191591] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177705.200642] [ 4662] 0 4660 355 0 3 0 0 0 macnock [177705.209906] Out of memory: Kill process 3661 (alfred) score 1 or sacrifice child [177705.217819] Killed process 3661 (alfred) total-vm:1036kB, anon-rss:48kB, file-rss:4kB, shmem-rss:0kB [177705.248665] oom_reaper: reaped process 3661 (alfred), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB [177705.263932] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177705.276875] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0 [177705.283383] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987 [177705.292286] 804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af [177705.301296] 00000000 00000000 80640000 00014d08 00000000 00000000 00000007 00000000 [177705.310069] 00000411 99a826ae 00000410 6d3a206e 80000000 839110e0 82dffd20 804bcd98 [177705.318879] 00000001 00200000 ffffffff 0000000e 00000003 8026a754 00000000 80640000 [177705.328553] ... [177705.331183] Call Trace: [177705.333827] [<8006aa9c>] show_stack+0x58/0x100 [177705.340003] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177705.345765] [<800f6e24>] oom_kill_process+0xd0/0x460 [177705.351174] [<800f79ec>] out_of_memory+0x3b0/0x420 [177705.356300] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177705.362237] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177705.367531] [<8011b1c0>] __do_fault+0x110/0x18c [177705.372744] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177705.378079] [<80071d40>] __do_page_fault+0x120/0x468 [177705.383344] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177705.389108] Mem-Info: [177705.391560] active_anon:109 inactive_anon:5 isolated_anon:0 [177705.391560] active_file:25 inactive_file:65 isolated_file:0 [177705.391560] unevictable:0 dirty:0 writeback:0 unstable:0 [177705.391560] slab_reclaimable:198 slab_unreclaimable:1695 [177705.391560] mapped:1 shmem:24 pagetables:26 bounce:0 [177705.391560] free:2014 free_pcp:17 free_cma:0 [177705.424923] Node 0 active_anon:436kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:4kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [177705.448177] Normal free:8024kB min:8192kB low:10240kB high:12288kB active_anon:436kB inactive_anon:20kB active_file:100kB inactive_file:260kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:328kB pagetables:104kB bounce:0kB free_pcp:68kB local_pcp:68kB free_cma:0kB [177705.476560] lowmem_reserve[]: 0 0 [177705.480149] Normal: 238*4kB (UM) 198*8kB (UM) 125*16kB (UM) 13*32kB (UM) 8*64kB (UM) 6*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8024kB [177705.496424] 114 total pagecache pages [177705.500597] 0 pages in swap cache [177705.504112] Swap cache stats: add 0, delete 0, find 0/0 [177705.509839] Free swap = 0kB [177705.512909] Total swap = 0kB [177705.515965] 16384 pages RAM [177705.519082] 0 pages HighMem/MovableOnly [177705.523236] 1513 pages reserved [177705.526578] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177705.535653] [ 525] 0 525 230 10 3 0 0 0 askfirst [177705.545192] [ 542] 0 542 256 12 4 0 0 0 urngd [177705.554564] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177705.564253] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177705.573769] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177705.582950] [ 4662] 0 4660 355 0 3 0 0 0 macnock [177705.592505] Out of memory: Kill process 542 (urngd) score 1 or sacrifice child [177705.600502] Killed process 542 (urngd) total-vm:1024kB, anon-rss:44kB, file-rss:4kB, shmem-rss:0kB [177705.695403] ntpd invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0 [177705.708301] CPU: 0 PID: 3982 Comm: ntpd Not tainted 4.14.215 #0 [177705.715653] Stack : 80510000 804e2d44 00000000 00000000 804b8b5c 82dffb84 82ea757c 804f1987 [177705.725592] 804b4c30 00000f8e 80643670 00200000 ffffffff 00000001 82dffb38 bf9368af [177705.735918] 00000000 00000000 80640000 00015b68 00000000 00000000 00000007 00000000 [177705.744939] 0000043b 7c90d744 0000043a 6d3a206e 80000000 82ea6760 82dffd20 804bcd98 [177705.753858] 00000001 00200000 ffffffff 0000000e 00000003 8026a754 00000000 80640000 [177705.762897] ... [177705.765767] Call Trace: [177705.768506] [<8006aa9c>] show_stack+0x58/0x100 [177705.773243] [<800f7b4c>] dump_header.isra.28+0x8c/0x1e0 [177705.779015] [<800f6e24>] oom_kill_process+0xd0/0x460 [177705.784539] [<800f79ec>] out_of_memory+0x3b0/0x420 [177705.789789] [<800fc11c>] __alloc_pages_nodemask+0x888/0xc80 [177705.795757] [<800f46fc>] filemap_fault+0x3ec/0x6c0 [177705.801008] [<8011b1c0>] __do_fault+0x110/0x18c [177705.805801] [<8011f63c>] handle_mm_fault+0x6f0/0xa98 [177705.811187] [<80071d40>] __do_page_fault+0x120/0x468 [177705.816428] [<800776bc>] tlb_do_page_fault_0+0x10c/0x114 [177705.822303] Mem-Info: [177705.824787] active_anon:98 inactive_anon:5 isolated_anon:0 [177705.824787] active_file:6 inactive_file:22 isolated_file:0 [177705.824787] unevictable:0 dirty:0 writeback:0 unstable:0 [177705.824787] slab_reclaimable:195 slab_unreclaimable:1694 [177705.824787] mapped:2 shmem:24 pagetables:22 bounce:0 [177705.824787] free:2040 free_pcp:17 free_cma:0 [177705.858377] Node 0 active_anon:392kB inactive_anon:20kB active_file:24kB inactive_file:88kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:8kB dirty:0kB writeback:0kB shmem:96kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes [177705.881262] Normal free:8128kB min:8192kB low:10240kB high:12288kB active_anon:392kB inactive_anon:20kB active_file:24kB inactive_file:88kB unevictable:0kB writepending:0kB present:65536kB managed:59484kB mlocked:0kB kernel_stack:328kB pagetables:88kB bounce:0kB free_pcp:68kB local_pcp:68kB free_cma:0kB [177705.909627] lowmem_reserve[]: 0 0 [177705.913163] Normal: 222*4kB (UM) 191*8kB (UM) 125*16kB (UM) 15*32kB (UM) 10*64kB (UM) 6*128kB (UM) 1*256kB (M) 3*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 8096kB [177705.928593] 52 total pagecache pages [177705.932382] 0 pages in swap cache [177705.935894] Swap cache stats: add 0, delete 0, find 0/0 [177705.941760] Free swap = 0kB [177705.944826] Total swap = 0kB [177705.947890] 16384 pages RAM [177705.951258] 0 pages HighMem/MovableOnly [177705.955308] 1513 pages reserved [177705.959135] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name [177705.968051] [ 525] 0 525 230 10 3 0 0 0 askfirst [177705.978053] [ 1081] 0 1081 267 10 3 0 0 0 dropbear [177705.987805] [ 3534] 0 3534 232 12 4 0 0 0 uradvd [177705.997507] [ 3982] 0 3982 302 10 4 0 0 0 ntpd [177706.006506] [ 4662] 0 4660 355 0 3 0 0 0 macnock [177706.016070] Out of memory: Kill process 3534 (uradvd) score 1 or sacrifice child [177706.023985] Killed process 3534 (uradvd) total-vm:928kB, anon-rss:44kB, file-rss:4kB, shmem-rss:0kB ```
adschm added the
bug
upstream
labels 2021-02-25 16:54:46 +01:00
Owner

Das ist ein upstream-Problem. Mindestens OpenWrt, wenn nicht sogar kernel.

Das ist ein upstream-Problem. Mindestens OpenWrt, wenn nicht sogar kernel.
Author

Reboot nach 10 sek bei OOM:

sysctl vm.panic_on_oom=1
sysctl kernel.panic=10
echo "vm.panic_on_oom=1" >> /etc/sysctl.conf
echo "kernel.panic=10" >> /etc/sysctl.conf
echo 1 > /proc/sys/vm/overcommit_memory 

könnte helfen

Reboot nach 10 sek bei OOM: ``` sysctl vm.panic_on_oom=1 sysctl kernel.panic=10 echo "vm.panic_on_oom=1" >> /etc/sysctl.conf echo "kernel.panic=10" >> /etc/sysctl.conf ``` ``` echo 1 > /proc/sys/vm/overcommit_memory ``` könnte helfen
Owner

Reboot on Panic + Panic on OOM ist sicherlich keine blöde Idee für unsere Firmware, denn der OOM Killer kann den Router aktuell auch nicht wieder ganz machen und egal was man abschießt, der Router ist danach auf die eine oder andere Art kaputt.

Dennoch sollten wir dieses Problem weiter verfolgen, denn es muss eine Ursache haben. Das ganze tritt ja auf Geräten mit 64 MB RAM und ohne 5 GHz auf. Die haben im normalen Betrieb fast die Hälfte des RAMs komplett frei.

Von vm.overcommit_memory=1 halte ich nichts..

Reboot on Panic + Panic on OOM ist sicherlich keine blöde Idee für unsere Firmware, denn der OOM Killer kann den Router aktuell auch nicht wieder ganz machen und egal was man abschießt, der Router ist danach auf die eine oder andere Art kaputt. Dennoch sollten wir dieses Problem weiter verfolgen, denn es muss eine Ursache haben. Das ganze tritt ja auf Geräten mit 64 MB RAM und ohne 5 GHz auf. Die haben im normalen Betrieb fast die Hälfte des RAMs komplett frei. Von vm.overcommit_memory=1 halte ich nichts..
fbl added this to the 20210226 milestone 2021-02-26 20:39:16 +01:00
fbl modified the milestone from 20210226 to next-bugfix 2021-02-27 11:25:11 +01:00
Author

In letzter Zeit ohne Änderungen am GW wieder gehäuft Ausfälle durch OOM-Killer. Es ist ein showstopper, gerade für GUs, wenn der Router mit WAN Uplink wegen OOM-Killer hostapd verliert ist nach kurzer Zeit alles dahinter tot. Man kommt aber nicht sofort an die Hardware ran und kann das Problem nicht remote fixen, wenn auch noch sshd und httpd gekillt wird.

Bei dem gepasteten dmesg output kann man sehen, dass der OOM Killer reinkickt, wenn weniger als 8MB Memory frei ist (min:8192kB). Das ist auf Geräten mit 32MB ein seltsames limit, führt es doch dazu, dass maximal 24MB RAM genutzt werden können.

Es macht Sinn, das auf 1MB zu setzen.

In letzter Zeit ohne Änderungen am GW wieder gehäuft Ausfälle durch OOM-Killer. Es ist ein showstopper, gerade für GUs, wenn der Router mit WAN Uplink wegen OOM-Killer hostapd verliert ist nach kurzer Zeit alles dahinter tot. Man kommt aber nicht sofort an die Hardware ran und kann das Problem nicht remote fixen, wenn auch noch sshd und httpd gekillt wird. Bei dem gepasteten dmesg output kann man sehen, dass der OOM Killer reinkickt, wenn weniger als 8MB Memory frei ist (min:8192kB). Das ist auf Geräten mit 32MB ein seltsames limit, führt es doch dazu, dass maximal 24MB RAM genutzt werden können. Es macht Sinn, das auf 1MB zu setzen.
Author

Found a workaround. It seems like the vm.min_free_kbytes setting is too high at 8 MB. I've tweaked that down to 4 MB and set vm.swapiness to 1 and that seems to have stopped the OOM killer. - from https://forum.openwrt.org/t/workaround-hostapd-terminated-by-oom-killer/13612

Found a workaround. It seems like the vm.min_free_kbytes setting is too high at 8 MB. I've tweaked that down to 4 MB and set vm.swapiness to 1 and that seems to have stopped the OOM killer. - from https://forum.openwrt.org/t/workaround-hostapd-terminated-by-oom-killer/13612
Owner

Bei dem gepasteten dmesg output kann man sehen, dass der OOM Killer reinkickt, wenn weniger als 8MB Memory frei ist (min:8192kB). Das ist auf Geräten mit 32MB ein seltsames limit, führt es doch dazu, dass maximal 24MB RAM genutzt werden können.

Das stimmt, das Limit wird aber für Geräte dynamisch festgelegt. Der 1043 hat 64 MB RAM, da wird min_free_kbytes von OpenWrt auf 8192 gesetzt. Bei 32 MB RAM ist min_free_kbytes 1024. Siehe hier: [1]

Bei 64 MB RAM ist normalerweise knapp die Hälfte des RAMs frei, daher muss es sich hier eigentlich um einen Bug handeln. Muss weiter untersucht werden.


Der OOM-Killer ergibt in unserer Firmware - wie schon angemerkt - nur wenig Sinn. Ich möchte dies im nächsten Release auf jeden Fall mit panic_on_oom=1 umsetzen.

Mit dem nächsten Release werden 32 MB Geräte wohl nicht mehr unterstützt werden können, da der RAM für OpenWrt 21.02 nicht mehr genügt.

vm.swapiness=1 sollte auf unserer Firmware keinen Effekt haben, da kein Swap aktiv ist.

> Bei dem gepasteten dmesg output kann man sehen, dass der OOM Killer reinkickt, wenn weniger als 8MB Memory frei ist (min:8192kB). Das ist auf Geräten mit 32MB ein seltsames limit, führt es doch dazu, dass maximal 24MB RAM genutzt werden können. Das stimmt, das Limit wird aber für Geräte dynamisch festgelegt. Der 1043 hat 64 MB RAM, da wird min_free_kbytes von OpenWrt auf 8192 gesetzt. Bei 32 MB RAM ist min_free_kbytes 1024. Siehe hier: [[1]](https://github.com/openwrt/openwrt/blob/master/package/base-files/files/etc/init.d/sysctl#L10-L18) Bei 64 MB RAM ist normalerweise knapp die Hälfte des RAMs frei, daher muss es sich hier eigentlich um einen Bug handeln. Muss weiter untersucht werden. ----- Der OOM-Killer ergibt in unserer Firmware - wie schon angemerkt - nur wenig Sinn. Ich möchte dies im nächsten Release auf jeden Fall mit `panic_on_oom=1` umsetzen. Mit dem nächsten Release werden 32 MB Geräte wohl nicht mehr unterstützt werden können, da der RAM für OpenWrt 21.02 nicht mehr genügt. `vm.swapiness=1` sollte auf unserer Firmware keinen Effekt haben, da kein Swap aktiv ist.
fbl self-assigned this 2021-07-05 14:08:50 +02:00
Author
https://git.freifunk-franken.de/freifunk-franken/firmware/pulls/151
fbl modified the milestone from next-bugfix to 20220405-beta 2022-03-03 15:43:01 +01:00
fbl referenced this issue from a commit 2022-03-06 19:09:36 +01:00
fbl closed this issue 2022-03-06 19:09:36 +01:00
Sign in to join this conversation.
No Milestone
No Assignees
3 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: freifunk-franken/firmware#131
No description provided.