Ludus: velká velikost souboru v temp

Poprvé za celou dobu provozu se mi podruhé objevilo v logu zaplnění složky tmps. Při první výskytu jsem věc nezkoumal - data v tmp odstranil manuálně a restartoval router. System mám na SSD, Úložiště mám /srv/ aktivní na flešce.

Dávám jen na vědomí, odinstaloval jsem nefunkční ludus a budu to pozorovat. Problém trval mezi 9:30 až 11:30.

Na konci postu je ještě zmínka o chybě err kernel[]: [407031.616304] vmscan: shrink_slab:

Syslog, záznam jádra a Diagnostiky jsem pro jistotu odložil.

2019-10-23 09:30:33 info updater-supervisor[]: Running pkgupdate
2019-10-23 09:30:46 warning kernel[]: [404375.692964] pkgupdate invoked oom-killer: gfp_mask=0x24004c0, order=2, oom_score_adj=0
2019-10-23 09:30:46 info kernel[]: [404375.692975] pkgupdate cpuset=/ mems_allowed=0
2019-10-23 09:30:46 warning kernel[]: [404375.692988] CPU: 0 PID: 17862 Comm: pkgupdate Not tainted 4.4.196-a890a5a94ebb621f8f1720c24d12fef1-0 #1
2019-10-23 09:30:46 warning kernel[]: [404375.692992] Hardware name: Marvell Armada 380/385 (Device Tree)
2019-10-23 09:30:46 warning kernel[]: [404375.692995] Backtrace: 
2019-10-23 09:30:46 warning kernel[]: [404375.693008] [<c001c654>] (dump_backtrace) from [<c001c894>] (show_stack+0x18/0x1c)
2019-10-23 09:30:46 warning kernel[]: [404375.693011]  r6:00000000 r5:60000113 r4:c077aea8 r3:00000000
2019-10-23 09:30:46 warning kernel[]: [404375.693022] [<c001c87c>] (show_stack) from [<c0304124>] (dump_stack+0x98/0xac)
2019-10-23 09:30:46 warning kernel[]: [404375.693033] [<c030408c>] (dump_stack) from [<c00afaec>] (dump_header+0x5c/0x1b0)
2019-10-23 09:30:46 warning kernel[]: [404375.693036]  r6:00000250 r5:00000000 r4:c6a67e6c r3:00000000
2019-10-23 09:30:46 warning kernel[]: [404375.693046] [<c00afa90>] (dump_header) from [<c00b0290>] (oom_kill_process+0x2b4/0x548)
2019-10-23 09:30:46 warning kernel[]: [404375.693049]  r10:c076f330 r9:0003f55d r8:c076f330 r7:000003ee r6:0003ee89 r5:c6a67e6c
2019-10-23 09:30:46 warning kernel[]: [404375.693058]  r4:ecde8e40
2019-10-23 09:30:46 warning kernel[]: [404375.693065] [<c00affdc>] (oom_kill_process) from [<c00b08c8>] (out_of_memory+0x334/0x344)
2019-10-23 09:30:46 warning kernel[]: [404375.693067]  r10:c076f330 r9:0003f55d r8:c076f330 r7:c076f4e8 r6:0003ee89 r5:ef35bfcc
2019-10-23 09:30:46 warning kernel[]: [404375.693075]  r4:c6a67e6c
2019-10-23 09:30:46 warning kernel[]: [404375.693083] [<c00b0594>] (out_of_memory) from [<c00b4fa8>] (__alloc_pages_nodemask+0xa48/0xa54)
2019-10-23 09:30:46 warning kernel[]: [404375.693086]  r10:c07b8908 r9:c6a66000 r8:024004c0 r7:00000002 r6:024004c0 r5:b6db6db7
2019-10-23 09:30:46 warning kernel[]: [404375.693094]  r4:00000000
2019-10-23 09:30:46 warning kernel[]: [404375.693099] [<c00b4560>] (__alloc_pages_nodemask) from [<c00b4fcc>] (__get_free_pages+0x18/0x34)
2019-10-23 09:30:46 warning kernel[]: [404375.693102]  r10:00000000 r9:ffffff9c r8:ef0e7440 r7:ce714e00 r6:ce714e00 r5:00000000
2019-10-23 09:30:46 warning kernel[]: [404375.693110]  r4:00000000
2019-10-23 09:30:46 warning kernel[]: [404375.693118] [<c00b4fb4>] (__get_free_pages) from [<c0022894>] (pgd_alloc+0x20/0x118)
2019-10-23 09:30:46 warning kernel[]: [404375.693125] [<c0022874>] (pgd_alloc) from [<c00265e0>] (mm_init+0xdc/0x170)
2019-10-23 09:30:46 warning kernel[]: [404375.693128]  r7:c07719cc r6:ce714e00 r5:00000000 r4:00000000
2019-10-23 09:30:46 warning kernel[]: [404375.693137] [<c0026504>] (mm_init) from [<c0026b50>] (mm_alloc+0x54/0x60)
2019-10-23 09:30:46 warning kernel[]: [404375.693140]  r8:e3438200 r7:beffee2c r6:beffe8d0 r5:eea3d0c0 r4:ce714e00 r3:cecab180
2019-10-23 09:30:46 warning kernel[]: [404375.693151] [<c0026afc>] (mm_alloc) from [<c00fc5b8>] (do_execveat_common+0x250/0x61c)
2019-10-23 09:30:46 warning kernel[]: [404375.693154]  r4:ebdbd000 r3:ebdbd010
2019-10-23 09:30:46 warning kernel[]: [404375.693160] [<c00fc368>] (do_execveat_common) from [<c00fc9b4>] (do_execve+0x30/0x38)
2019-10-23 09:30:46 warning kernel[]: [404375.693163]  r10:00000000 r9:c6a66000 r8:c0009ec4 r7:0000000b r6:beffe9e8 r5:beffe8d0
2019-10-23 09:30:46 warning kernel[]: [404375.693171]  r4:beffee2c
2019-10-23 09:30:46 warning kernel[]: [404375.693176] [<c00fc984>] (do_execve) from [<c00fcbdc>] (SyS_execve+0x24/0x28)
2019-10-23 09:30:46 warning kernel[]: [404375.693182] [<c00fcbb8>] (SyS_execve) from [<c0009d00>] (ret_fast_syscall+0x0/0x48)
2019-10-23 09:30:46 warning kernel[]: [404375.693184]  r5:beffe8d8 r4:00000003
2019-10-23 09:30:46 warning kernel[]: [404375.693189] Mem-Info:
2019-10-23 09:30:46 warning kernel[]: [404375.693199] active_anon:212183 inactive_anon:2855 isolated_anon:7
2019-10-23 09:30:46 warning kernel[]: [404375.693199]  active_file:435 inactive_file:1121 isolated_file:0
2019-10-23 09:30:46 warning kernel[]: [404375.693199]  unevictable:0 dirty:0 writeback:0 unstable:0
2019-10-23 09:30:46 warning kernel[]: [404375.693199]  slab_reclaimable:1820 slab_unreclaimable:2943
2019-10-23 09:30:46 warning kernel[]: [404375.693199]  mapped:8626 shmem:86792 pagetables:929 bounce:0
2019-10-23 09:30:46 warning kernel[]: [404375.693199]  free:15606 free_pcp:25 free_cma:0
2019-10-23 09:30:46 warning kernel[]: [404375.693217] Normal free:61876kB min:3504kB low:4380kB high:5256kB active_anon:594076kB inactive_anon:7544kB active_file:1740kB inactive_file:4484kB unevictable:0kB isolated(anon):28kB isolated(file):0kB present:786432kB managed:768548kB mlocked:0kB dirty:0kB writeback:0kB mapped:32872kB shmem:225532kB slab_reclaimable:7280kB slab_unreclaimable:11772kB kernel_stack:2096kB pagetables:3716kB unstable:0kB bounce:0kB free_pcp:100kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:44056 all_unreclaimable? yes
2019-10-23 09:30:46 warning kernel[]: [404375.693220] lowmem_reserve[]: 0 2048 2048
2019-10-23 09:30:46 warning kernel[]: [404375.693235] HighMem free:548kB min:256kB low:552kB high:852kB active_anon:254656kB inactive_anon:3876kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:262144kB managed:262144kB mlocked:0kB dirty:0kB writeback:0kB mapped:1632kB shmem:121636kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
2019-10-23 09:30:46 warning kernel[]: [404375.693238] lowmem_reserve[]: 0 0 0
2019-10-23 09:30:46 warning kernel[]: [404375.693243] Normal: 13608*4kB (UME) 937*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 61928kB
2019-10-23 09:30:46 warning kernel[]: [404375.693260] HighMem: 125*4kB (UM) 7*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 556kB
2019-10-23 09:30:46 warning kernel[]: [404375.693277] 88388 total pagecache pages
2019-10-23 09:30:46 warning kernel[]: [404375.693281] 0 pages in swap cache
2019-10-23 09:30:46 warning kernel[]: [404375.693284] Swap cache stats: add 0, delete 0, find 0/0
2019-10-23 09:30:46 warning kernel[]: [404375.693286] Free swap  = 0kB
2019-10-23 09:30:46 warning kernel[]: [404375.693288] Total swap = 0kB
2019-10-23 09:30:46 warning kernel[]: [404375.693291] 262144 pages RAM
2019-10-23 09:30:46 warning kernel[]: [404375.693293] 65536 pages HighMem/MovableOnly
2019-10-23 09:30:46 warning kernel[]: [404375.693296] 4471 pages reserved
2019-10-23 09:30:46 info kernel[]: [404375.693298] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
2019-10-23 09:30:46 info kernel[]: [404375.693314] [ 1024]     0  1024      213       16       4       0        0             0 ubusd
2019-10-23 09:30:46 info kernel[]: [404375.693319] [ 1161]     0  1161      179        4       3       0        0             0 askfirst
2019-10-23 09:30:46 info kernel[]: [404375.693326] [ 2286]     0  2286      320       22       4       0        0             0 rpcd
2019-10-23 09:30:46 info kernel[]: [404375.693332] [ 2318]     0  2318      391      160       4       0        0             0 haveged
2019-10-23 09:30:46 info kernel[]: [404375.693337] [ 3245]     0  3245     1230      554       5       0        0             0 sfpswitch.py
2019-10-23 09:30:46 info kernel[]: [404375.693343] [ 3270]     0  3270      376       38       4       0        0             0 netifd
2019-10-23 09:30:46 info kernel[]: [404375.693348] [ 3371]     0  3371      282       18       4       0        0             0 odhcpd
2019-10-23 09:30:46 info kernel[]: [404375.693353] [ 3846]     0  3846      397       30       4       0        0             0 ulogd
2019-10-23 09:30:46 info kernel[]: [404375.693360] [ 4083]     0  4083      198        8       3       0        0             0 atd
2019-10-23 09:30:46 info kernel[]: [404375.693365] [ 4127]   200  4127      743       46       5       0        0             0 mosquitto
2019-10-23 09:30:46 info kernel[]: [404375.693370] [ 4196]     0  4196     2817     1722       8       0        0             0 lcollect
2019-10-23 09:30:46 info kernel[]: [404375.693375] [ 4270]     0  4270      701       38       5       0        0         -1000 sshd
2019-10-23 09:30:46 info kernel[]: [404375.693380] [ 5197]     0  5197      704       43       4       0        0             0 smbd
2019-10-23 09:30:46 info kernel[]: [404375.693385] [ 5199]     0  5199      706       22       4       0        0             0 nmbd
2019-10-23 09:30:46 info kernel[]: [404375.693390] [ 5224]     0  5224     5717     3288      15       0        0             0 foris-ws
2019-10-23 09:30:46 info kernel[]: [404375.693395] [ 5270]     0  5270     6570     4193      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693442] [ 5328]     0  5328      777       93       5       0        0             0 collectd
2019-10-23 09:30:46 info kernel[]: [404375.693449] [ 5353]     0  5353     1826      826       7       0        0             0 lighttpd
2019-10-23 09:30:46 info kernel[]: [404375.693455] [ 5360]     0  5360      234       13       3       0        0             0 mountd
2019-10-23 09:30:46 info kernel[]: [404375.693460] [ 5423]     0  5423      193       11       4       0        0             0 cron
2019-10-23 09:30:46 info kernel[]: [404375.693465] [ 5569]     0  5569     4147     2341      12       0        0             0 python3
2019-10-23 09:30:46 info kernel[]: [404375.693470] [ 5777]     0  5777     3590     2291      11       0        0             0 python3
2019-10-23 09:30:46 info kernel[]: [404375.693475] [ 5830] 65534  5830     3757     2411      10       0        0          1000 netdata
2019-10-23 09:30:46 info kernel[]: [404375.693480] [ 5860]     0  5860     2070      127       7       0        0             0 sentinel-proxy
2019-10-23 09:30:46 info kernel[]: [404375.693485] [ 5909]     0  5909      739      168       5       0        0             0 smartd
2019-10-23 09:30:46 info kernel[]: [404375.693491] [ 6045]     0  6045     5769     3498      15       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693496] [ 6060]     0  6060     5844     3615      15       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693501] [ 6292]     0  6292     5671     3473      15       0        0             0 ludus.fcgi
2019-10-23 09:30:46 info kernel[]: [404375.693505] [ 6294]     0  6294     7071     4451      17       0        0             0 foris
2019-10-23 09:30:46 info kernel[]: [404375.693510] [ 6305] 65534  6305      292       15       5       0        0             0 dnsmasq
2019-10-23 09:30:46 info kernel[]: [404375.693515] [ 6310]     0  6310      274       13       4       0        0             0 dnsmasq
2019-10-23 09:30:46 info kernel[]: [404375.693520] [ 6698]     0  6698     6587     4192      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693526] [ 6699]     0  6699     6615     4203      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693531] [ 6701]     0  6701     6629     4220      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693536] [ 6703]     0  6703     6617     4211      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693541] [ 6708]     0  6708     6587     4193      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693546] [ 6711]     0  6711     6587     4193      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693551] [ 6712]     0  6712     6587     4216      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693557] [ 6718]     0  6718     6587     4193      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693561] [ 6721]     0  6721     6587     4193      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693566] [ 6723]     0  6723     6587     4213      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693571] [ 6724]     0  6724     6879     4300      18       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693577] [ 6725]     0  6725     6615     4207      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693582] [ 6731]     0  6731     6587     4193      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693595] [ 6732]     0  6732     6626     4210      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693601] [ 6738]     0  6738     6714     4315      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693606] [ 6742]     0  6742     6587     4193      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693611] [ 6743]     0  6743     6587     4193      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693617] [ 6744]     0  6744     6606     4212      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693622] [ 6746]     0  6746     6633     4228      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693627] [ 6747]     0  6747     6615     4240      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693632] [ 6748]     0  6748     6615     4221      16       0        0             0 foris-controlle
2019-10-23 09:30:46 info kernel[]: [404375.693637] [11145]     0 11145    20882    11827      45       0        0             0 Suricata-Main
2019-10-23 09:30:46 info kernel[]: [404375.693643] [11296]     0 11296    16848     8503      32       0        0             0 kresd
2019-10-23 09:30:46 info kernel[]: [404375.693648] [11344]     0 11344      277        7       3       0        0             0 ntpd
2019-10-23 09:30:46 info kernel[]: [404375.693654] [11375]     0 11375     9434     5944      23       0        0             0 python2.7
2019-10-23 09:30:46 info kernel[]: [404375.693658] [11412]     0 11412     1917      450       8       0        0             0 sentinel-minipo
2019-10-23 09:30:46 info kernel[]: [404375.693664] [11420] 65534 11420     1296       59       6       0        0             0 sentinel-minipo
2019-10-23 09:30:46 info kernel[]: [404375.693669] [11432]     0 11432    56305    47802     116       0        0             0 Suricata-Main
2019-10-23 09:30:46 info kernel[]: [404375.693674] [11328]     0 11328      179       39       3       0        0             0 nethist
2019-10-23 09:30:46 info kernel[]: [404375.693679] [24126]     0 24126     6098     4113      16       0        0             0 ucollect
2019-10-23 09:30:46 info kernel[]: [404375.693684] [25299]     0 25299      712       62       5       0        0             0 socat
2019-10-23 09:30:46 info kernel[]: [404375.693689] [ 9963]     0  9963      520       28       4       0        0             0 hostapd
2019-10-23 09:30:46 info kernel[]: [404375.693694] [ 9990]     0  9990      520       28       4       0        0             0 hostapd
2019-10-23 09:30:46 info kernel[]: [404375.693699] [26004]     0 26004     2317      242       9       0        0             0 syslog-ng
2019-10-23 09:30:46 info kernel[]: [404375.693704] [26007]     0 26007      277        4       3       0        0             0 sh
2019-10-23 09:30:46 info kernel[]: [404375.693709] [ 8416]     0  8416     2788     1154       9       0        0             0 python3
2019-10-23 09:30:46 info kernel[]: [404375.693715] [12926]     0 12926      706       38       5       0        0             0 sshd
2019-10-23 09:30:46 info kernel[]: [404375.693721] [17760]     0 17760     5179     3941      14       0        0             0 pkgupdate
2019-10-23 09:30:46 info kernel[]: [404375.693726] [17859]     0 17859      148        1       3       0        0             0 busybox
2019-10-23 09:30:46 info kernel[]: [404375.693731] [17860]     0 17860      148        1       3       0        0             0 busybox
2019-10-23 09:30:46 info kernel[]: [404375.693736] [17861]     0 17861      148        1       3       0        0             0 busybox
2019-10-23 09:30:46 info kernel[]: [404375.693741] [17862]     0 17862     5081     3876      14       0        0             0 pkgupdate
2019-10-23 09:30:46 info kernel[]: [404375.693746] [17863]     0 17863      148        1       3       0        0             0 busybox
2019-10-23 09:30:46 info kernel[]: [404375.693751] [17864]     0 17864     5146     3913      14       0        0             0 pkgupdate
2019-10-23 09:30:46 info kernel[]: [404375.693756] [17865]     0 17865     5179     3931      14       0        0             0 pkgupdate
2019-10-23 09:30:46 err kernel[]: [404375.693761] Out of memory: Kill process 5830 (netdata) score 1006 or sacrifice child
2019-10-23 09:30:46 err kernel[]: [404375.701771] Killed process 5830 (netdata) total-vm:15028kB, anon-rss:9644kB, file-rss:0kB
2019-10-23 09:30:48 warning updater[17760]: planner.lua:344 (pkg_plan): Requested package foris-pakon-plugin-l10n-de that is missing, ignoring as requested.
2019-10-23 09:30:48 warning updater[17760]: planner.lua:344 (pkg_plan): Requested package foris-storage-plugin-l10n-de that is missing, ignoring as requested.
2019-10-23 09:30:48 warning updater[17760]: planner.lua:344 (pkg_plan): Requested package luci-i18n-ddns-en that is missing, ignoring as requested.
2019-10-23 09:30:48 info updater-supervisor[]: pkgupdate reported no errors
2019-10-23 09:30:51 info netdata[17906]: resources control: allowed file descriptors: soft = 1024, max = 4096
2019-10-23 09:30:51 info netdata[17906]: Adjusted my Out-Of-Memory (OOM) score from 0 to 1000.
2019-10-23 09:30:51 err netdata[17906]: Cannot adjust netdata scheduling policy to idle (5), with priority 0. Falling back to nice.
2019-10-23 09:30:51 err netdata[17906]: Cannot get my current process scheduling policy.
2019-10-23 09:30:51 info netdata[17906]: netdata started on pid 17906.
2019-10-23 09:30:51 info netdata[17906]: Executing /usr/lib/netdata/plugins.d/system-info.sh
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_OS_NAME="unknown"
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_OS_ID=unknown
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_OS_ID_LIKE=unknown
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_OS_VERSION=unknown
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_OS_VERSION_ID=unknown
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_OS_DETECTION=unknown
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_KERNEL_NAME=Linux
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_KERNEL_VERSION=4.4.196-a890a5a94ebb621f8f1720c24d12fef1-0
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_ARCHITECTURE=armv7l
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_VIRTUALIZATION=unknown
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_VIRT_DETECTION=none
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_CONTAINER=unknown
2019-10-23 09:30:51 info netdata[17906]: NETDATA_SYSTEM_CONTAINER_DETECTION=none
2019-10-23 09:30:51 info netdata[17906]: CONFIG: cannot load user config '/etc/netdata/stream.conf'. Will try stock config.
2019-10-23 09:30:51 info netdata[17906]: Host 'turris' (at registry as 'turris') with guid '8d41667a-f1b9-11e9-a009-d858d7003550' initialized, os 'linux', timezone 'GMT', tags '', program_name 'netdata', program_version 'v3.11.7-37-g9c717a9', update every 2, memory mode ram, history entries 4034, streaming disabled (to '' with api key ''), health disabled, cache_dir '/var/cache/netdata', varlib_dir '/var/lib/netdata', health_log '/var/lib/netdata/health/health-log.db', alarms default handler '/usr/lib/netdata/plugins.d/alarm-notify.sh', alarms default recipient 'root'
2019-10-23 09:30:51 info netdata[17906]: netdata initialization completed. Enjoy real-time performance monitoring!
2019-10-23 09:30:51 info netdata[17906]: thread created with task id 17915
2019-10-23 09:30:51 info netdata[17906]: set name of thread 17915 to PLUGIN[proc]
2019-10-23 09:30:51 info netdata[17906]: thread created with task id 17917
2019-10-23 09:30:51 info netdata[17906]: set name of thread 17917 to PLUGIN[idlejitt
2019-10-23 09:30:51 err netdata[17906]: Cannot advise the kernel about the memory usage (MADV_MERGEABLE) of file '(null)'.

Připadá mi, že to souvisí s netdata

2019-10-23 10:08:11 err kernel[]: [406619.681302] Out of memory: Kill process 17906 (netdata) score 1006 or sacrifice child
2019-10-23 10:08:11 err kernel[]: [406619.689265] Killed process 17906 (netdata) total-vm:13380kB, anon-rss:9072kB, file-rss:0kB
2019-10-23 10:08:16 info netdata[22611]: resources control: allowed file descriptors: soft = 1024, max = 4096
2019-10-23 10:08:16 info netdata[22611]: Adjusted my Out-Of-Memory (OOM) score from 0 to 1000.
2019-10-23 10:08:16 err netdata[22611]: Cannot adjust netdata scheduling policy to idle (5), with priority 0. Falling back to nice.
2019-10-23 10:08:16 err netdata[22611]: Cannot get my current process scheduling policy.
2019-10-23 10:08:16 info netdata[22611]: netdata started on pid 22611.

Další ojedinělou chybou je err kernel[]: [407031.616304] vmscan: shrink_slab:

2019-10-23 10:09:01 info /usr/sbin/cron[22706]: (root) CMD (/usr/bin/rainbow_button_sync.sh)
2019-10-23 10:09:01 info /usr/sbin/cron[22707]: (root) CMD (/root/connCheck.sh > /dev/null 2>&1)
2019-10-23 10:10:01 info /usr/sbin/cron[22835]: (root) CMD (/usr/bin/rainbow_button_sync.sh)
2019-10-23 10:10:01 info /usr/sbin/cron[22837]: (root) CMD (nethist_stats.lua)
2019-10-23 10:10:01 info /usr/sbin/cron[22836]: (root) CMD (/usr/bin/notifier)
2019-10-23 10:11:01 info /usr/sbin/cron[22955]: (root) CMD (/usr/bin/rainbow_button_sync.sh)
2019-10-23 10:12:01 info /usr/sbin/cron[23048]: (root) CMD (/usr/sbin/logrotate -s /tmp/logrotate.state /etc/logrotate.conf)
2019-10-23 10:12:01 info /usr/sbin/cron[23051]: (root) CMD (nethist_stats.lua)
2019-10-23 10:12:01 info /usr/sbin/cron[23050]: (root) CMD (/root/connCheck.sh > /dev/null 2>&1)
2019-10-23 10:12:01 info /usr/sbin/cron[23052]: (root) CMD (/usr/bin/rainbow_button_sync.sh)
2019-10-23 10:13:01 info /usr/sbin/cron[23178]: (root) CMD (/usr/bin/rainbow_button_sync.sh)
2019-10-23 10:14:01 info /usr/sbin/cron[23272]: (root) CMD (/usr/bin/rainbow_button_sync.sh)
2019-10-23 10:14:01 info /usr/sbin/cron[23274]: (root) CMD (nethist_stats.lua)
2019-10-23 10:15:01 info /usr/sbin/cron[23368]: (root) CMD (/root/connCheck.sh > /dev/null 2>&1)
2019-10-23 10:15:01 info /usr/sbin/cron[23369]: (root) CMD (/usr/bin/rainbow_button_sync.sh)
2019-10-23 10:15:01 info /usr/sbin/cron[23371]: (root) CMD (/usr/share/nikola/bin/nikola.sh)
2019-10-23 10:15:01 info /usr/sbin/cron[23370]: (root) CMD (/usr/bin/notifier)
2019-10-23 10:15:02 err kernel[]: [407031.616304] vmscan: shrink_slab: super_cache_scan+0x0/0x188 negative objects to delete nr=-2147483618
2019-10-23 10:15:02 err kernel[]: [407031.625904] vmscan: shrink_slab: super_cache_scan+0x0/0x188 negative objects to delete nr=-2147482603
2019-10-23 10:15:02 err kernel[]: [407031.636097] vmscan: shrink_slab: super_cache_scan+0x0/0x188 negative objects to delete nr=-2147482820
2019-10-23 10:15:02 err kernel[]: [407031.645774] vmscan: shrink_slab: super_cache_scan+0x0/0x188 negative objects to delete nr=-2147483354
2019-10-23 10:15:02 err kernel[]: [407031.655454] vmscan: shrink_slab: super_cache_scan+0x0/0x188 negative objects to delete nr=-2147483368
2019-10-23 10:15:02 err kernel[]: [407031.665217] vmscan: shrink_slab: super_cache_scan+0x0/0x188 negative objects to delete nr=-2147483254
2019-10-23 10:15:02 err kernel[]: [407031.674877] vmscan: shrink_slab: super_cache_scan+0x0/0x188 negative objects to delete nr=-2147482438

Dle pohledu do logu mi přijde, že netdata byl obětován především proto, že měl explicitně nastavenou nižší prioritu pro tento účel.

Viníka bych nejspíš hledal primárně dle toho co zabíralo hodně prostoru v /tmp/. Nevidím v tomhle seznamu procesů se spotřebou RAM nic zvláštního – suricata (pakon) pár desítek MB zabírá, ale to mi nepřijde překvapivé a Omnia má 1-2 GiB.

Teď tam zabíraly hodně diagnostiky. Po jejich smazání toto byl tento stav velikosti největších souborů a adresářů v tmp:

/tmp soubory
nethist … 56 799
luci-indexcache … 109 755

/tmp adresáře
/tmp/lib … 6 533 252
z toho pakon.db … 6 533 120

/tmp/log … 358 301 k
z toho
/tmp/log/ludus … 356 501 k
z toho soubor eve.json … 356 812 k

Resume -> problémem je buď jen ludus “jako takový” nebo to, že zrovna nefunguje.