DNS Server not working

Hi,
since this morning there is no internet connection any more through the TO. I changed nothing since yesterday. In the system log as shown below, TO does not get a V4 IP address (I do not use V6) and it can not connect to api.turris.cz. I disabled DNSSEC and/or forwarding, changed to the ISP DNS Server, restarted TO and PC but nothing helped. The Windows problem solver of the attached PC says “the DNS Server is not responding”. Access of the Internet via another router without TO does work, so ISP connection is OK.
In foris: the test of IPv4 and gateway connectivity is OK, DNS/DNSSEC resolving is not OK
In luci: ping request: negative, “bad address”, DNS test: “timeout, no servers could be reached”.
OS 3.11.3
Thank you for any suggestion what might be wrong.

This is the server log, content is alwas repeating due to the errors:

> 2019-04-03 13:00:39 info ucollect[28493]: Socat started
> 2019-04-03 13:00:44 err ucollect[28493]: Failed to resolve uplink api.turris.cz:5679: Try again
> 2019-04-03 13:00:44 warning ucollect[28493]: Didn't get any V4 address in resolution of api.turris.cz
> 2019-04-03 13:00:44 warning ucollect[28493]: Didn't get any V6 address in resolution of api.turris.cz
> 2019-04-03 13:00:44 err ucollect[28493]: Error from socat: 2019/04/03 13:00:44 socat[28616] E getaddrinfo("api.turris.cz", "NULL", {1,2,1,6}, {}): Try again
> 
> 2019-04-03 13:00:44 warning ucollect[28493]: Remote closed the uplink api.turris.cz:5679, reconnecting
> 
> 2019-04-03 13:00:44 warning ucollect[28493]: epoll_wait on 4 interrupted, retry
> 
> 2019-04-03 13:00:44 info ucollect[28493]: Reconnecting to api.turris.cz:5679 now
> 
> 2019-04-03 13:00:44 crit ucollect[28493]: Too many login failures, giving up
> 
> 2019-04-03 13:01:01 info /usr/sbin/cron[28630]: (root) CMD (/usr/bin/rainbow_button_sync.sh)
> 
> 2019-04-03 13:01:44 info ucollect[28647]: Initializing emergency signal handlers
> 
> 2019-04-03 13:01:44 info ucollect[28647]: Creating a main loop
> 
> 2019-04-03 13:01:44 info ucollect[28647]: Creating uplink
> 
> 2019-04-03 13:01:44 info ucollect[28647]: Initializing PCAP (in) on lo
> 
> 2019-04-03 13:01:44 info ucollect[28647]: Initializing PCAP (out) on lo
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Loading plugin library libplugin_ucollect_badconf_25.so
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Installing plugin Badconf with api version 0
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Loading plugin library libplugin_ucollect_bandwidth_22.so
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Installing plugin Bandwidth with api version 0
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Loading plugin library libplugin_ucollect_count_28.so
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Installing plugin Count with api version 0
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Loading plugin library libplugin_ucollect_fake_23.so
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Installing plugin Fake with api version 0
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Loading plugin library libplugin_ucollect_flow_33.so
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Installing plugin Flow with api version 2
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Loading plugin library libpluglib_ucollect_diffstore_1.2.so
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Loading plugin library libplugin_ucollect_fwup_12.so
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Installing plugin Fwup with api version 2
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Loading plugin library libpluglib_ucollect_diffstore_1.2.so
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Loading plugin library libplugin_ucollect_refused_13.so
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Installing plugin Refused with api version 0
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Loading plugin library libplugin_ucollect_sniff_19.so
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Installing plugin Sniff with api version 0
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Loading plugin library libplugin_ucollect_spoof_8.so
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Installing plugin Spoof with api version 0
> 
> 2019-04-03 13:01:45 info ucollect[28647]: Changing remote uplink address to api.turris.cz:5679
> 
> 2019-04-03 13:01:50 err ucollect[28647]: Failed to resolve uplink api.turris.cz:5679: Try again
> 
> 2019-04-03 13:01:50 warning ucollect[28647]: Didn't get any V4 address in resolution of api.turris.cz
> 
> 2019-04-03 13:01:50 warning ucollect[28647]: Didn't get any V6 address in resolution of api.turris.cz
> 
> 2019-04-03 13:01:50 info ucollect[28647]: Sending login credentials disabled
> 
> 2019-04-03 13:01:50 info ucollect[4360]: Last message 'Sending login creden' repeated 5 times, suppressed by syslog-ng on turris
> 
> 2019-04-03 13:01:50 info ucollect[28647]: Unloading plugin library
> 
> 2019-04-03 13:01:50 info ucollect[28647]: Running the main loop
> 
> 2019-04-03 13:01:50 info ucollect[28647]: Reconnecting to api.turris.cz:5679 now
> 
> 2019-04-03 13:01:50 info ucollect[28647]: Socat started
> 
> 2019-04-03 13:01:55 err ucollect[28647]: Failed to resolve uplink api.turris.cz:5679: Try again
> 
> 2019-04-03 13:01:55 warning ucollect[28647]: Didn't get any V4 address in resolution of api.turris.cz
> 
> 2019-04-03 13:01:55 warning ucollect[28647]: Didn't get any V6 address in resolution of api.turris.cz
> 
> 2019-04-03 13:01:55 err ucollect[28647]: Error from socat: 2019/04/03 13:01:55 socat[28656] E getaddrinfo("api.turris.cz", "NULL", {1,10,1,6}, {}): Try again
> 
> 2019-04-03 13:01:55 warning ucollect[28647]: Remote closed the uplink api.turris.cz:5679, reconnecting
> 
> 2019-04-03 13:01:55 warning ucollect[28647]: epoll_wait on 4 interrupted, retry
> 
> 2019-04-03 13:01:55 info ucollect[28647]: Reconnecting to api.turris.cz:5679 now
> 
> 2019-04-03 13:01:55 info ucollect[28647]: Socat started

These errors were shown before, including a checksum error of the internal MMC memory:

> 2019-04-03 12:32:44 err kresd[25525]: SIGBUS received; this is most likely due to filling up the filesystem where cache resides.
> 
> 2019-04-03 12:32:44 warning kernel[]: [ 1715.417882] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 393216 csum 1000242804 expected csum 2049996767
> 
> 2019-04-03 12:32:48 err ucollect[24109]: Failed to resolve uplink api.turris.cz:5679: Try again
> 
> 2019-04-03 12:32:48 warning ucollect[24109]: Didn't get any V4 address in resolution of api.turris.cz
> 
> 2019-04-03 12:32:48 warning ucollect[24109]: Didn't get any V6 address in resolution of api.turris.cz
> 
> 2019-04-03 12:32:48 err ucollect[24109]: Error from socat: 2019/04/03 12:32:48 socat[25422] E getaddrinfo("api.turris.cz", "NULL", {1,2,1,6}, {}): Try again
> 
> 2019-04-03 12:32:48 warning ucollect[24109]: Remote closed the uplink api.turris.cz:5679, reconnecting
> 
> 2019-04-03 12:32:48 warning ucollect[24109]: epoll_wait on 4 interrupted, retry
> 
> 2019-04-03 12:32:48 info ucollect[24109]: Reconnecting to api.turris.cz:5679 now
> 
> 2019-04-03 12:32:48 crit ucollect[24109]: Too many login failures, giving up
> 
> 2019-04-03 12:32:49 err kresd[25721]:
> 
> 2019-04-03 12:32:49 err kresd[25721]: SIGBUS received; this is most likely due to filling up the filesystem where cache resides.
> 
> 2019-04-03 12:32:49 warning kernel[]: [ 1720.462011] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 393216 csum 1000242804 expected csum 2049996767
> 
> 2019-04-03 12:32:54 err kresd[25757]:
> 
> 2019-04-03 12:32:54 err kresd[25757]: SIGBUS received; this is most likely due to filling up the filesystem where cache resides.

Something is written about “BTRFS warning (device mmcblk0p1): csum failed …” and I don’t know if that’s good:

Apart from the possibly broken flash/filesystem, this part typically means that your /tmp/ is full, leading to various problems:

Would you please try to restart your router to see if it helps for you? If not, could you try once again to enable or disable DNS forwarding in Foris?

OK, thank you all.
I just checked the file systems page in luci. It says /tmp is only used by 3%, 30MB of 1010MB. Is there a way to fix a broken filesystem? I agree with Roman that it does not look good regarding the memory. The device is 3 weeks old…

I did the restart and tried all possible variations, with/without forwarding, with/without DNSSEC etc. IP/gateway test in Foris is OK, DNS/DNSSEC test again not OK.

This looks like a kresd daemon - it crashes for some reason and therefore DNS doesn’t work for you. See you through ssh

ps | grep kresd

and write the output here, please.

That SIGBUS message does signify an crash (caught but not recoverable).

That is the whole output:

root@turris:~# ps | grep kresd
14706 root 1108 R grep kresd
root@turris:~#

I did not yet do any changes. It is about like factory default.

OK, but what is the outcome? Broken hardware that has to be exchanged because it is “not recoverable”? Or anything (software) that can be fixed through me?

Try BTRFS fix (don’t know if it helps):
btrfs check --repair /dev/mmcblk0p1
or
btrfs check --clear-space-cache v1 /dev/mmcblk0p1
or
btrfs check --check-data-csum /dev/mmcblk0p1

I’m sorry, but I can’t try and validate right now.

That is the outcome of --check-data-csum… not a perfect result, stopped at 3/7.
“Repair” is not working (mounted)

root@turris:~# btrfs check --force --check-data-csum /dev/mmcblk0p1
Opening filesystem to check...
WARNING: filesystem mounted, continuing because of --force
Checking filesystem on /dev/mmcblk0p1
[1/7] checking root items
[2/7] checking extents
ref mismatch on [147128320 765952] extent item 0, found 10
extent item 147714048 has multiple extent items
ERROR: errors found in extent allocation tree or chunk allocation
[3/7] checking free space cache
there is no free space entry for 147894272-147460096
there is no free space entry for 147894272-801112064
cache appears valid but isn't 12582912
ERROR: errors found in free space cache
found 362868736 bytes used, error(s) found
total csum bytes: 256988
total tree bytes: 103559168
total fs tree bytes: 99426304
total extent tree bytes: 3715072
btree space waste bytes: 28121694
file data blocks allocated: 1666486272
 referenced 1666203648
root@turris:~#

After --clear-space-cache:

[1/7] checking root items
[2/7] checking extents
ref mismatch on [147128320 765952] extent item 0, found 10
extent item 147611648 has multiple extent items
ERROR: errors found in extent allocation tree or chunk allocation
[3/7] checking free space cache
[4/7] checking fs roots
[5/7] checking csums against data
mirror 1 bytenr 147460096 csum 1604028360 expected csum 898237175
mirror 1 bytenr 147464192 csum 213348351 expected csum 1094950640
mirror 1 bytenr 147468288 csum 844813667 expected csum 1076326877
mirror 1 bytenr 147472384 csum 303706614 expected csum 3804615493
mirror 1 bytenr 147480576 csum 1292548231 expected csum 342183652
mirror 1 bytenr 147484672 csum 1860327646 expected csum 3078536957
mirror 1 bytenr 147488768 csum 1539878200 expected csum 661999258
mirror 1 bytenr 147492864 csum 3552540171 expected csum 1345637965
mirror 1 bytenr 147496960 csum 1799456720 expected csum 3381568594
mirror 1 bytenr 147505152 csum 1792414269 expected csum 3915992295
mirror 1 bytenr 147509248 csum 3157063753 expected csum 788582167
mirror 1 bytenr 147513344 csum 1569027606 expected csum 3047533663
mirror 1 bytenr 147517440 csum 3877736832 expected csum 2204020376
mirror 1 bytenr 147521536 csum 1000242804 expected csum 2049996767
mirror 1 bytenr 147525632 csum 2593635896 expected csum 1451870215
mirror 1 bytenr 147529728 csum 2003241903 expected csum 817621989
mirror 1 bytenr 147533824 csum 3697687554 expected csum 206654504
mirror 1 bytenr 147537920 csum 3304641930 expected csum 2694592833
mirror 1 bytenr 147542016 csum 2835186141 expected csum 2322930814
mirror 1 bytenr 147546112 csum 226048157 expected csum 915289613
mirror 1 bytenr 147550208 csum 1093465975 expected csum 1685981753
mirror 1 bytenr 147554304 csum 760661500 expected csum 2081639392
mirror 1 bytenr 147558400 csum 645439562 expected csum 679571946
mirror 1 bytenr 147562496 csum 487265516 expected csum 3952099098
mirror 1 bytenr 147566592 csum 281071879 expected csum 3175760707
mirror 1 bytenr 147570688 csum 2296440455 expected csum 681992238
mirror 1 bytenr 147574784 csum 589117506 expected csum 3641586295
mirror 1 bytenr 147578880 csum 773760381 expected csum 476734911
mirror 1 bytenr 147582976 csum 74734526 expected csum 42934575
mirror 1 bytenr 147587072 csum 2452394823 expected csum 1195283800
mirror 1 bytenr 147591168 csum 2675585889 expected csum 2579579874
mirror 1 bytenr 147595264 csum 1094812114 expected csum 2398433515
mirror 1 bytenr 147599360 csum 410602079 expected csum 3078054294
mirror 1 bytenr 147603456 csum 3280857679 expected csum 642904098
mirror 1 bytenr 147607552 csum 2069676421 expected csum 1998040149
mirror 1 bytenr 147611648 csum 969005992 expected csum 4283352897
mirror 1 bytenr 147615744 csum 6341175 expected csum 2333757766
mirror 1 bytenr 147619840 csum 4218395641 expected csum 3962094765
mirror 1 bytenr 147623936 csum 3251086884 expected csum 1460827023
mirror 1 bytenr 147628032 csum 2122248417 expected csum 3424129490
mirror 1 bytenr 147632128 csum 3790502479 expected csum 2934787180
mirror 1 bytenr 147636224 csum 717676333 expected csum 288231011
mirror 1 bytenr 147640320 csum 1937483707 expected csum 238060655
mirror 1 bytenr 147644416 csum 1395503272 expected csum 94370152
mirror 1 bytenr 147648512 csum 4260508449 expected csum 4209039554
mirror 1 bytenr 147652608 csum 3399700088 expected csum 3283336889
mirror 1 bytenr 147664896 csum 1359460265 expected csum 3547301746
mirror 1 bytenr 147668992 csum 3991912429 expected csum 3670949859
mirror 1 bytenr 147673088 csum 3954915119 expected csum 2692313638
mirror 1 bytenr 147677184 csum 3547185395 expected csum 3055674516
mirror 1 bytenr 147681280 csum 908111140 expected csum 2051380253
mirror 1 bytenr 147685376 csum 3095277323 expected csum 1744241500
mirror 1 bytenr 147689472 csum 316007704 expected csum 153698207
mirror 1 bytenr 147693568 csum 819036922 expected csum 886403817
mirror 1 bytenr 147697664 csum 1573680585 expected csum 240665234
mirror 1 bytenr 147701760 csum 3873195569 expected csum 1488386193
mirror 1 bytenr 147705856 csum 2077523365 expected csum 4026520879
mirror 1 bytenr 147709952 csum 3279973971 expected csum 1613844396
mirror 1 bytenr 147714048 csum 1369853791 expected csum 2964689789
mirror 1 bytenr 147718144 csum 2595162881 expected csum 961966609
mirror 1 bytenr 147722240 csum 2352944865 expected csum 4135885028
mirror 1 bytenr 147726336 csum 2639290988 expected csum 2342269354
mirror 1 bytenr 147730432 csum 3700564171 expected csum 344835455
mirror 1 bytenr 147734528 csum 1079046815 expected csum 3425745359
mirror 1 bytenr 147738624 csum 3182858113 expected csum 1887463430
mirror 1 bytenr 147742720 csum 3995159440 expected csum 523946796
mirror 1 bytenr 147746816 csum 2347204729 expected csum 1068660108
mirror 1 bytenr 147750912 csum 1601719399 expected csum 1830625220
mirror 1 bytenr 147755008 csum 2313263548 expected csum 173452110
mirror 1 bytenr 147759104 csum 3768113220 expected csum 4238217655
mirror 1 bytenr 147763200 csum 1307856235 expected csum 2560074932
mirror 1 bytenr 147767296 csum 139015895 expected csum 388531440
mirror 1 bytenr 147775488 csum 2527230026 expected csum 4161528695
mirror 1 bytenr 147779584 csum 3618549690 expected csum 2616072956
mirror 1 bytenr 147783680 csum 3640016416 expected csum 3052790122
mirror 1 bytenr 147787776 csum 2541697217 expected csum 3177640825
mirror 1 bytenr 147791872 csum 3070527756 expected csum 2452103549
mirror 1 bytenr 147795968 csum 2159240224 expected csum 3021739015
mirror 1 bytenr 147800064 csum 4234487078 expected csum 3939404865
mirror 1 bytenr 147804160 csum 3500027709 expected csum 2659388155
mirror 1 bytenr 147808256 csum 3741260350 expected csum 1194917909
mirror 1 bytenr 147812352 csum 636584091 expected csum 1314422429
mirror 1 bytenr 147816448 csum 138228468 expected csum 3839325713
mirror 1 bytenr 147820544 csum 2631148340 expected csum 3598957400
mirror 1 bytenr 147824640 csum 1917796229 expected csum 2605521350
mirror 1 bytenr 147828736 csum 2962172869 expected csum 4069510342
mirror 1 bytenr 147832832 csum 710230019 expected csum 2039323344
mirror 1 bytenr 147836928 csum 1023697890 expected csum 2134799807
there are no extents for csum range 147775488-147894272
csum exists for 147775488-147894272 but there is no extent record
mirror 1 bytenr 147914752 csum 2045247320 expected csum 3348847258
mirror 1 bytenr 147918848 csum 569398148 expected csum 3322931226
mirror 1 bytenr 147922944 csum 193090081 expected csum 2738439667
mirror 1 bytenr 147927040 csum 2389923815 expected csum 2582380930
mirror 1 bytenr 147931136 csum 4050967499 expected csum 4224592263
mirror 1 bytenr 147935232 csum 70583225 expected csum 3154695893
mirror 1 bytenr 147939328 csum 1761804271 expected csum 3578932283
mirror 1 bytenr 147943424 csum 2592421258 expected csum 3489186199
mirror 1 bytenr 147947520 csum 3922047102 expected csum 2361937482
mirror 1 bytenr 147951616 csum 2367572001 expected csum 3908102460
mirror 1 bytenr 147955712 csum 3894458205 expected csum 2281064399
mirror 1 bytenr 147959808 csum 1936936073 expected csum 2215127628
mirror 1 bytenr 147963904 csum 3415954047 expected csum 1686305351
mirror 1 bytenr 147968000 csum 551623836 expected csum 1386826383
ERROR: errors found in csum tree
[6/7] checking root refs
[7/7] checking quota groups skipped (not enabled on this FS)
found 362811392 bytes used, error(s) found
total csum bytes: 256988
total tree bytes: 103563264
total fs tree bytes: 99426304
total extent tree bytes: 3719168
btree space waste bytes: 28126005
file data blocks allocated: 1666355200
referenced 1666072576
root@turris:~# [1/7] checking root items
-ash: [1/7]: not found
root@turris:~# [2/7] checking extents
-ash: [2/7]: not found
root@turris:~# ref mismatch on [147128320 765952] extent item 0, found 10
-ash: ref: not found
root@turris:~# extent item 147611648 has multiple extent items
-ash: extent: not found
root@turris:~# ERROR: errors found in extent allocation tree or chunk allocation
-ash: ERROR:: not found
root@turris:~# [3/7] checking free space cache
m 1613844396
mirror 1 bytenr 147714048 csum 1369853791 expected csum 2964689789
mirror 1 bytenr 147718144 csum 2595162881 expected csum 961966609
mirror 1 bytenr 147722240 csum 2352944865 expected csum 413-ash: [3/7]: not foun d
root@turris:~# [4/7] checking fs roots
ytenr -ash: [4/7]: not found
root@turris:~# [5/7] checking csums against data
-ash: [5/7]: not found
root@turris:~# mirror 1 bytenr 147460096 csum 1604028360 expected csum 898237175
expecte-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147464192 csum 213348351 expected csum 1094950640
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147468288 csum 844813667 expected csum 1076326877
-ash: mirror: not found
ctroot@turris:~# mirror 1 bytenr 147472384 csum 303706614 expected csum 38046154 93
440 expec-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147480576 csum 1292548231 expected csum 342183652
4729 expec-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147484672 csum 1860327646 expected csum 307853695
7
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147488768 csum 1539878200 expected csum 661999258
63548 expe-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147492864 csum 3552540171 expected csum 134563796
5
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147496960 csum 1799456720 expected csum 338156859
4
-ash: mirror: not found
croot@turris:~# mirror 1 bytenr 147505152 csum 1792414269 expected csum 39159922 9
5
expect-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147509248 csum 3157063753 expected csum 788582167
-ash: 026 expectmirror: not found
root@turris:~# mirror 1 bytenr 147513344 csum 1569027606 expected csum 304753366
3
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147517440 csum 3877736832 expected csum 220402037
6
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147521536 csum 1000242804 expected csum 204999676
7
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147525632 csum 2593635896 expected csum 145187021
5
-ash: mirror: not found
troot@turris:~# mirror 1 bytenr 147529728 csum 2003241903 expected csum 81762198 9
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147533824 csum 3697687554 expected csum 206654504
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147537920 csum 3304641930 expected csum 269459283
3
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147542016 csum 2835186141 expected csum 232293081
4
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147546112 csum 226048157 expected csum 915289613
636584091 exp-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147550208 csum 1093465975 expected csum 168598175
3
-ash: mirror: not found
experoot@turris:~# mirror 1 bytenr 147554304 csum 760661500 expected csum 20816 39392
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147558400 csum 645439562 expected csum 679571946
d csum 3598957400
mirror 1 bytenr 147824640 csum 1917796229 e-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147562496 csum 487265516 expected csum 3952099098
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147566592 csum 281071879 expected csum 3175760707
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147570688 csum 2296440455 expected csum 681992238
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147574784 csum 589117506 expected csum 3641586295
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147578880 csum 773760381 expected csum 476734911
is -ash: mirror: not found
root@turris:~# mirror 1 bytenr 147582976 csum 74734526 expected csum 42934575
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147587072 csum 2452394823 expected csum 119528380
0
ec-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147591168 csum 2675585889 expected csum 257957987
4
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147595264 csum 1094812114 expected csum 239843351
5
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147599360 csum 410602079 expected csum 3078054294
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147603456 csum 3280857679 expected csum 642904098
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147607552 csum 2069676421 expected csum 199804014
9
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147611648 csum 969005992 expected csum 4283352897
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147615744 csum 6341175 expected csum 2333757766
-ash: 3922047102mirror: not found ex
root@turris:~# mirror 1 bytenr 147619840 csum 4218395641 expected csum 396209476
5
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147623936 csum 3251086884 expected csum 146082702
3
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147628032 csum 2122248417 expected csum 342412949
0
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147632128 csum 3790502479 expected csum 293478718
0
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147636224 csum 717676333 expected csum 288231011
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147640320 csum 1937483707 expected csum 238060655

[6/7] che-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147644416 csum 1395503272 expected csum 94370152
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147648512 csum 4260508449 expected csum 420903955
4
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147652608 csum 3399700088 expected csum 328333688
9
99426-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147664896 csum 1359460265 expected csum 354730174
6
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147668992 csum 3991912429 expected csum 367094985
9
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147673088 csum 3954915119 expected csum 269231363
8
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147677184 csum 3547185395 expected csum 305567451
6
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147681280 csum 908111140 expected csum 2051380253
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147685376 csum 3095277323 expected csum 174424150
0
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147689472 csum 316007704 expected csum 153698207
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147693568 csum 819036922 expected csum 886403817
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147697664 csum 1573680585 expected csum 240665234
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147701760 csum 3873195569 expected csum 148838619
3
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147705856 csum 2077523365 expected csum 402652087
9
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147709952 csum 3279973971 expected csum 161384439
6
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147714048 csum 1369853791 expected csum 296468978
9
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147718144 csum 2595162881 expected csum 961966609
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147722240 csum 2352944865 expected csum 413588502
8
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147726336 csum 2639290988 expected csum 234226935
4
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147730432 csum 3700564171 expected csum 344835455
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147734528 csum 1079046815 expected csum 342574535
9
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147738624 csum 3182858113 expected csum 188746343
0
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147742720 csum 3995159440 expected csum 523946796
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147746816 csum 2347204729 expected csum 106866010
8
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147750912 csum 1601719399 expected csum 183062522
0
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147755008 csum 2313263548 expected csum 173452110
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147759104 csum 3768113220 expected csum 423821765
5
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147763200 csum 1307856235 expected csum 256007493
2
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147767296 csum 139015895 expected csum 388531440
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147775488 csum 2527230026 expected csum 416152869
5
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147779584 csum 3618549690 expected csum 261607295
6
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147783680 csum 3640016416 expected csum 305279012
2
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147787776 csum 2541697217 expected csum 317764082
5
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147791872 csum 3070527756 expected csum 245210354
9
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147795968 csum 2159240224 expected csum 302173901
5
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147800064 csum 4234487078 expected csum 393940486
5
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147804160 csum 3500027709 expected csum 265938815
5
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147808256 csum 3741260350 expected csum 119491790
9
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147812352 csum 636584091 expected csum 1314422429
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147816448 csum 138228468 expected csum 3839325713
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147820544 csum 2631148340 expected csum 359895740
0
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147824640 csum 1917796229 expected csum 260552135
0
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147828736 csum 2962172869 expected csum 406951034
2
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147832832 csum 710230019 expected csum 2039323344
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147836928 csum 1023697890 expected csum 213479980
7
-ash: mirror: not found
root@turris:~# there are no extents for csum range 147775488-147894272
-ash: there: not found
root@turris:~# csum exists for 147775488-147894272 but there is no extent record
-ash: csum: not found
root@turris:~# mirror 1 bytenr 147914752 csum 2045247320 expected csum 334884725
8
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147918848 csum 569398148 expected csum 3322931226
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147922944 csum 193090081 expected csum 2738439667
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147927040 csum 2389923815 expected csum 258238093
0
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147931136 csum 4050967499 expected csum 422459226
3
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147935232 csum 70583225 expected csum 3154695893
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147939328 csum 1761804271 expected csum 357893228
3
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147943424 csum 2592421258 expected csum 348918619
9
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147947520 csum 3922047102 expected csum 236193748
2
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147951616 csum 2367572001 expected csum 390810246
0
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147955712 csum 3894458205 expected csum 228106439
9
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147959808 csum 1936936073 expected csum 221512762
8
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147963904 csum 3415954047 expected csum 168630535
1
-ash: mirror: not found
root@turris:~# mirror 1 bytenr 147968000 csum 551623836 expected csum 1386826383
-ash: mirror: not found
root@turris:~# ERROR: errors found in csum tree
-ash: ERROR:: not found
root@turris:~# [6/7] checking root refs
-ash: [6/7]: not found
root@turris:~# [7/7] checking quota groups skipped (not enabled on this FS)
-ash: syntax error: unexpected “(”
root@turris:~# found 362811392 bytes used, error(s) found
-ash: syntax error: unexpected “(”
root@turris:~# total csum bytes: 256988
-ash: total: not found
root@turris:~# total tree bytes: 103563264
-ash: total: not found
root@turris:~# total fs tree bytes: 99426304
-ash: total: not found
root@turris:~# total extent tree bytes: 3719168
-ash: total: not found
root@turris:~# btree space waste bytes: 28126005
-ash: btree: not found
root@turris:~# file data blocks allocated: 1666355200
data: cannot open data' (No such file or directory) blocks: cannot open blocks’ (No such file or directory)
allocated:: cannot open allocated:' (No such file or directory) 1666355200: cannot open 1666355200’ (No such file or directory)
root@turris:~# referenced 1666072576
-ash: referenced: not found
root@turris:~# root@turris:~#
-ash: root@turris:~#: not found
root@turris:~#


Quick question: How can I put a window here with a scroll bar to avoid these long posts?

So here I am at the end, sorry. The last option would be a re-flash router.
Maybe someone else will have an idea …

Vcunat pointed out that the “data” file and the “allocation” file are not accessible which for sure is a problem. I can not repair the tmp file because it is mounted, --force does not work and there is no function to unmount it. I saved some config files recently to reverse changes I have done. I will try to do a rollback now and see if that helps. But if tmp is really corrupted that might not work. Do you mean re-flash like going back to factory status?

  1. /tmp directory is virtual memory (RAM) - not physically on Flash disk.
  2. Reflash router by this: https://doc.turris.cz/doc/en/howto/omnia_factory_reset - but it’s like a last resort.

I actually can’t yet see how the /tmp-full problem is related to the btrfs problems. /tmp is in RAM and will be clean on every reboot. That btrfs is on flash, and rollback won’t by itself delete the corrupted data, but it may cause you to use older version of data that wasn’t corrupted, so you certainly may try that as a starting point.

OK, thank you both. Rollback did not help, as expected. /tmp is in RAM, I should have known that. I agree with you that /tmp-full and btrfs problem are separated. /tmp is not full (as shown in luci) and the restart should have fixed that part anyway by flushing the /tmp data. So I assume there is only one btrfs problem in the flash memory left.
Before doing the complete ugly factory-reset (how) can I repair the flash memory issues of corrupted data?

Finally, I did the factory-reset (stage 3, 3 led lights) and TO is working now. That is the good news. The bad news is that even more checksum errors are shown for mmcblk0p1 in the syslog:

Summary

2019-04-07T02:05:12+02:00 warning kernel: [22038.491710] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 1138678673 expected csum 3348847258
2019-04-07T02:05:12+02:00 warning kernel: [22038.491973] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 1138678673 expected csum 3348847258
2019-04-07T00:05:12+02:00 info kresd[24431]: [ ta ] key: 20326 state: Valid
2019-04-07T00:05:12+02:00 info kresd[24431]: [ ta ] next refresh for . in 13.808333333333 hours
2019-04-07T02:05:13+02:00 warning kernel: [22039.052072] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:05:13+02:00 warning kernel: [22039.151915] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:05:13+02:00 warning kernel: [22039.152167] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T00:05:23+02:00 info kresd[24431]: net.ipv6 = false
2019-04-07T00:05:23+02:00 info kresd[24431]:
2019-04-07T02:05:23+02:00 info kernel: [22049.097314] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 348160
2019-04-07T02:05:23+02:00 info kernel: [22049.097337] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 372736
2019-04-07T02:05:23+02:00 info kernel: [22049.097354] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 528384
2019-04-07T02:05:23+02:00 info kernel: [22049.097364] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 532480
2019-04-07T02:05:23+02:00 info kernel: [22049.097380] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 643072
2019-04-07T02:05:23+02:00 info kernel: [22049.103277] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 348160
2019-04-07T02:05:23+02:00 info kernel: [22049.103298] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 372736
2019-04-07T02:05:23+02:00 info kernel: [22049.103315] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 528384
2019-04-07T02:05:23+02:00 info kernel: [22049.103325] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 532480
2019-04-07T02:05:23+02:00 info kernel: [22049.103341] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 643072
2019-04-07T02:05:23+02:00 warning kernel: [22049.103769] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:05:23+02:00 warning kernel: [22049.109488] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:05:23+02:00 warning kernel: [22049.117050] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 344064 csum 4146773188 expected csum 3804615493
2019-04-07T02:05:23+02:00 warning kernel: [22049.126072] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 344064 csum 4146773188 expected csum 3804615493
2019-04-07T02:05:23+02:00 warning kernel: [22049.126468] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:05:29+02:00 warning kernel: [22055.380863] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 850896754 expected csum 3348847258
2019-04-07T02:05:29+02:00 warning kernel: [22055.843693] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:05:29+02:00 warning kernel: [22055.843980] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:05:30+02:00 warning kernel: [22055.906479] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:05:44+02:00 info kernel: [22070.307029] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 348160
2019-04-07T02:05:44+02:00 info kernel: [22070.307052] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 372736
2019-04-07T02:05:44+02:00 info kernel: [22070.307069] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 528384
2019-04-07T02:05:44+02:00 info kernel: [22070.307079] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 532480
2019-04-07T02:05:44+02:00 info kernel: [22070.307095] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 643072
2019-04-07T02:05:44+02:00 warning kernel: [22070.313402] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:05:44+02:00 warning kernel: [22070.321083] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 344064 csum 3489050329 expected csum 3804615493
2019-04-07T02:05:44+02:00 warning kernel: [22070.321279] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:05:50+02:00 warning kernel: [22076.507258] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 3962828385 expected csum 3348847258
2019-04-07T02:05:50+02:00 warning kernel: [22076.507528] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 3962828385 expected csum 3348847258
2019-04-07T02:05:51+02:00 warning kernel: [22076.974477] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:05:51+02:00 warning kernel: [22076.974763] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:05:51+02:00 warning kernel: [22077.035411] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:05:51+02:00 warning kernel: [22077.035677] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T00:06:01+02:00 info /usr/sbin/cron[15261]: (root) CMD (/usr/bin/rainbow_button_sync.sh)
2019-04-07T00:06:01+02:00 info /usr/sbin/cron[15262]: (root) CMD (nethist_stats.lua)
2019-04-07T02:06:03+02:00 info kernel: [22089.638006] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 348160
2019-04-07T02:06:03+02:00 info kernel: [22089.638029] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 372736
2019-04-07T02:06:03+02:00 info kernel: [22089.638045] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 528384
2019-04-07T02:06:03+02:00 info kernel: [22089.638055] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 532480
2019-04-07T02:06:03+02:00 info kernel: [22089.638071] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 643072
2019-04-07T02:06:03+02:00 warning kernel: [22089.644399] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:06:03+02:00 warning kernel: [22089.652076] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 344064 csum 2462641187 expected csum 3804615493
2019-04-07T02:06:03+02:00 warning kernel: [22089.652456] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:06:10+02:00 warning kernel: [22096.581797] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:06:10+02:00 warning kernel: [22096.582063] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:06:11+02:00 warning kernel: [22097.049751] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:06:11+02:00 warning kernel: [22097.050001] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:06:11+02:00 warning kernel: [22097.107799] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:06:11+02:00 warning kernel: [22097.108058] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:06:24+02:00 info kernel: [22110.120129] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 348160
2019-04-07T02:06:24+02:00 info kernel: [22110.120152] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 372736
2019-04-07T02:06:24+02:00 info kernel: [22110.120169] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 528384
2019-04-07T02:06:24+02:00 info kernel: [22110.120179] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 532480
2019-04-07T02:06:24+02:00 info kernel: [22110.120194] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 643072
2019-04-07T02:06:24+02:00 warning kernel: [22110.126596] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:06:24+02:00 warning kernel: [22110.134177] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 344064 csum 2462641187 expected csum 3804615493
2019-04-07T02:06:24+02:00 warning kernel: [22110.134347] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:06:30+02:00 warning kernel: [22116.624775] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:06:30+02:00 warning kernel: [22116.625044] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:06:31+02:00 warning kernel: [22117.080815] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:06:31+02:00 warning kernel: [22117.081109] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:06:31+02:00 warning kernel: [22117.142000] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:06:31+02:00 warning kernel: [22117.142272] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:06:44+02:00 info kernel: [22130.418399] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 348160
2019-04-07T02:06:44+02:00 info kernel: [22130.418421] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 372736
2019-04-07T02:06:44+02:00 info kernel: [22130.418438] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 528384
2019-04-07T02:06:44+02:00 info kernel: [22130.418447] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 532480
2019-04-07T02:06:44+02:00 info kernel: [22130.418463] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 643072
2019-04-07T02:06:44+02:00 warning kernel: [22130.425035] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:06:44+02:00 warning kernel: [22130.432594] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 344064 csum 2462641187 expected csum 3804615493
2019-04-07T02:06:44+02:00 warning kernel: [22130.432760] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:06:51+02:00 warning kernel: [22136.996023] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:06:51+02:00 warning kernel: [22136.996367] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:06:51+02:00 warning kernel: [22137.451471] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:06:51+02:00 warning kernel: [22137.451764] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:06:51+02:00 warning kernel: [22137.515888] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:06:51+02:00 warning kernel: [22137.516157] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T00:07:01+02:00 info /usr/sbin/cron[9637]: (root) CMD (/usr/bin/rainbow_button_sync.sh)
2019-04-07T02:07:04+02:00 info kernel: [22150.568980] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 348160
2019-04-07T02:07:04+02:00 info kernel: [22150.569003] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 372736
2019-04-07T02:07:04+02:00 info kernel: [22150.569019] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 528384
2019-04-07T02:07:04+02:00 info kernel: [22150.569029] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 532480
2019-04-07T02:07:04+02:00 info kernel: [22150.569044] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 643072
2019-04-07T02:07:04+02:00 warning kernel: [22150.575458] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:07:04+02:00 warning kernel: [22150.583032] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 344064 csum 2462641187 expected csum 3804615493
2019-04-07T02:07:04+02:00 warning kernel: [22150.583408] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:07:11+02:00 warning kernel: [22157.716400] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:07:11+02:00 warning kernel: [22157.716677] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:07:12+02:00 warning kernel: [22158.193785] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:07:12+02:00 warning kernel: [22158.194093] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:07:12+02:00 warning kernel: [22158.253901] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:07:12+02:00 warning kernel: [22158.254167] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:07:24+02:00 info kernel: [22170.227565] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 348160
2019-04-07T02:07:24+02:00 info kernel: [22170.227588] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 372736
2019-04-07T02:07:24+02:00 info kernel: [22170.227605] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 528384
2019-04-07T02:07:24+02:00 info kernel: [22170.227615] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 532480
2019-04-07T02:07:24+02:00 info kernel: [22170.227630] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 643072
2019-04-07T02:07:24+02:00 warning kernel: [22170.234176] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:07:24+02:00 warning kernel: [22170.241778] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 344064 csum 2462641187 expected csum 3804615493
2019-04-07T02:07:24+02:00 warning kernel: [22170.241937] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:07:30+02:00 warning kernel: [22176.709542] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:07:30+02:00 warning kernel: [22176.709810] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:07:31+02:00 warning kernel: [22177.171578] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:07:31+02:00 warning kernel: [22177.171868] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:07:31+02:00 warning kernel: [22177.231936] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:07:31+02:00 warning kernel: [22177.232204] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:07:44+02:00 info kernel: [22190.858674] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 348160
2019-04-07T02:07:44+02:00 info kernel: [22190.858696] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 372736
2019-04-07T02:07:44+02:00 info kernel: [22190.858713] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 528384
2019-04-07T02:07:44+02:00 info kernel: [22190.858722] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 532480
2019-04-07T02:07:44+02:00 info kernel: [22190.858738] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 643072
2019-04-07T02:07:44+02:00 warning kernel: [22190.865084] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:07:44+02:00 warning kernel: [22190.872736] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 344064 csum 2462641187 expected csum 3804615493
2019-04-07T02:07:44+02:00 warning kernel: [22190.872898] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:07:51+02:00 warning kernel: [22197.521346] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:07:51+02:00 warning kernel: [22197.521637] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:07:52+02:00 warning kernel: [22197.979424] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:07:52+02:00 warning kernel: [22197.979715] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:07:52+02:00 warning kernel: [22198.039172] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:07:52+02:00 warning kernel: [22198.039437] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T00:08:01+02:00 info /usr/sbin/cron[3742]: (root) CMD (nethist_stats.lua)
2019-04-07T00:08:01+02:00 info /usr/sbin/cron[3743]: (root) CMD (/usr/bin/rainbow_button_sync.sh)
2019-04-07T02:08:05+02:00 info kernel: [22211.609034] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 348160
2019-04-07T02:08:05+02:00 info kernel: [22211.609055] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 372736
2019-04-07T02:08:05+02:00 info kernel: [22211.609071] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 528384
2019-04-07T02:08:05+02:00 info kernel: [22211.609080] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 532480
2019-04-07T02:08:05+02:00 info kernel: [22211.609096] BTRFS info (device mmcblk0p1): no csum found for inode 9886 start 643072
2019-04-07T02:08:05+02:00 warning kernel: [22211.615633] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:08:05+02:00 warning kernel: [22211.623223] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 344064 csum 2462641187 expected csum 3804615493
2019-04-07T02:08:05+02:00 warning kernel: [22211.623388] BTRFS warning (device mmcblk0p1): csum failed ino 9886 off 331776 csum 2504910500 expected csum 898237175
2019-04-07T02:08:12+02:00 warning kernel: [22218.190480] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:08:12+02:00 warning kernel: [22218.190756] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:08:12+02:00 warning kernel: [22218.651735] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:08:12+02:00 warning kernel: [22218.652115] BTRFS warning (device mmcblk0p1): csum failed ino 9903 off 4096 csum 3278825049 expected csum 3489186199
2019-04-07T02:08:12+02:00 warning kernel: [22218.715659] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:08:12+02:00 warning kernel: [22218.715923] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T00:08:26+02:00 info hostapd: wlan1: STA 9e:ff:4d:15:0a:78 WPA: group key handshake completed (RSN)
2019-04-07T00:08:26+02:00 info hostapd: wlan1: STA 30:07:4d:dd:a3:df WPA: group key handshake completed (RSN)
2019-04-07T02:08:28+02:00 warning kernel: [22234.334722] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:08:28+02:00 warning kernel: [22234.334992] BTRFS warning (device mmcblk0p1): csum failed ino 9902 off 0 csum 2263713221 expected csum 3348847258
2019-04-07T02:08:28+02:00 warning kernel: [22234.869776] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399
2019-04-07T02:08:28+02:00 warning kernel: [22234.870048] BTRFS warning (device mmcblk0p1): csum failed ino 9904 off 0 csum 994174497 expected csum 2281064399

After a few minutes it stopped showing these errors, I do not know if that is a good sign or not.

I have seen that other users also had problems with the memory:

Or as seen in the above quoted post from RomanHK

I do NOT use LXC container or NextCloud, so I think after three weeks of using the new TO there should be no wear-out.

That is all I could do. But my question remains if the TO is broken or not? As of now my trust in it is not really high due to the numerous csum errors. There are other errors shown in the syslog, too.

Thanks for suggestions!

1 Like

Hi @Canis111,

Can you let us know if you had any power outages? Would you please re-flash your router from the flash drive? It would really help us to see if the errors are still there or not. For now, it could mean that you have just corrupted the file system instead of eMMC and medkit should solve it.

Hi Pepe,

I did the re-flash with the latest medkit and so far all is OK. I do not see any csum errors of the flash in the syslog any more. So your suggestion was a good idea.
To avoid bigger wear-out of the flash, I mounted the internal SSD I have installed earlier as /srv in sda. It is shown in foris under “storage” as “device in use is currently sda”. That should help keeping the flash healthy.
Again, thanks to all of you for your help!