Reboot loop after upgrade to 3.11.9

I’m a special case :innocent:. Since the reboot on my router doesn’t work for me, I have the latest version 3.11.9 and it doesn’t reboot for me. One bug fixes another bug :crazy_face: crazy!

1 Like

It might be unpredictable when the /tmp is full.

We are investigating this issue since we heard about that and many thanks to @yorik for including the output from the serial cable! It appears that something slips to the stable release of kernel 4.4 LTS. In some cases, the router rebooted a few times, but after that, it works flawlessly and on the other hand, there might be a nasty bug, which might do reboot loop and we are really sorry for that!

As some of you can notice in the Czech section, we are working on Turris OS 3.11.10, where it should be solved. The RC version should be released tomorrow.

2 Likes

Hello, i have same problem as https://forum.test.turris.cz/t/reboot-loop-when-starting/3462 after update to the Verze Turris OS 3.11.9
Solution: restore to factory default, run updater.sh manualy
After update to 3.11.9 and restore config from backup … still reboot loop

Additional info:

root@AP:/tmp/log# cat messages | grep kernel | grep warn
2019-11-29 22:11:06 warning kernel[]: [ 14.123736] ath10k_pci 0000:02:00.0: Direct firmware load for ath10k/pre-cal-pci-0000:02:00.0.bin failed with error -2
2019-11-29 22:11:06 warning kernel[]: [ 14.134472] ath10k_pci 0000:02:00.0: Falling back to user helper
2019-11-29 22:11:06 warning kernel[]: [ 14.153874] ath10k_pci 0000:02:00.0: Direct firmware load for ath10k/cal-pci-0000:02:00.0.bin failed with error -2
2019-11-29 22:11:06 warning kernel[]: [ 14.164265] ath10k_pci 0000:02:00.0: Falling back to user helper
2019-11-29 22:11:06 warning kernel[]: [ 14.255230] ath10k_pci 0000:02:00.0: board id is not exist in otp, ignore it
2019-11-29 22:11:06 warning kernel[]: [ 14.262345] ath10k_pci 0000:02:00.0: Direct firmware load for ath10k/QCA988X/hw2.0/board-2.bin failed with error -2
2019-11-29 22:11:06 warning kernel[]: [ 14.272810] ath10k_pci 0000:02:00.0: Falling back to user helper

root@AP:/tmp/log# cat messages | grep kernel | grep err
2019-11-29 22:11:06 warning kernel[]: [ 14.123736] ath10k_pci 0000:02:00.0: Direct firmware load for ath10k/pre-cal-pci-0000:02:00.0.bin failed with error -2
2019-11-29 22:11:06 err kernel[]: [ 14.144773] firmware ath10k!pre-cal-pci-0000:02:00.0.bin: firmware_loading_store: map pages failed
2019-11-29 22:11:06 warning kernel[]: [ 14.153874] ath10k_pci 0000:02:00.0: Direct firmware load for ath10k/cal-pci-0000:02:00.0.bin failed with error -2
2019-11-29 22:11:06 err kernel[]: [ 14.174238] firmware ath10k!cal-pci-0000:02:00.0.bin: firmware_loading_store: map pages failed
2019-11-29 22:11:06 warning kernel[]: [ 14.262345] ath10k_pci 0000:02:00.0: Direct firmware load for ath10k/QCA988X/hw2.0/board-2.bin failed with error -2
2019-11-29 22:11:06 err kernel[]: [ 14.282938] firmware ath10k!QCA988X!hw2.0!board-2.bin: firmware_loading_store: map pages failed
2019-11-29 22:13:46 err kernel[]: [ 193.660679] tpacket_rcv: packet too big, clamped from 36054 to 32638. macoff=82

@yorik 's solutions (see above) doesn’t help

I have the same traceback.

# cat /etc/turris-version 
3.11.9

# while [ 1 ]; do dmesg; sleep 1; done
[  142.679128] Unable to handle kernel paging request at virtual address 6eb80b92
[  142.686385] pgd = ec5b4000
[  142.689096] [6eb80b92] *pgd=00000000
[  142.692700] Internal error: Oops: 1 [#1] SMP ARM
[  142.697325] Modules linked in: qcserial option iptable_nat ath9k usb_wwan rndis_host qmi_wwan pppoe nf_nat_pptp nf_nat_ipv4 nf_nat_amanda nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_ipv6 nf_conntrack_ipv4 nf_conntrack_amanda ipt_REJECT ipt_MASQUERADE ebtable_nat ebtable_filter ebtable_broute cdc_ether ath9k_common armada_thermal xt_u32 xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_recent xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_id xt_hl xt_helper xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_TCPMSS xt_REDIRECT xt_LOG xt_HL xt_DSCP xt_CT xt_CLASSIFY usbserial usbnet ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress ums_alauda ts_kmp ts_fsm ts_bm thermal_sys pppox ppp_mppe ppp_async nfnetlink nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_redirect nf_nat_proto_gre nf_nat_masquerade_ipv4 nf_nat_irc nf_nat_h323 nf_nat_ftp nf_nat nf_log_ipv4 nf_defrag_ipv6 nf_defrag_ipv4 nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_rtcache nf_conntrack_proto_gre nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp nf_conntrack_broadcast mvsdio iptable_raw iptable_mangle iptable_filter ipt_ECN ip_tables hwmon ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt cdc_wdm ath9k_hw fuse sch_cake nf_conntrack sch_teql sch_tbf sch_sfq sch_red sch_prio sch_pie sch_netem sch_htb sch_gred sch_fq sch_dsmark sch_codel em_text em_nbyte em_meta em_cmp cls_basic act_vlan act_police act_pedit act_nat act_ipt act_gact act_csum act_bpf act_skbedit act_mirred em_u32 cls_u32 cls_tcindex cls_flow cls_route cls_fw sch_hfsc sch_ingress ath10k_pci ath10k_core ath mac80211 cfg80211 compat ledtrig_usbdev ledtrig_oneshot xt_LED ledtrig_morse ledtrig_heartbeat ledtrig_gpio cryptodev ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 nf_log_common ip6table_raw ip6table_mangle ip6table_filter ip6_tables x_tables pppoatm ppp_generic slhc nfsd nfsv3 msdos ip_gre gre ifb sit ip6_tunnel tunnel6 tunnel4 ip_tunnel tun snd_compress snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd_rawmidi snd_seq_device snd_hwdep snd input_core soundcore rxkad vfat fat udf crc_itu_t ntfs nfs_layout_nfsv41_files nfsv4 nfs auth_rpcgss oid_registry lockd sunrpc grace minix isofs hfsplus hfs cramfs configfs cifs autofs4 kafs af_rxrpc dns_resolver dm_crypt dm_mirror dm_region_hash dm_log dm_mod br2684 atm multipath fscache raid456 async_raid6_recov async_pq async_xor async_memcpy async_tx raid10 raid1 raid0 linear md_mod nls_utf8 nls_koi8_r nls_cp1255 nls_iso8859_6 nls_iso8859_2 nls_iso8859_15 nls_iso8859_13 nls_iso8859_1 nls_cp932 nls_cp866 nls_cp864 nls_cp862 nls_cp852 nls_cp850 nls_cp775 nls_cp437 nls_cp1251 nls_cp1250 xts algif_skcipher algif_hash af_alg sha512_generic sha256_generic sha1_generic seqiv jitterentropy_rng drbg pcbc md5 md4 marvell_cesa hmac gf128mul fcrypt ecb des_generic ctr cmac ccm cbc authenc xhci_plat_hcd xhci_pci xhci_hcd uhci_hcd ledtrig_transient ahci_platform uas xfs libcrc32c jfs f2fs exfat mii aead crypto_null
[  142.971519] CPU: 0 PID: 2449 Comm: hostapd Not tainted 4.4.202-a890a5a94ebb621f8f1720c24d12fef1-0 #1
[  142.980672] Hardware name: Marvell Armada 380/385 (Device Tree)
[  142.986604] task: ef08e600 ti: ec21c000 task.ti: ec21c000
[  142.992019] PC is at __siphash_aligned+0x2c/0xbdc
[  142.996732] LR is at 0xec21db08
[  142.999879] pc : [<c05aa764>]    lr : [<ec21db08>]    psr: 80000013
[  142.999879] sp : ec21d9c8  ip : ec21dae0  fp : ec21dadc
[  143.011383] r10: ec21daf8  r9 : ed7e0c3c  r8 : ed7e0c30
[  143.016617] r7 : ed0e26f0  r6 : 00000000  r5 : 6eb80b8a  r4 : 0000fffe
[  143.023158] r3 : 00000010  r2 : 6eb80b8a  r1 : 10000000  r0 : ec21daf8
[  143.029699] Flags: Nzcv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment none
[  143.036850] Control: 10c5387d  Table: 2c5b404a  DAC: 00000051
[  143.042608] Process hostapd (pid: 2449, stack limit = 0xec21c210)
[  143.048714] Stack: (0xec21d9c8 to 0xec21e000)
[  143.053081] d9c0:                   dc7665a1 c2e3032d c0799800 00000009 ec21daf8 00000000
[  143.061277] d9e0: 00000000 10000000 176ffcf8 b79e83a5 00012be3 00000000 0016077e 00000000
[  143.069474] da00: 0000cb1c 00000000 00000000 e86494d1 9c670681 00000000 00000853 00000000
[  143.077671] da20: 00000000 7b67d36d fbbd452b 00000000 0000ddba 00000000 ec21db1c 00000000
[  143.085867] da40: e9fa7780 ec2b45d0 eda00154 ec2b4064 ec21da8c ec21da60 bf6a774c bf6a75a0
[  143.094063] da60: 00000fff c2e3032d dc7665a1 ec2c4000 e9fa7780 ec21daf0 00000008 e2c2242e
[  143.102260] da80: ec21dacc ec21da90 bf6e040c bf6a76ec 00000000 59b96d7c 0f274099 00000000
[  143.110456] daa0: 00001d53 e9fa7780 e9fa7780 ec85d480 ec21dacc 0000fffe 6eb80b8a 00000000
[  143.118653] dac0: ed0e26f0 ed7e0c30 ed7e0c3c ed0e2658 ec21db3c ec21dae0 c04a4fa0 c05aa744
[  143.126848] dae0: 00000000 00000000 00000085 00000004 00000022 00000000 00008e88 00000000
[  143.135044] db00: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  143.143240] db20: 00000000 00000000 ed7e0c30 ed0e2658 ec21db54 ec21db40 bf6b9734 c04a4eb4
[  143.151437] db40: ed7e0ba0 e9fa7780 ec21db94 ec21db58 bf6ba3b0 bf6b9720 00000000 ec85d480
[  143.159634] db60: 38a7cf63 00000021 bf6b6c64 e9fa7780 ec85d480 00000000 00000085 ed7e0ba0
[  143.167830] db80: 00000000 ec85d480 ec21dbf4 ec21db98 bf6bb3f0 bf6ba2d8 e9fa7d80 00000000
[  143.176026] dba0: e9fa7780 ec21dba4 ec21dba4 00000000 00000000 ed7e0ba0 ec85d480 ec2b4000
[  143.184224] dbc0: 00000000 00000a00 00000002 0000001a e9fa7780 ec85d480 ed7e0ba0 ec2b4000
[  143.192420] dbe0: 00000000 00000000 ec21dc14 ec21dbf8 bf6bb4e8 bf6bb350 00000070 00000000
[  143.200616] dc00: ec85d000 00000000 ec21dcd4 ec21dc18 bf6bc1e4 bf6bb460 c076a450 00000040
[  143.208813] dc20: ec21dc44 ec21dc30 c04ab480 c008c89c ec21dc68 00000001 ec21dca4 ec21dc48
[  143.217009] dc40: c04ac67c c04ab418 c06eb600 c076ba60 c076eda3 c076ba60 2ef6c000 c07674c0
[  143.225206] dc60: ef6d34c0 ec2b4000 ec21dc68 ec21dc68 ec21dc70 ec21dc70 ec21dc9c c076a08c
[  143.233403] dc80: c076a080 40000003 ec21c000 00000100 c076a08c c076a090 ec21dd04 ec21dca8
[  143.241599] dca0: c002c230 c002bbc8 ec21dcdc e9fa7780 ec85d000 e2c23e42 00000000 ed80a000
[  143.249796] dcc0: 00000000 00000000 ec21dd1c ec21dcd8 bf6bc62c bf6bbd88 18fa9200 ec85d480
[  143.257993] dce0: ec85d480 00000000 00000000 00006000 00000000 e9fa7780 ec85d000 ec85d000
[  143.266189] dd00: 00000000 ed80a000 00000000 00000000 ec21dd6c ec21dd20 c04aef98 bf6bc600
[  143.274385] dd20: ec21dd80 c076a100 ed80a000 00000000 00000000 c076ba60 c04aea74 c04ae6d4
[  143.282582] dd40: ec21dd6c e9fa7780 c0766564 ec85d000 00000000 ed80a000 00000000 00000000
[  143.290778] dd60: ec21ddc4 ec21dd70 c04af644 c04aed6c 00000008 e2c23e42 ec21dda4 ec21dd88
[  143.298974] dd80: fffffff4 bf6c42fc ec85d000 ec85d000 e9fa7780 e2c23f40 ec21ddb4 e9fa7780
[  143.307171] dda0: ec85d000 00000063 e2c23f40 00000063 00000000 00000000 ec21ddd4 ec21ddc8
[  143.315367] ddc0: c04af7a8 c04af1ac ec21dea4 ec21ddd8 c058fe88 c04af7a0 00000000 00000000
[  143.323563] dde0: 00000071 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  143.331759] de00: 00000000 00000000 ec21df0c 00000050 00008e88 00000000 00000000 ec594400
[  143.339955] de20: eeeb6a80 00000000 0000000a 00000000 00000000 00000000 00000000 00000000
[  143.348152] de40: 0000000e 00000000 00008e88 00000000 00000000 00000000 00000000 00000000
[  143.356348] de60: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  143.364544] de80: eeeb6a80 beb3d56c 00000014 00000000 ec21c000 00000122 ec21deb4 ec21dea8
[  143.372740] dea0: c0492834 c058f244 ec21dfa4 ec21deb8 c0493aac c0492824 ec21dedc 00000000
[  143.380937] dec0: 00000000 00000000 00000000 b6f25d50 00000063 ec21df00 00000014 00000001
[  143.389132] dee0: 00000000 00000000 ec21ded4 00000000 00000000 00000000 00000000 ee972ae0
[  143.397329] df00: 8e880011 00000015 06000000 18fa9200 0000b7d8 c0113f80 ec21df5c ec21df28
[  143.405525] df20: c00f6848 c011418c 00000020 00000000 ec21df54 ef08e9b0 ef08e600 c0799d6c
[  143.413722] df40: 00000000 c0009ea4 ec21c000 00000006 ec21df6c ec21df60 c00f6940 c00f671c
[  143.421918] df60: ec21df8c ec21df70 c0042674 c000f7dc 00000000 ec21c000 c0009ea4 ec21dfb0
[  143.430114] df80: ec21dfac beb3d56c 00000014 00000063 00000122 c0009ea4 00000000 ec21dfa8
[  143.438310] dfa0: c0009cc0 c04939fc beb3d56c 00000014 00000011 b6f25d50 00000063 00000000
[  143.446506] dfc0: beb3d56c 00000014 00000063 00000122 00000000 b6f25d50 0000008a 00000010
[  143.454702] dfe0: beb3d500 beb3d4ec b6f7b8d8 b6f7abb8 60000010 00000011 00000000 00000000
[  143.462896] Backtrace: 
[  143.465363] [<c05aa738>] (__siphash_aligned) from [<c04a4fa0>] (skb_get_hash_perturb+0xf8/0x15c)
[  143.474166]  r10:ed0e2658 r9:ed7e0c3c r8:ed7e0c30 r7:ed0e26f0 r6:00000000 r5:6eb80b8a
[  143.482065]  r4:0000fffe
[  143.484674] [<c04a4ea8>] (skb_get_hash_perturb) from [<bf6b9734>] (ieee80211_unreserve_tid+0x80/0x7ac [mac80211])
[  143.494958]  r5:ed0e2658 r4:ed7e0c30
[  143.498612] [<bf6b9714>] (ieee80211_unreserve_tid [mac80211]) from [<bf6ba3b0>] (ieee80211_tx_dequeue+0x550/0x71c [mac80211])
[  143.509941]  r5:e9fa7780 r4:ed7e0ba0
[  143.513590] [<bf6ba2cc>] (ieee80211_tx_dequeue [mac80211]) from [<bf6bb3f0>] (ieee80211_tx_prepare_skb+0x1dc/0x240 [mac80211])
[  143.525005]  r10:ec85d480 r9:00000000 r8:ed7e0ba0 r7:00000085 r6:00000000 r5:ec85d480
[  143.532902]  r4:e9fa7780
[  143.535496] [<bf6bb344>] (ieee80211_tx_prepare_skb [mac80211]) from [<bf6bb4e8>] (ieee80211_xmit+0x94/0xe8 [mac80211])
[  143.546214]  r9:00000000 r8:00000000 r7:ec2b4000 r6:ed7e0ba0 r5:ec85d480 r4:e9fa7780
[  143.554075] [<bf6bb454>] (ieee80211_xmit [mac80211]) from [<bf6bc1e4>] (__ieee80211_subif_start_xmit+0x468/0x878 [mac80211])
[  143.565315]  r7:00000000 r6:ec85d000 r5:00000000 r4:00000070
[  143.571072] [<bf6bbd7c>] (__ieee80211_subif_start_xmit [mac80211]) from [<bf6bc62c>] (ieee80211_subif_start_xmit+0x38/0x2e4 [mac80211])
[  143.583270]  r10:00000000 r9:00000000 r8:ed80a000 r7:00000000 r6:e2c23e42 r5:ec85d000
[  143.591166]  r4:e9fa7780
[  143.593738] [<bf6bc5f4>] (ieee80211_subif_start_xmit [mac80211]) from [<c04aef98>] (dev_hard_start_xmit+0x238/0x338)

Until the fix arrives (likely 3.11.10), for me the workaround to have only one wireless controller enabled resolved the reboot loop.
Can be done by:

  1. Turn off wifi on the connecting devices,
  2. Wait to boot,
  3. Disable other wireless controller (e.g. “wi-fi 2”)

Just for the record, after the update to 3.11.10 I have not experienced any issue anymore. I have not done exhaustive testing, but I’m able to connect to my Omnia via WiFi again :slight_smile:
Thanks all.

Same for me. Thank you!