Turris OS 3.11.10 is released into RC!

Omnia 2GB (eMMC boot, OpenVPN server, 3x LXC, SATA card, SSD + HW raid BOX)
Reboot loop even after restart (± 3 min). Solution - back to 3.11.9

Turris 1.0 Ok - stable (OpenVPN client)

I also see the spontaneous reboots. Although only after several hours of running.

No unwanted reboots on my Omnia.

27.11 new update to 3.11.10 - now stable.

EDIT: It turns out this has been an issue even with the previous version, probably related to this topic.
Since this upgrade, my old Turris 1.0 (with BTRFS) reboots every few minutes. I’ve connected a serial line to see what’s going on. It turns out the kernel panics whenever a device connects to the Wi-Fi. This is the end of the log just before the reboot:

[  377.326278] Unable to handle kernel paging request for data at address 0x27e86e32
[  377.333787] Faulting instruction address: 0xc04e43c8
[  377.338772] Oops: Kernel access of bad area, sig: 11 [#1]
[  377.344170] SMP NR_CPUS=2 P2020 RDB
[  377.347656] Modules linked in: option iptable_nat ip6table_nat ath9k usb_wwan rndis_host qmi_wwan pppoe nf_nat_pptp nf_nat_ipv6 nf
_nat_ipv4 nf_nat_amanda nf_conntrack_pptp nf_conntrack_ipv6 nf_conntrack_ipv4 nf_conntrack_amanda ipt_REJECT ipt_MASQUERADE ebtable_n
at ebtable_filter ebtable_broute cdc_ether ath9k_common xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_socket xt_recent xt_nfac
ct xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_id xt_hl xt_helper xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit x
t_connbytes xt_comment xt_TPROXY xt_TCPMSS xt_REDIRECT xt_LOG xt_HL xt_DSCP xt_CT xt_CLASSIFY wireguard usbserial usbnet ts_kmp ts_fs
m ts_bm pppox ppp_mppe ppp_async nfnetlink_acct nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_redirect nf_nat_proto_
gre nf_nat_masquerade_ipv4 nf_nat_irc nf_nat_h323 nf_nat_ftp nf_log_ipv4 nf_defrag_ipv6 nf_defrag_ipv4 nf_conntrack_tftp nf_conntrack
_snmp nf_conntrack_sip nf_conntrack_rtcache nf_conntrack_proto_gre nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntra
ck_ftp nf_conntrack_broadcast lm90 iptable_raw iptable_mangle iptable_filter ipt_ECN ip_tables hwmon gpio_keys ebtables ebt_vlan ebt_
stp ebt_redirect ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt cdc_wdm ath9k_hw sch_teql sch_tbf sch_sfq sc
h_red sch_prio sch_pie sch_netem sch_htb sch_gred sch_fq sch_dsmark sch_codel em_text em_nbyte em_meta em_cmp cls_basic act_vlan act_
police act_pedit act_nat act_ipt act_gact act_csum act_bpf act_skbedit act_mirred em_u32 cls_u32 cls_tcindex cls_flow cls_route cls_f
w sch_hfsc sch_ingress ath10k_pci ath10k_core ath mac80211 cfg80211 compat xt_set ip_set_list_set ip_set_hash_netiface ip_set_hash_ne
tport ip_set_hash_netnet ip_set_hash_net ip_set_hash_netportnet ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_has
h_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6t_NPT ip6t_MASQUERADE nf
_nat_masquerade_ipv6 nf_nat nf_conntrack ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 nf_log_common ip6table_raw ip6table_mangle ip6table_f
ilter ip6_tables pppoatm ppp_generic slhc ip_gre gre ifb ip6_udp_tunnel udp_tunnel sit ip6_tunnel tunnel6 tunnel4 ip_tunnel tun br268
4 atm xt_NFLOG x_tables nfnetlink_log nfnetlink sha1_generic ecb leds_gpio xhci_plat_hcd xhci_pci xhci_hcd uhci_hcd ehci_fsl ehci_pla
tform ehci_hcd fsl_mph_dr_of button_hotplug input_core usbcore usb_common mii aead crypto_null
[  377.564735] CPU: 1 PID: 16837 Comm: hostapd Not tainted 4.4.201-f90a52a6230ecb072f657fce5aebd444-0 #1
[  377.573959] task: daa35fa0 ti: dcf9e000 task.ti: dcf9e000
[  377.579354] NIP: c04e43c8 LR: c03dd53c CTR: 00000000
[  377.584317] REGS: dcf9f9e0 TRAP: 0300   Not tainted  (4.4.201-f90a52a6230ecb072f657fce5aebd444-0)
[  377.593189] MSR: 00029000 <CE,EE,ME>  CR: 28222024  XER: 20000000
[  377.599294] DEAR: 27e86e32 ESR: 00000000
GPR00: 00000000 dcf9fa90 daa35fa0 dcf9fb30 10000000 27e86e32 00000000 00000000
GPR08: dcf9fb30 00000000 00000022 d8038d0b dcf9fb30 1013f6f8 00000000 c065fa68
GPR16: c0660000 c05c7714 dcf9fd6c 00000000 c065fa70 00000000 00000000 c065f668
GPR24: dcf9e000 00000010 de0cf658 debb8cb0 de0cf6f0 dea47480 27e86e32 0000fffe
[  377.631563] NIP [c04e43c8] __siphash_aligned+0x20/0x710
[  377.636794] LR [c03dd53c] skb_get_hash_perturb+0x124/0x144
[  377.642276] Call Trace:
[  377.644717] [dcf9fa90] [00100021] 0x100021 (unreliable)
[  377.649945] [dcf9fb20] [c03dd468] skb_get_hash_perturb+0x50/0x144
[  377.656118] [dcf9fb70] [e288df44] ieee80211_unreserve_tid+0x70/0xd3c [mac80211]
[  377.663453] [dcf9fb80] [e288e814] ieee80211_unreserve_tid+0x940/0xd3c [mac80211]
[  377.670873] [dcf9fbb0] [e288fecc] ieee80211_tx_prepare_skb+0x1f8/0x244 [mac80211]
[  377.678382] [dcf9fc00] [e2891100] __ieee80211_subif_start_xmit+0x8a4/0x8f8 [mac80211]
[  377.686236] [dcf9fcb0] [e2891210] ieee80211_subif_start_xmit+0xbc/0x2a0 [mac80211]
[  377.693814] [dcf9fcf0] [c03e7770] dev_hard_start_xmit+0x290/0x328
[  377.699909] [dcf9fd50] [c03e7e2c] __dev_queue_xmit+0x530/0x638
[  377.705747] [dcf9fda0] [c04c6134] packet_sendmsg+0xc44/0xe68
[  377.711411] [dcf9fe50] [c03ca5c8] sock_sendmsg+0x20/0x40
[  377.716725] [dcf9fe60] [c03cc2b4] SyS_sendto+0xbc/0xec
[  377.721866] [dcf9ff40] [c000e18c] ret_from_syscall+0x0/0x3c
[  377.727439] --- interrupt: c01 at 0xb7940e88
[  377.727439]     LR = 0xb7962b44
[  377.734836] Instruction dump:
[  377.737799] 5529383e 7c633a78 7c634a78 4e800020 9421ff70 5489077e 38000000 7c6c1b78
[  377.745560] bdc10048 54990038 91210040 5484c00e <81050000> 81250004 81450008 8365000c
[  377.753498] ---[ end trace 6edd3c546b7c7279 ]---
[  377.758110]
2019-11-28 09:53:25 warning dnsmasq-dhcp[5312]: Last message 'DHCP packet received' repeated 1 times, suppressed by syslog-ng on blue
box.cesnet.cz
2019-11-28 09:53:25 info hostapd[]: wlan0: STA 58:cb:52:4c:ec:63 IEEE 802.11: authenticated
2019-11-28 09:53:25 info hostapd[]: wlan0: STA 58:cb:52:4c:ec:63 IEEE 802.11: associated (aid 1)
2019-11-28 09:53:25 alert kernel[]: [  377.326278] Unable to handle kernel paging request for data at address 0x27e86e32
2019-11-28 09:53:25 alert kernel[]: [  377.333787] Faulting instruction address: 0xc04e43c8
2019-11-28 09:53:25 warning kernel[]: [  377.338772] Oops: Kernel access of bad area, sig: 11 [#1]
2019-11-28 09:53:25 warning kernel[]: [  377.344170] SMP NR_CPUS=2 P2020 RDB
2019-11-28 09:53:25 warning kernel[]: [  377.347656] Modules linked in: option iptable_nat ip6table_nat ath9k usb_wwan rndis_host qmi
_wwan pppoe nf_nat_pptp nf_nat_ipv6 nf_nat_ipv4 nf_nat_amanda nf_conntrack_pptp nf_conntrack_ipv6 nf_conntrack_ipv4 nf_conntrack_aman
da ipt_REJECT ipt_MASQUERADE ebtable_nat ebtable_filter ebtable_broute cdc_ether ath9k_common xt_time xt_tcpudp xt_tcpmss xt_statisti
c xt_state xt_socket xt_recent xt_nfacct xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_id xt_hl xt_helper xt_ecn xt_dscp x
t_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_TPROXY xt_TCPMSS xt_REDIRECT xt_LOG xt_HL xt_DSCP xt_CT xt_CLASSIFY w
ireguard usbserial usbnet ts_kmp ts_fsm ts_bm pppox ppp_mppe ppp_async nfnetlink_acct nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf
_nat_sip nf_nat_redirect nf_nat_proto_gre nf_nat_masquerade_ipv4 nf_nat_irc nf_nat_h323 nf_nat_ftp nf_log_ipv4 nf_defrag_ipv6 nf_defr
ag_ipv4 nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_rtcache nf_conntrack_proto_gre nf_conntrack_netlink nf
2019-11-28 09:53:25 notice kernel[]: nf_conntrack_h323 nf_conntrack_ftp nf_conntrack_broadcast lm90 iptable_raw iptable_mangle iptabl
e_filter ipt_ECN ip_tables hwmon gpio_keys ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among
ebt_802_3 crc_ccitt cdc_wdm ath9k_hw sch_teql sch_tbf sch_sfq sch_red sch_prio sch_pie sch_netem sch_htb sch_gred sch_fq sch_dsmark
sch_codel em_text em_nbyte em_meta em_cmp cls_basic act_vlan act_police act_pedit act_nat act_ipt act_gact act_csum act_bpf act_skbed
it act_mirred em_u32 cls_u32 cls_tcindex cls_flow cls_route cls_fw sch_hfsc sch_ingress ath10k_pci ath10k_core ath mac80211 cfg80211
compat xt_set ip_set_list_set ip_set_hash_netiface ip_set_hash_netport ip_set_hash_netnet ip_set_hash_net ip_set_hash_netportnet ip_s
et_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set
_bitmap_ipmac ip_set_bitmap_ip ip_set ip6t_NPT ip6t_MASQUERADE nf_nat_masquerade_ipv6 nf_nat nf_conntrack ip6t_REJE
2019-11-28 09:53:25 notice kernel[]: nf_reject_ipv6 nf_log_ipv6 nf_log_common ip6table_raw ip6table_mangle ip6table_filter ip6_tables
pppoatm ppp_generic slhc ip_gre gre ifb ip6_udp_tunnel udp_tunnel sit ip6_tunnel tunnel6 tunnel4 ip_tunnel tun br2684 atm xt_NFLOG x
_tables nfnetlink_log nfnetlink sha1_generic ecb leds_gpio xhci_plat_hcd xhci_pci xhci_hcd uhci_hcd ehci_fsl ehci_platform ehci_hcd f
sl_mph_dr_of button_hotplug input_core usbcore usb_common mii aead crypto_null
2019-11-28 09:53:25 warning kernel[]: [  377.564735] CPU: 1 PID: 16837 Comm: hostapd Not tainted 4.4.201-f90a52a6230ecb072f657fce5aeb
d444-0 #1
2019-11-28 09:53:25 warning kernel[]: [  377.573959] task: daa35fa0 ti: dcf9e000 task.ti: dcf9e000
2019-11-28 09:53:25 warning kernel[]: [  377.579354] NIP: c04e43c8 LR: c03dd53c CTR: 00000000
2019-11-28 09:53:25 warning kernel[]: [  377.584317] REGS: dcf9f9e0 TRAP: 0300   Not tainted  (4.4.201-f90a52a6230ecb072f657fce5aebd4
44-0)
2019-11-28 09:53:25 warning kernel[]: [  377.593189] MSR: 00029000 <CE,EE,ME>  CR: 28222024  XER: 20000000
2019-11-28 09:53:25 warning kernel[]: [  377.599294] DEAR: 27e86e32 ESR: 00000000
2019-11-28 09:53:25 warning kernel[]: [  377.599294] GPR00: 00000000 dcf9fa90 daa35fa0 dcf9fb30 10000000 27e86e32 00000000 00000000
2019-11-28 09:53:25 warning kernel[]: [  377.599294] GPR08: dcf9fb30 00000000 00000022 d8038d0b dcf9fb30 1013f6f8 00000000 c065fa68
2019-11-28 09:53:25 warning kernel[]: [  377.599294] GPR16: c0660000 c05c7714 dcf9fd6c 00000000 c065fa70 00000000 00000000 c065f668
2019-11-28 09:53:25 warning kernel[]: [  377.599294] GPR24: dcf9e000 00000010 de0cf658 debb8cb0 de0cf6f0 dea47480 27e86e32 0000fffe
2019-11-28 09:53:25 warning kernel[]: [  377.631563] NIP [c04e43c8] __siphash_aligned+0x20/0x710
2019-11-28 09:53:25 warning kernel[]: [  377.636794] LR [c03dd53c] skb_get_hash_perturb+0x124/0x144
2019-11-28 09:53:25 warning kernel[]: [  377.642276] Call Trace:
2019-11-28 09:53:25 warning kernel[]: [  377.644717] [dcf9fa90] [00100021] 0x100021 (unreliable)
2019-11-28 09:53:25 warning kernel[]: [  377.649945] [dcf9fb20] [c03dd468] skb_get_hash_perturb+0x50/0x144
2019-11-28 09:53:25 warning kernel[]: [  377.656118] [dcf9fb70] [e288df44] ieee80211_unreserve_tid+0x70/0xd3c [mac80211]
2019-11-28 09:53:25 warning kernel[]: [  377.663453] [dcf9fb80] [e288e814] ieee80211_unreserve_tid+0x940/0xd3c [mac80211]
2019-11-28 09:53:25 warning kernel[]: [  377.670873] [dcf9fbb0] [e288fecc] ieee80211_tx_prepare_skb+0x1f8/0x244 [mac80211]
2019-11-28 09:53:25 warning kernel[]: [  377.678382] [dcf9fc00] [e2891100] __ieee80211_subif_start_xmit+0x8a4/0x8f8 [mac80211]
2019-11-28 09:53:25 warning kernel[]: [  377.686236] [dcf9fcb0] [e2891210] ieee80211_subif_start_xmit+0xbc/0x2a0 [mac80211]
2019-11-28 09:53:25 warning kernel[]: [  377.693814] [dcf9fcf0] [c03e7770] dev_hard_start_xmit+0x290/0x328
2019-11-28 09:53:25 warning kernel[]: [  377.699909] [dcf9fd50] [c03e7e2c] __dev_queue_xmit+0x530/0x638
2019-11-28 09:53:25 warning kernel[]: [  377.705747] [dcf9fda0] [c04c6134] packet_sendmsg+0xc44/0xe68
2019-11-28 09:53:25 warning kernel[]: [  377.711411] [dcf9fe50] [c03ca5c8] sock_sendmsg+0x20/0x40
2019-11-28 09:53:25 warning kernel[]: [  377.716725] [dcf9fe60] [c03cc2b4] SyS_sendto+0xbc/0xec
2019-11-28 09:53:25 warning kernel[]: [  377.721866] [dcf9ff40] [c000e18c] ret_from_syscall+0x0/0x3c
2019-11-28 09:53:25 warning kernel[]: [  377.727439] --- interrupt: c01 at 0xb7940e88
2019-11-28 09:53:25 warning kernel[]: [  377.727439]     LR = 0xb7962b44
2019-11-28 09:53:25 warning kernel[]: [  377.734836] Instruction dump:
2019-11-28 09:53:25 warning kernel[]: [  377.737799] 5529383e 7c633a78 7c634a78 4e800020 9421ff70 5489077e 38000000 7c6c1b78
2019-11-28 09:53:25 warning kernel[]: [  377.745560] bdc10048 54990038 91210040 5484c00e <81050000> 81250004 81450008 8365000c
2019-11-28 09:53:25 warning kernel[]: [  377.753498] ---[ end trace 6edd3c546b7c7279 ]---
2019-11-28 09:53:25 warning kernel[]: [  377.758110]
[  378.759665] Kernel panic - not syncing: Fatal exception in interrupt
[  378.766026] Rebooting in 3 seconds..

This Turris has just one Wi-Fi card, the one it was shipped with. I use it in WPA2 enterprise mode.

My Omnia 1GB with WPA2 Personal has no problems.

@Pepe Stále na Turrisu 1.x probíhá restart. Po některém vše naběhne korektně a po dalším třeba zase ne. Každopádně reset začne po připojování wifi.

For me, the reboots are also mostly occurring when I try to connect to the Omnia’s wifi, like @Ondrej_Caletka is reporting.

We are releasing another RC2 of Turris OS 3.11.10. This time with the downgraded kernel to version 4.4.196 as in the newest version of the kernel, there are some issues with hostapd, which we are investigating, because it seems that it is included also in kernel 4.14, which is running on Turris OS 4.x.

We will appreciate any feedback for this release as we would like to release it to the final release soon.

2 Likes

TO 2GB, simple config, WiFi, OK.

2 Likes

RC2, Turris 1.0, downgrade kernel to .196 - all OK…

2 Likes

RC2, Turris Omnia NAS, now OK with downgraded kernel.

1 Like

RC2
Omnia 2GB OK - (eMMC boot, OpenVPN server, 3x LXC, SATA card, SSD + HW raid BOX)
Turris 1.0 OK - (OpenVPN client)

And did it helped with WiFi issues or were you fine before and you are still fine?

A post was split to a new topic: Odmítnutá aktualizace se nainstalovala

RC2 - Turris 1.0 OK. 2 Wifi cards were running fine with RC1 and they are still running fine.

I can confirm, that with kernel 4.4.196-f90a52a6230ecb072f657fce5aebd444-0, the crashes are gone.

BTW, it was crashing consistently on my both Turrises 1.x – all Omnias are already on TOS4. The only reason I noticed it only on one of them was that the other one has been upgraded with second Wi-Fi card and the original card is used only in 2.4 GHz band, which my devices generally don’t use. When I tried to connect to 2.4 GHz SSID, the router crashed in a very similar way.

Thanks a lot for provided feedback. This time, we are releasing another RC with a small change. The only change, there is an updated pyuci package.

1 Like