Firmware Crash ATH10

I have the “Candela Technologies Wi-Fi drivers for Qualcomm Atheros QCA988x with improved stability in busy networks” installed on an turris omnia and mox. On both systems I occasionally get wlan disconnects especially after/while loading many video data. At the same time the kernel log states that the wifi firmware crashed. The more traffic is transmitted over the wifi the more frequent the firmware crash seems to occure.

Error on omnia
[554721.610920] ath10k_pci 0000:02:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[563654.236743] ath10k_pci 0000:02:00.0: firmware crashed! (guid 974409e8-ade9-4461-8ce6-0660421efebd)
[563654.245874] ath10k_pci 0000:02:00.0: qca988x hw2.0 target 0x4100016c chip_id 0x043202ff sub 0000:0000
[563654.245882] ath10k_pci 0000:02:00.0: kconfig debug 0 debugfs 1 tracing 0 dfs 1 testmode 0
[563654.247060] ath10k_pci 0000:02:00.0: firmware ver 10.1-ct-8x-__fH-022-ecad3248 api 2 features wmi-10.x,mfp,txstatus-noack,wmi-10.x-CT,ratemask-CT,regdump-CT,txrate-CT,flush-all-CT,pingpong-CT,ch-regs-CT,nop-CT,set-special-CT,get-temp crc32 1b2a161c
[563654.247080] ath10k_pci 0000:02:00.0: board_file api 1 bmi_id N/A crc32 bebc7c08
[563654.247086] ath10k_pci 0000:02:00.0: htt-ver 2.2 wmi-op 2 htt-op 2 cal otp max-sta 128 raw 0 hwcrypto 1
[563654.247213] ath10k_pci 0000:02:00.0: firmware register dump:
[563654.252989] ath10k_pci 0000:02:00.0: [00]: 0x4100016C 0x00000000 0x0099483D 0x0001001A
[563654.261041] ath10k_pci 0000:02:00.0: [04]: 0x0099483D 0x00060130 0x00000000 0x00000000
[563654.269099] ath10k_pci 0000:02:00.0: [08]: 0x00000000 0x009BC2B4 0x00425DFC 0x00428EF4
[563654.277176] ath10k_pci 0000:02:00.0: [12]: 0x00000009 0x00000000 0x0095808C 0x009580A2
[563654.285246] ath10k_pci 0000:02:00.0: [16]: 0x00958080 0x0094085D 0x00000000 0x00000000
[563654.293278] ath10k_pci 0000:02:00.0: [20]: 0x4099483D 0x0040AC34 0x00000000 0x0047A8F7
[563654.301324] ath10k_pci 0000:02:00.0: [24]: 0x809950AF 0x0040AC94 0x00000000 0xC099483D
[563654.309371] ath10k_pci 0000:02:00.0: [28]: 0x809960A0 0x0040AD14 0x0041E524 0x00425DFC
[563654.317402] ath10k_pci 0000:02:00.0: [32]: 0x80997EC9 0x0040ADB4 0x0041E524 0x00425DFC
[563654.325449] ath10k_pci 0000:02:00.0: [36]: 0x809AF249 0x0040AEE4 0x00425918 0x00000002
[563654.333493] ath10k_pci 0000:02:00.0: [40]: 0x80940F18 0x0040AF14 0x00000004 0x004039D0
[563654.341517] ath10k_pci 0000:02:00.0: [44]: 0x80940EEA 0x0040AF44 0x00400000 0x00000000
[563654.349597] ath10k_pci 0000:02:00.0: [48]: 0x80940F31 0x0040AF64 0x00401C10 0x00400600
[563654.357655] ath10k_pci 0000:02:00.0: [52]: 0x40940024 0x0040AF84 0x004068E8 0x004068E8
[563654.365693] ath10k_pci 0000:02:00.0: [56]: 0x00000000 0x0040AFA4 0x009BB001 0x00040020
[563654.373739] ath10k_pci 0000:02:00.0: Copy Engine register dump:
[563654.379766] ath10k_pci 0000:02:00.0: [00]: 0x00057400   7   7   3   3
[563654.386330] ath10k_pci 0000:02:00.0: [01]: 0x00057800  20  20 343 344
[563654.392888] ath10k_pci 0000:02:00.0: [02]: 0x00057c00   6   6  69  70
[563654.399458] ath10k_pci 0000:02:00.0: [03]: 0x00058000   8   8  12   8
[563654.406030] ath10k_pci 0000:02:00.0: [04]: 0x00058400 4147 4147  67  27
[563654.412777] ath10k_pci 0000:02:00.0: [05]: 0x00058800  22  22 245 246
[563654.419329] ath10k_pci 0000:02:00.0: [06]: 0x00058c00   6   6   6   6
[563654.425901] ath10k_pci 0000:02:00.0: [07]: 0x00059000   0   0   0   0
[563654.432598] ath10k_pci 0000:02:00.0: debug log header, dbuf: 0x411a98  dropped: 0
[563654.432663] ath10k_pci 0000:02:00.0: [0] next: 0x411ab0 buf: 0x40f8fc sz: 1500 len: 204 count: 12 free: 0
[563654.432728] ath10k_pci 0000:02:00.0: ath10k_pci ATH10K_DBG_BUFFER:
[563654.439030] ath10k: [0000]: 0267AB3B 08004FE8 00000300 00000000 0267AB3B 08004FE8 01000100 00000011
[563654.448231] ath10k: [0008]: 0267AB3B 08004FE8 00000300 00000011 0267AB3B 08004FE8 01000100 00000010
[563654.457395] ath10k: [0016]: 0267AB3B 08004FE8 00000300 00000010 0267AC18 08004FE8 01030200 00000010
[563654.466587] ath10k: [0024]: 0267AC18 08004FE8 00030000 00000010 0267AC18 08004FE8 01030200 00000000
[563654.475772] ath10k: [0032]: 0267AC18 08004FE8 00030000 00000000 0267AC18 08004FE8 01030200 00000011
[563654.484934] ath10k: [0040]: 0267AC18 08004FE8 00030000 00000011 0267AC19 17FC0001 00000000 00001001
[563654.494117] ath10k: [0048]: 0040AB24 4100016C 000000CB
[563654.499372] ath10k_pci 0000:02:00.0: ATH10K_END
[563654.504066] ath10k_pci 0000:02:00.0: [1] next: 0x411a98 buf: 0x40feec sz: 1500 len: 0 count: 0 free: 0
[563654.542204] ath10k_pci 0000:02:00.0: removing peer, cleanup-all, deleting: peer 7a1daed3 vdev: 0 addr: 28:c2:1f:00:7c:89
[563654.542218] ath10k_pci 0000:02:00.0: removing peer, cleanup-all, deleting: peer 7060a18b vdev: 0 addr: 04:f0:21:23:fe:05
[563654.654282] ieee80211 phy0: Hardware restart was requested
[563655.648188] ath10k_pci 0000:02:00.0: 10.1 wmi init: vdevs: 16  peers: 127  tid: 256
[563655.657495] ath10k_pci 0000:02:00.0: wmi print 'P 128 V 8 T 410'
[563655.657526] ath10k_pci 0000:02:00.0: wmi print 'msdu-desc: 1424  sw-crypt: 0 ct-sta: 0'
[563655.658108] ath10k_pci 0000:02:00.0: wmi print 'alloc rem: 25000 iram: 38944'
[563656.706580] ath10k_pci 0000:02:00.0: pdev param 0 not supported by firmware
[563656.713962] ath10k_pci 0000:02:00.0: rts threshold -1
[563657.716129] ath10k_pci 0000:02:00.0: device successfully recovered
Error on mox 1
[600661.051411] mv88e6085 d0032004.mdio-mii:10 lan2: Link is Down
[600975.017406] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[630113.954070] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[630149.610640] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[630219.183941] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[630350.641292] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[632022.180628] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[632061.516688] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[632263.927201] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[632329.980838] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[640479.165868] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[640514.042489] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[640600.804219] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[640728.491826] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[641347.411872] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[643163.216164] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[644991.039968] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[646800.145610] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[648626.179931] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[650435.026760] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[652241.883396] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[654069.306988] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[656152.673260] mv88e6085 d0032004.mdio-mii:10 lan2: Link is Up - 1Gbps/Full - flow control rx/tx
[656152.682229] lanbr: port 3(lan2) entered blocking state
[656152.687649] lanbr: port 3(lan2) entered forwarding state
[656170.608328] lanbr: port 3(lan2) entered disabled state
[656170.615423] mv88e6085 d0032004.mdio-mii:10 lan2: Link is Down
[656174.006360] mv88e6085 d0032004.mdio-mii:10 lan2: Link is Up - 1Gbps/Full - flow control rx/tx
[656174.015319] lanbr: port 3(lan2) entered blocking state
[656174.020719] lanbr: port 3(lan2) entered forwarding state
[656180.843639] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[657297.276339] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[682335.749061] lanbr: port 3(lan2) entered disabled state
[682335.756365] mv88e6085 d0032004.mdio-mii:10 lan2: Link is Down
[682348.284334] ath10k_pci 0000:01:00.0: firmware crashed! (guid 95f0cae5-2751-431d-ad54-848a0e4d4a4f)
[682348.293709] ath10k_pci 0000:01:00.0: qca988x hw2.0 target 0x4100016c chip_id 0x043202ff sub 0000:0000
[682348.303339] ath10k_pci 0000:01:00.0: kconfig debug 0 debugfs 1 tracing 0 dfs 1 testmode 0
[682348.312065] ath10k_pci 0000:01:00.0: firmware ver 10.1-ct-8x-__fH-022-ecad3248 api 2 features wmi-10.x,mfp,txstatus-noack,wmi-10.x-CT,ratemask-CT,regdump-CT,txrate-CT,flush-all-CT,pingpong-CT,ch-regs-CT,nop-CT,set-special-CT,get-temp crc32 1b2a161c
[682348.342064] ath10k_pci 0000:01:00.0: board_file api 1 bmi_id N/A crc32 bebc7c08
[682348.349735] ath10k_pci 0000:01:00.0: htt-ver 2.2 wmi-op 2 htt-op 2 cal otp max-sta 128 raw 0 hwcrypto 1
[682348.359700] ath10k_pci 0000:01:00.0: firmware register dump:
[682348.365676] ath10k_pci 0000:01:00.0: [00]: 0x4100016C 0x00000000 0x00994902 0x09A683B1
[682348.373948] ath10k_pci 0000:01:00.0: [04]: 0x00994902 0x00060130 0x00000000 0x00000000
[682348.382227] ath10k_pci 0000:01:00.0: [08]: 0x00000000 0x009BBB1C 0x00426474 0x09A683A9
[682348.390515] ath10k_pci 0000:01:00.0: [12]: 0x00000009 0x00000000 0x0095808C 0x009580A2
[682348.398795] ath10k_pci 0000:01:00.0: [16]: 0x00958080 0x0094085D 0x00000000 0x00000000
[682348.407078] ath10k_pci 0000:01:00.0: [20]: 0x40994902 0x0040AC34 0x00000000 0x004FE01F
[682348.415362] ath10k_pci 0000:01:00.0: [24]: 0x809950AF 0x0040AC94 0x00000000 0xC0994902
[682348.423627] ath10k_pci 0000:01:00.0: [28]: 0x809960A0 0x0040AD14 0x0041E524 0x00426474
[682348.431911] ath10k_pci 0000:01:00.0: [32]: 0x80997EC9 0x0040ADB4 0x0041E524 0x00426474
[682348.440208] ath10k_pci 0000:01:00.0: [36]: 0x809AF249 0x0040AEE4 0x00425918 0x00000002
[682348.448498] ath10k_pci 0000:01:00.0: [40]: 0x80940F18 0x0040AF14 0x00000004 0x004039D0
[682348.456788] ath10k_pci 0000:01:00.0: [44]: 0x80940EEA 0x0040AF44 0x00400000 0x00000000
[682348.465077] ath10k_pci 0000:01:00.0: [48]: 0x80940F31 0x0040AF64 0x00401C10 0x00400600
[682348.473342] ath10k_pci 0000:01:00.0: [52]: 0x40940024 0x0040AF84 0x004068E8 0x004068E8
[682348.481625] ath10k_pci 0000:01:00.0: [56]: 0x00000000 0x0040AFA4 0x009BB001 0x00040020
[682348.489917] ath10k_pci 0000:01:00.0: Copy Engine register dump:
[682348.496143] ath10k_pci 0000:01:00.0: [00]: 0x00057400   7   7   3   3
[682348.502892] ath10k_pci 0000:01:00.0: [01]: 0x00057800   7   7 106 107
[682348.509667] ath10k_pci 0000:01:00.0: [02]: 0x00057c00  16  16  15  16
[682348.516443] ath10k_pci 0000:01:00.0: [03]: 0x00058000  21  21  24  21
[682348.523197] ath10k_pci 0000:01:00.0: [04]: 0x00058400 4735 4735 104  65
[682348.530134] ath10k_pci 0000:01:00.0: [05]: 0x00058800   5   5 452 453
[682348.536903] ath10k_pci 0000:01:00.0: [06]: 0x00058c00  21  21  21  21
[682348.543657] ath10k_pci 0000:01:00.0: [07]: 0x00059000   0   0   0   0
[682348.550499] ath10k_pci 0000:01:00.0: debug log header, dbuf: 0x411a98  dropped: 0
[682348.558411] ath10k_pci 0000:01:00.0: [0] next: 0x411ab0 buf: 0x40f8fc sz: 1500 len: 28 count: 1 free: 0
[682348.568290] ath10k_pci 0000:01:00.0: ath10k_pci ATH10K_DBG_BUFFER:
[682348.574777] ath10k: [0000]: 01A683A9 17FC0001 00000000 0000083B 0040AB24 4100016C 000000CB
[682348.583413] ath10k_pci 0000:01:00.0: ATH10K_END
[682348.588279] ath10k_pci 0000:01:00.0: [1] next: 0x411a98 buf: 0x40feec sz: 1500 len: 0 count: 0 free: 0
[682348.654268] ath10k_pci 0000:01:00.0: removing peer, cleanup-all, deleting: peer 000000007d488a24 vdev: 0 addr: 28:c2:1f:00:7c:89
[682348.666439] ath10k_pci 0000:01:00.0: removing peer, cleanup-all, deleting: peer 000000005fe6f1db vdev: 0 addr: 04:f0:21:45:df:64
[682348.790008] ieee80211 phy0: Hardware restart was requested
[682349.777131] ath10k_pci 0000:01:00.0: 10.1 wmi init: vdevs: 16  peers: 127  tid: 256
[682349.794972] ath10k_pci 0000:01:00.0: wmi print 'P 128 V 8 T 410'
[682349.801296] ath10k_pci 0000:01:00.0: wmi print 'msdu-desc: 1424  sw-crypt: 0 ct-sta: 0'
[682349.810004] ath10k_pci 0000:01:00.0: wmi print 'alloc rem: 25000 iram: 38944'
[682349.880417] ath10k_pci 0000:01:00.0: pdev param 0 not supported by firmware
[682349.898520] ath10k_pci 0000:01:00.0: rts threshold -1
[682349.913129] ath10k_pci 0000:01:00.0: failed to transmit packet, dropping: -19
[682349.920631] ath10k_pci 0000:01:00.0: failed to submit frame: -19
[682349.926934] ath10k_pci 0000:01:00.0: failed to transmit frame: -19
[682349.933440] ath10k_pci 0000:01:00.0: failed to transmit packet, dropping: -19
[682349.940941] ath10k_pci 0000:01:00.0: failed to submit frame: -19
[682349.947260] ath10k_pci 0000:01:00.0: failed to push frame: -19
[682349.953394] ath10k_pci 0000:01:00.0: device successfully recovered
[682414.537880] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
Error on mox 2
[768823.146382] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[769352.124315] lanbr: port 3(lan2) entered disabled state
[769352.131122] mv88e6085 d0032004.mdio-mii:10 lan2: Link is Down
[770196.674003] ath10k_pci 0000:01:00.0: firmware crashed! (guid f8bea874-fc24-40d3-8e42-540633bee217)
[770196.683376] ath10k_pci 0000:01:00.0: qca988x hw2.0 target 0x4100016c chip_id 0x043202ff sub 0000:0000
[770196.693001] ath10k_pci 0000:01:00.0: kconfig debug 0 debugfs 1 tracing 0 dfs 1 testmode 0
[770196.701691] ath10k_pci 0000:01:00.0: firmware ver 10.1-ct-8x-__fH-022-ecad3248 api 2 features wmi-10.x,mfp,txstatus-noack,wmi-10.x-CT,ratemask-CT,regdump-CT,txrate-CT,flush-all-CT,pingpong-CT,ch-regs-CT,nop-CT,set-special-CT,get-temp crc32 1b2a161c
[770196.731667] ath10k_pci 0000:01:00.0: board_file api 1 bmi_id N/A crc32 bebc7c08
[770196.739329] ath10k_pci 0000:01:00.0: htt-ver 2.2 wmi-op 2 htt-op 2 cal otp max-sta 128 raw 0 hwcrypto 1
[770196.749237] ath10k_pci 0000:01:00.0: firmware register dump:
[770196.755185] ath10k_pci 0000:01:00.0: [00]: 0x4100016C 0x00000000 0x0099483D 0x0000F82F
[770196.763451] ath10k_pci 0000:01:00.0: [04]: 0x0099483D 0x00060130 0x00000000 0x00000000
[770196.771726] ath10k_pci 0000:01:00.0: [08]: 0x00000000 0x009BAF4C 0x00426474 0x0042FC5C
[770196.780007] ath10k_pci 0000:01:00.0: [12]: 0x00000009 0x00000000 0x0095808C 0x009580A2
[770196.788286] ath10k_pci 0000:01:00.0: [16]: 0x00958080 0x0094085D 0x00000000 0x00000000
[770196.796577] ath10k_pci 0000:01:00.0: [20]: 0x4099483D 0x0040AC34 0x00000000 0x0042000A
[770196.804861] ath10k_pci 0000:01:00.0: [24]: 0x809950AF 0x0040AC94 0x00000000 0xC099483D
[770196.813128] ath10k_pci 0000:01:00.0: [28]: 0x809960A0 0x0040AD14 0x0041E524 0x00426474
[770196.821414] ath10k_pci 0000:01:00.0: [32]: 0x80997EC9 0x0040ADB4 0x0041E524 0x00426474
[770196.829699] ath10k_pci 0000:01:00.0: [36]: 0x809AF249 0x0040AEE4 0x00425918 0x00000002
[770196.837977] ath10k_pci 0000:01:00.0: [40]: 0x80940F18 0x0040AF14 0x00000004 0x004039D0
[770196.846257] ath10k_pci 0000:01:00.0: [44]: 0x80940EEA 0x0040AF44 0x00400000 0x00000000
[770196.854541] ath10k_pci 0000:01:00.0: [48]: 0x80940F31 0x0040AF64 0x00401C10 0x00400600
[770196.862811] ath10k_pci 0000:01:00.0: [52]: 0x40940024 0x0040AF84 0x004068E8 0x004068E8
[770196.871089] ath10k_pci 0000:01:00.0: [56]: 0x00000000 0x0040AFA4 0x009BB001 0x00040020
[770196.879372] ath10k_pci 0000:01:00.0: Copy Engine register dump:
[770196.885596] ath10k_pci 0000:01:00.0: [00]: 0x00057400   7   7   3   3
[770196.892346] ath10k_pci 0000:01:00.0: [01]: 0x00057800   8   8 395 396
[770196.899108] ath10k_pci 0000:01:00.0: [02]: 0x00057c00  53  53  52  53
[770196.905876] ath10k_pci 0000:01:00.0: [03]: 0x00058000   0   0   2   0
[770196.912630] ath10k_pci 0000:01:00.0: [04]: 0x00058400 2737 2737 130  90
[770196.919562] ath10k_pci 0000:01:00.0: [05]: 0x00058800  13  13 268 269
[770196.926327] ath10k_pci 0000:01:00.0: [06]: 0x00058c00   2   2   2   2
[770196.933084] ath10k_pci 0000:01:00.0: [07]: 0x00059000   0   0   0   0
[770196.939926] ath10k_pci 0000:01:00.0: debug log header, dbuf: 0x411a98  dropped: 0
[770196.947836] ath10k_pci 0000:01:00.0: [0] next: 0x411ab0 buf: 0x40f8fc sz: 1500 len: 28 count: 1 free: 0
[770196.957709] ath10k_pci 0000:01:00.0: ath10k_pci ATH10K_DBG_BUFFER:
[770196.964192] ath10k: [0000]: 07034079 17FC0001 00000000 00000F82 0040AB24 4100016C 000000CB
[770196.972824] ath10k_pci 0000:01:00.0: ATH10K_END
[770196.977672] ath10k_pci 0000:01:00.0: [1] next: 0x411a98 buf: 0x40feec sz: 1500 len: 0 count: 0 free: 0
[770197.033911] ath10k_pci 0000:01:00.0: removing peer, cleanup-all, deleting: peer 000000007d488a24 vdev: 0 addr: 28:c2:1f:00:7c:89
[770197.046064] ath10k_pci 0000:01:00.0: removing peer, cleanup-all, deleting: peer 000000005fe6f1db vdev: 0 addr: 04:f0:21:45:df:64
[770197.188836] ieee80211 phy0: Hardware restart was requested
[770198.205800] ath10k_pci 0000:01:00.0: 10.1 wmi init: vdevs: 16  peers: 127  tid: 256
[770198.223650] ath10k_pci 0000:01:00.0: wmi print 'P 128 V 8 T 410'
[770198.230021] ath10k_pci 0000:01:00.0: wmi print 'msdu-desc: 1424  sw-crypt: 0 ct-sta: 0'
[770198.238949] ath10k_pci 0000:01:00.0: wmi print 'alloc rem: 25000 iram: 38944'
[770198.309093] ath10k_pci 0000:01:00.0: pdev param 0 not supported by firmware
[770198.325073] ath10k_pci 0000:01:00.0: rts threshold -1
[770198.338744] ath10k_pci 0000:01:00.0: device successfully recovered
Error on mox 3
[830884.022545] ath10k_pci 0000:01:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
[839117.793551] ath10k_pci 0000:01:00.0: firmware crashed! (guid 5e012740-f77e-4ec7-a87f-b4b3508a78b4)
[839117.802955] ath10k_pci 0000:01:00.0: qca988x hw2.0 target 0x4100016c chip_id 0x043202ff sub 0000:0000
[839117.812588] ath10k_pci 0000:01:00.0: kconfig debug 0 debugfs 1 tracing 0 dfs 1 testmode 0
[839117.821284] ath10k_pci 0000:01:00.0: firmware ver 10.1-ct-8x-__fH-022-ecad3248 api 2 features wmi-10.x,mfp,txstatus-noack,wmi-10.x-CT,ratemask-CT,regdump-CT,txrate-CT,flush-all-CT,pingpong-CT,ch-regs-CT,nop-CT,set-special-CT,get-temp crc32 1b2a161c
[839117.851298] ath10k_pci 0000:01:00.0: board_file api 1 bmi_id N/A crc32 bebc7c08
[839117.858972] ath10k_pci 0000:01:00.0: htt-ver 2.2 wmi-op 2 htt-op 2 cal otp max-sta 128 raw 0 hwcrypto 1
[839117.868883] ath10k_pci 0000:01:00.0: firmware register dump:
[839117.874821] ath10k_pci 0000:01:00.0: [00]: 0x4100016C 0x00000000 0x0099483F 0x00000000
[839117.883096] ath10k_pci 0000:01:00.0: [04]: 0x00000000 0x00060324 0x00000000 0x00000000
[839117.891382] ath10k_pci 0000:01:00.0: [08]: 0x00000000 0x00000000 0x00000000 0x00000000
[839117.899662] ath10k_pci 0000:01:00.0: [12]: 0x00000005 0x00000000 0x00000000 0x00000000
[839117.907951] ath10k_pci 0000:01:00.0: [16]: 0x009B0BD3 0x0094085D 0x00000000 0x0099483F
[839117.916223] ath10k_pci 0000:01:00.0: [20]: 0x809430B8 0x00401A40 0x00000001 0x00000002
[839117.924499] ath10k_pci 0000:01:00.0: [24]: 0x80940975 0x00401A60 0x0000001F 0x00403BEC
[839117.932785] ath10k_pci 0000:01:00.0: [28]: 0x409406B9 0x00401A80 0x0000001F 0x00400000
[839117.941065] ath10k_pci 0000:01:00.0: [32]: 0x00000000 0x00401AA0 0x00050024 0x0040011D
[839117.949408] ath10k_pci 0000:01:00.0: [36]: 0x00000000 0x00000000 0x00000000 0x00000000
[839117.957695] ath10k_pci 0000:01:00.0: [40]: 0x00000000 0x00000000 0x00000000 0x00000000
[839117.965958] ath10k_pci 0000:01:00.0: [44]: 0x00000000 0x00000000 0x00000000 0x00000000
[839117.974244] ath10k_pci 0000:01:00.0: [48]: 0x00000000 0x00000000 0x00000000 0x00000000
[839117.982535] ath10k_pci 0000:01:00.0: [52]: 0x00000000 0x00000000 0x00000000 0x00000000
[839117.990818] ath10k_pci 0000:01:00.0: [56]: 0x00000000 0x00000000 0x00000000 0x00000000
[839117.999107] ath10k_pci 0000:01:00.0: Copy Engine register dump:
[839118.005322] ath10k_pci 0000:01:00.0: [00]: 0x00057400   7   7   3   3
[839118.012079] ath10k_pci 0000:01:00.0: [01]: 0x00057800  21  21 216 217
[839118.018858] ath10k_pci 0000:01:00.0: [02]: 0x00057c00  45  45  44  45
[839118.025613] ath10k_pci 0000:01:00.0: [03]: 0x00058000  27  27  30  27
[839118.032369] ath10k_pci 0000:01:00.0: [04]: 0x00058400 2375 2375 205 165
[839118.039319] ath10k_pci 0000:01:00.0: [05]: 0x00058800  18  18  81  82
[839118.046075] ath10k_pci 0000:01:00.0: [06]: 0x00058c00   3   3   3   3
[839118.052829] ath10k_pci 0000:01:00.0: [07]: 0x00059000   0   0   0   0
[839118.059684] ath10k_pci 0000:01:00.0: debug log header, dbuf: 0x411a98  dropped: 0
[839118.067591] ath10k_pci 0000:01:00.0: [0] next: 0x411ab0 buf: 0x40f8fc sz: 1500 len: 52 count: 2 free: 0
[839118.077507] ath10k_pci 0000:01:00.0: ath10k_pci ATH10K_DBG_BUFFER:
[839118.083989] ath10k: [0000]: 03383ABE 13FC0006 91100000 00000000 00000000 00000010 03383ABE 17FC0001
[839118.093454] ath10k: [0008]: 00000000 00000000 00401930 4100016C 00000000
[839118.100502] ath10k_pci 0000:01:00.0: ATH10K_END
[839118.105351] ath10k_pci 0000:01:00.0: [1] next: 0x411a98 buf: 0x40feec sz: 1500 len: 0 count: 0 free: 0
[839118.147941] ath10k_pci 0000:01:00.0: failed to recalculate rts/cts prot for vdev 0: -108
[839118.156408] ath10k_pci 0000:01:00.0: failed to set preamble for vdev 0: -108
[839118.163819] ath10k_pci 0000:01:00.0: failed to set mgmt tx rate -108
[839118.170595] ath10k_pci 0000:01:00.0: removing peer, cleanup-all, deleting: peer 0000000021ef5a36 vdev: 0 addr: 28:c2:1f:00:7c:89
[839118.182758] ath10k_pci 0000:01:00.0: removing peer, cleanup-all, deleting: peer 00000000d47544a0 vdev: 0 addr: 04:f0:21:45:df:64
[839118.303039] ieee80211 phy0: Hardware restart was requested
[839119.290028] ath10k_pci 0000:01:00.0: 10.1 wmi init: vdevs: 16  peers: 127  tid: 256
[839119.307830] ath10k_pci 0000:01:00.0: wmi print 'P 128 V 8 T 410'
[839119.314742] ath10k_pci 0000:01:00.0: wmi print 'msdu-desc: 1424  sw-crypt: 0 ct-sta: 0'
[839119.323155] ath10k_pci 0000:01:00.0: wmi print 'alloc rem: 25000 iram: 38944'
[839119.393461] ath10k_pci 0000:01:00.0: pdev param 0 not supported by firmware
[839119.408896] ath10k_pci 0000:01:00.0: rts threshold -1
[839119.423437] ath10k_pci 0000:01:00.0: failed to transmit packet, dropping: -19
[839119.430942] ath10k_pci 0000:01:00.0: failed to submit frame: -19
[839119.437229] ath10k_pci 0000:01:00.0: failed to push frame: -19
[839119.443388] ath10k_pci 0000:01:00.0: device successfully recovered