Bootloop after update to 5.3.6 (again)

Since my bad experience with autoupdate, i turned it off when i failed to update to 5.3.4, reinstalled 5.3.4 manually and let the Mox running.

I skipped 5.3.5 because i read about some issues. After 5.3.6 came out, i gave it a try again because some reported no issues after updating.

I used the Forris GUI to update the System. At first it looked fine until it stopped doing anything. I couldn’t access the device. After 30 minutes i decided to reboot. And, i got a boot loop again.

Here is the log:

CZ.NIC's Armada 3720 Secure Firmware v2021.09.07 (Sep  7 2021 18:16:52)
Running on Turris MOX
Initializing DDR... done
NOTICE:  Booting Trusted Firmware
NOTICE:  BL1: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL1: Built : 18:17:49, Sep  7 2021
NOTICE:  BL1: Booting BL2
NOTICE:  BL2: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL2: Built : 18:17:50, Sep  7 2021
NOTICE:  BL1: Booting BL31
NOTICE:  BL31: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL31: Built : 18:17:53, Sep  7 2021


U-Boot 2021.10-rc3-00050-g7d3fea2c7f (Sep 07 2021 - 18:16:56 +0200)

DRAM:  1 GiB
WDT:   Started with servicing (60s timeout)
Comphy chip #0:
Comphy-0: SGMII1        3.125 Gbps
Comphy-1: PEX0          5 Gbps    
Comphy-2: USB3_HOST0    5 Gbps    
PCIE-0: Link up
MMC:   sdhci@d8000: 0
Loading Environment from SPIFlash... SF: Detected w25q64dw with page size 256 Bytes, erase size 4 KiB, total 8 MiB
OK
Model: CZ.NIC Turris Mox Board
Net:   eth0: neta@30000
Turris Mox:
  Board version: 22
  RAM size: 1024 MiB
  Serial Number: [somenumber]
  ECDSA Public Key: [somekey]
  SD/eMMC version: SD
Module Topology:
   1: Mini-PCIe Module
   2: Peridot Switch Module (8-port)
   3: Topaz Switch Module (4-port)

Hit any key to stop autoboot:  0 
gpio: pin GPIO221 (gpio 57) value is 0
gpio: pin GPIO220 (gpio 56) value is 1
SF: Detected w25q64dw with page size 256 Bytes, erase size 4 KiB, total 8 MiB
device 0 offset 0x7f0000, size 0x10000
SF: 65536 bytes @ 0x7f0000 Read: OK
switch to partitions #0, OK
mmc0 is current device
Scanning mmc 0:1...
Found U-Boot script /boot.scr
2070 bytes read in 85 ms (23.4 KiB/s)
## Executing script at 04d00000
19554 bytes read in 97 ms (196.3 KiB/s)
10448904 bytes read in 564 ms (17.7 MiB/s)
Moving Image from 0x5000000 to 0x5080000, end=5acb000
## Flattened Device Tree blob at 04f00000
   Booting using the fdt blob at 0x4f00000
   Loading Device Tree to 000000003faf5000, end 000000003fafcc61 ... OK

Starting kernel ...



CZ.NIC's Armada 3720 Secure Firmware v2021.09.07 (Sep  7 2021 18:16:52)
Running on Turris MOX
Initializing DDR... done
NOTICE:  Booting Trusted Firmware
NOTICE:  BL1: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL1: Built : 18:17:49, Sep  7 2021
NOTICE:  BL1: Booting BL2
NOTICE:  BL2: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL2: Built : 18:17:50, Sep  7 2021
NOTICE:  BL1: Booting BL31
NOTICE:  BL31: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL31: Built : 18:17:53, Sep  7 2021


U-Boot 2021.10-rc3-00050-g7d3fea2c7f (Sep 07 2021 - 18:16:56 +0200)

DRAM:  1 GiB
WDT:   Started with servicing (60s timeout)
Comphy chip #0:
Comphy-0: SGMII1        3.125 Gbps
Comphy-1: PEX0          5 Gbps    
Comphy-2: USB3_HOST0    5 Gbps    
PCIE-0: Link up
MMC:   sdhci@d8000: 0
Loading Environment from SPIFlash... SF: Detected w25q64dw with page size 256 Bytes, erase size 4 KiB, total 8 MiB
OK
Model: CZ.NIC Turris Mox Board
Net:   eth0: neta@30000
Turris Mox:
  Board version: 22
  RAM size: 1024 MiB
  Serial Number: [somenumber]
  ECDSA Public Key: [somekey]
  SD/eMMC version: SD
Module Topology:
   1: Mini-PCIe Module
   2: Peridot Switch Module (8-port)
   3: Topaz Switch Module (4-port)

Hit any key to stop autoboot:  0 
gpio: pin GPIO221 (gpio 57) value is 0
gpio: pin GPIO220 (gpio 56) value is 1
SF: Detected w25q64dw with page size 256 Bytes, erase size 4 KiB, total 8 MiB
device 0 offset 0x7f0000, size 0x10000
SF: 65536 bytes @ 0x7f0000 Read: OK
switch to partitions #0, OK
mmc0 is current device
Scanning mmc 0:1...
Found U-Boot script /boot.scr
2070 bytes read in 85 ms (23.4 KiB/s)
## Executing script at 04d00000
19554 bytes read in 97 ms (196.3 KiB/s)
10448904 bytes read in 564 ms (17.7 MiB/s)
Moving Image from 0x5000000 to 0x5080000, end=5acb000
## Flattened Device Tree blob at 04f00000
   Booting using the fdt blob at 0x4f00000
   Loading Device Tree to 000000003faf5000, end 000000003fafcc61 ... OK

Starting kernel ...

"Synchronous Abort" handler, esr 0x96000021
elr: ffffffffc5a9d01c lr : 0000000000003234 (reloc)
elr: 00000000059b001c lr : 000000003ff16234
x0 : 000000003faf5000 x1 : 0000000000000000
x2 : 0000000000000000 x3 : 0000000000000000
x4 : 000000002ac1f300 x5 : 0000000000000001
x6 : 0000000000000001 x7 : 0000000000000000
x8 : 0000000005080000 x9 : 0000000000000002
x10: 000000000a200023 x11: 0000000000000002
x12: 0000000000000002 x13: 000000003faf8fff
x14: 000000003faf5000 x15: 000000003ff14f84
x16: 000000003ff5a230 x17: 0000000000000000
x18: 000000003fb02dc0 x19: 000000003ffe3f80
x20: 0000000000000000 x21: 0000000000000400
x22: 0000000000000003 x23: 000000003fbfacf8
x24: 000000003fbfacf8 x25: 000000003ffcdae8
x26: 0000000000000000 x27: 000000003ff1625c
x28: 000000003fbfad20 x29: 000000003fafe480

Code: f9005e66 4b0402a4 9ac42063 f9001663 (f8656842) 
Resetting CPU ...

resetting ...


CZ.NIC's Armada 3720 Secure Firmware v2021.09.07 (Sep  7 2021 18:16:52)
Running on Turris MOX
Initializing DDR... done
NOTICE:  Booting Trusted Firmware
NOTICE:  BL1: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL1: Built : 18:17:49, Sep  7 2021
NOTICE:  BL1: Booting BL2
NOTICE:  BL2: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL2: Built : 18:17:50, Sep  7 2021
NOTICE:  BL1: Booting BL31
NOTICE:  BL31: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL31: Built : 18:17:53, Sep  7 2021


U-Boot 2021.10-rc3-00050-g7d3fea2c7f (Sep 07 2021 - 18:16:56 +0200)

DRAM:  1 GiB
WDT:   Started with servicing (60s timeout)
Comphy chip #0:
Comphy-0: SGMII1        3.125 Gbps
Comphy-1: PEX0          5 Gbps    
Comphy-2: USB3_HOST0    5 Gbps    
PCIE-0: Link up
MMC:   sdhci@d8000: 0
Loading Environment from SPIFlash... SF: Detected w25q64dw with page size 256 Bytes, erase size 4 KiB, total 8 MiB
OK
Model: CZ.NIC Turris Mox Board
Net:   eth0: neta@30000
Turris Mox:
  Board version: 22
  RAM size: 1024 MiB
  Serial Number: [somenumber]
  ECDSA Public Key: [somekey]
  SD/eMMC version: SD
Module Topology:
   1: Mini-PCIe Module
   2: Peridot Switch Module (8-port)
   3: Topaz Switch Module (4-port)

Hit any key to stop autoboot:  0 
gpio: pin GPIO221 (gpio 57) value is 0
gpio: pin GPIO220 (gpio 56) value is 1
SF: Detected w25q64dw with page size 256 Bytes, erase size 4 KiB, total 8 MiB
device 0 offset 0x7f0000, size 0x10000
SF: 65536 bytes @ 0x7f0000 Read: OK
switch to partitions #0, OK
mmc0 is current device
Scanning mmc 0:1...
Found U-Boot script /boot.scr
2070 bytes read in 85 ms (23.4 KiB/s)
## Executing script at 04d00000
19554 bytes read in 97 ms (196.3 KiB/s)
10448904 bytes read in 564 ms (17.7 MiB/s)
Moving Image from 0x5000000 to 0x5080000, end=5acb000
## Flattened Device Tree blob at 04f00000
   Booting using the fdt blob at 0x4f00000
   Loading Device Tree to 000000003faf5000, end 000000003fafcc61 ... OK

Starting kernel ...

"Synchronous Abort" handler, esr 0x96000021
elr: ffffffffc5a9d01c lr : 0000000000003234 (reloc)
elr: 00000000059b001c lr : 000000003ff16234
x0 : 000000003faf5000 x1 : 0000000000000000
x2 : 0000000000000000 x3 : 0000000000000000
x4 : 000000002ac1f300 x5 : 0000000000000001
x6 : 0000000000000001 x7 : 0000000000000000
x8 : 0000000005080000 x9 : 0000000000000002
x10: 000000000a200023 x11: 0000000000000002
x12: 0000000000000002 x13: 000000003faf8fff
x14: 000000003faf5000 x15: 000000003ff14f84
x16: 000000003ff5a230 x17: 0000000000000000
x18: 000000003fb02dc0 x19: 000000003ffe3f80
x20: 0000000000000000 x21: 0000000000000400
x22: 0000000000000003 x23: 000000003fbfacf8
x24: 000000003fbfacf8 x25: 000000003ffcdae8
x26: 0000000000000000 x27: 000000003ff1625c
x28: 000000003fbfad20 x29: 000000003fafe480

Code: f9005e66 4b0402a4 9ac42063 f9001663 (f8656842) 
Resetting CPU ...

resetting ...


CZ.NIC's Armada 3720 Secure Firmware v2021.09.07 (Sep  7 2021 18:16:52)
Running on Turris MOX
Initializing DDR... done
NOTICE:  Booting Trusted Firmware
NOTICE:  BL1: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL1: Built : 18:17:49, Sep  7 2021
NOTICE:  BL1: Booting BL2
NOTICE:  BL2: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL2: Built : 18:17:50, Sep  7 2021
NOTICE:  BL1: Booting BL31
NOTICE:  BL31: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL31: Built : 18:17:53, Sep  7 2021


U-Boot 2021.10-rc3-00050-g7d3fea2c7f (Sep 07 2021 - 18:16:56 +0200)

DRAM:  1 GiB
WDT:   Started with servicing (60s timeout)
Comphy chip #0:
Comphy-0: SGMII1        3.125 Gbps
Comphy-1: PEX0          5 Gbps    
Comphy-2: USB3_HOST0    5 Gbps    
PCIE-0: Link up
MMC:   sdhci@d8000: 0
Loading Environment from SPIFlash... SF: Detected w25q64dw with page size 256 Bytes, erase size 4 KiB, total 8 MiB
OK
Model: CZ.NIC Turris Mox Board
Net:   eth0: neta@30000
Turris Mox:
  Board version: 22
  RAM size: 1024 MiB
  Serial Number: [somenumber]
  ECDSA Public Key: [somekey]
  SD/eMMC version: SD
Module Topology:
   1: Mini-PCIe Module
   2: Peridot Switch Module (8-port)
   3: Topaz Switch Module (4-port)

Hit any key to stop autoboot:  0 
gpio: pin GPIO221 (gpio 57) value is 0
gpio: pin GPIO220 (gpio 56) value is 1
SF: Detected w25q64dw with page size 256 Bytes, erase size 4 KiB, total 8 MiB
device 0 offset 0x7f0000, size 0x10000
SF: 65536 bytes @ 0x7f0000 Read: OK
switch to partitions #0, OK
mmc0 is current device
Scanning mmc 0:1...
Found U-Boot script /boot.scr
2070 bytes read in 84 ms (23.4 KiB/s)
## Executing script at 04d00000
19554 bytes read in 97 ms (196.3 KiB/s)
10448904 bytes read in 564 ms (17.7 MiB/s)
Moving Image from 0x5000000 to 0x5080000, end=5acb000
## Flattened Device Tree blob at 04f00000
   Booting using the fdt blob at 0x4f00000
   Loading Device Tree to 000000003faf5000, end 000000003fafcc61 ... OK

Starting kernel ...

"Synchronous Abort" handler, esr 0x96000021
elr: ffffffffc5a9d01c lr : 0000000000003234 (reloc)
elr: 00000000059b001c lr : 000000003ff16234
x0 : 000000003faf5000 x1 : 0000000000000000
x2 : 0000000000000000 x3 : 0000000000000000
x4 : 000000002ac1f300 x5 : 0000000000000001
x6 : 0000000000000001 x7 : 0000000000000000
x8 : 0000000005080000 x9 : 0000000000000002
x10: 000000000a200023 x11: 0000000000000002
x12: 0000000000000002 x13: 000000003faf8fff
x14: 000000003faf5000 x15: 000000003ff14f84
x16: 000000003ff5a230 x17: 0000000000000000
x18: 000000003fb02dc0 x19: 000000003ffe3f80
x20: 0000000000000000 x21: 0000000000000400
x22: 0000000000000003 x23: 000000003fbfacf8
x24: 000000003fbfacf8 x25: 000000003ffcdae8
x26: 0000000000000000 x27: 000000003ff1625c
x28: 000000003fbfad20 x29: 000000003fafe480

Code: f9005e66 4b0402a4 9ac42063 f9001663 (f8656842) 
Resetting CPU ...

resetting ...


CZ.NIC's Armada 3720 Secure Firmware v2021.09.07 (Sep  7 2021 18:16:52)
Running on Turris MOX
Initializing DDR... done
NOTICE:  Booting Trusted Firmware
NOTICE:  BL1: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL1: Built : 18:17:49, Sep  7 2021
NOTICE:  BL1: Booting BL2
NOTICE:  BL2: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL2: Built : 18:17:50, Sep  7 2021
NOTICE:  BL1: Booting BL31
NOTICE:  BL31: v2.5(release):v2.5-396-gb3fa4e461
NOTICE:  BL31: Built : 18:17:53, Sep  7 2021


U-Boot 2021.10-rc3-00050-g7d3fea2c7f (Sep 07 2021 - 18:16:56 +0200)

DRAM:  1 GiB
WDT:   Started with servicing (60s timeout)
Comphy chip #0:
Comphy-0: SGMII1        3.125 Gbps
Comphy-1: PEX0          5 Gbps    
Comphy-2: USB3_HOST0    5 Gbps    
PCIE-0: Link up
MMC:   sdhci@d8000: 0
Loading Environment from SPIFlash... SF: Detected w25q64dw with page size 256 Bytes, erase size 4 KiB, total 8 MiB
OK
Model: CZ.NIC Turris Mox Board
Net:   eth0: neta@30000
Turris Mox:
  Board version: 22
  RAM size: 1024 MiB
  Serial Number: [somenumber]
  ECDSA Public Key: [somekey]
  SD/eMMC version: SD
Module Topology:
   1: Mini-PCIe Module
   2: Peridot Switch Module (8-port)
   3: Topaz Switch Module (4-port)

Hit any key to stop autoboot:  0 
=>            

Any chance to get the system back working from this point?
With each new update i have to reinstall the whole system and doing the config. That’s not very funny.

Just guessing but could it be a bad SD card?
Easy enough to test a nother card

This lnk can provide you with some info should you want to debugg further and find more detailes

https://u-boot.readthedocs.io/en/latest/develop/crash_dumps.html

I have same problem, tried to contact support but they said its issue. In v6 its better but not fixed in 100%
I have no serial cable 1v8 to be safe if something broken, but you can try :smiley: https://gitlab.nic.cz/turris/mox-boot-builder/-/tags/v2021.09.07

Where I can download v6 images?