So nevermind, I managed to solve the stability issue.
Today I saw that the modem was unstable and looking at the output of
root@turris:~# qmicli -d /dev/cdc-wdm0 --nas-get-cell-location-info
I realized that I was connected to a cell serving other than B20 lte band.
After some trial and error i managed to lock the modem to B20 lte band and it is now stable. Here is what I used for the EC20 modem
#Stop the connection
ifdown Lte
#conect to modem through serial
socat - /dev/ttyUSB2,crnl
#Get the original BANDS
AT+QCFG="band"
+QCFG: "band",0xdf,0x800d5,0x3f
#Lock to B20
AT+COPS=0
AT+QCFG="band",0,80000,0,1
#Get the new BANDS
AT+QCFG="band"
+QCFG: "band",0xdf,0x80000,0x3f
#Start the connection
Ifup Lte