Update on this:
I exchanged the SFP-Module and still not really a change.
Only the upload is slightly faster, but that might just also be due to availability from the speedtest-servers.
Work laptop with activated VPN gets me also around 400 Mbit/s Up and 700 Mbit/s down…