Hey @Robin,
Can you provide more information about your network setup? What router model and ISP are you currently running?
With that, can you provide more details on your ethernet switch? Is it managed vs unmanaged? As a test, can you try bypassing the switch and hardwire your core directly to your router to see if you experience the same delay?
I’ll be on standby for your reply 