Could you please setup a temporary ethernet connection from your Windows running Roon Server directly to your primary router, and see if your issues persist?
If they do, please share the name of a track you experience skipping with, and our team will enable diagnostics for your Roon Server.