Does the issue happen from multiple Roon remotes or just one? Are you using Google/Cloudflare DNS service?
It’s very possible that this might be happening due to your ISP restricting access, if this is the case please see the following article for more information: