Roon uses a more agressive buffering strategy compared to many other streaming protocols. This can cause issues on underspec’d computers and networks.
Could you run a speedtest and relay us the results? What CPU is in the Mac mini? Do you have another PC or Mac you could use as a Roon Core temporarily to help us determine if the cause of this issue lies with the Mac mini or the network?