It’s quite possible that in some cases network issues are the problem.
I found intermittent pops and clicks using a Pi 2 and DSD 128 but PCM 192 was fine. Others reported those artifacts becoming much more prevalent at DSD 256.
@Erik_Hansson has recently reported hi-res issues here.