I don’t think the DigiOne would be worthwhile in this scenario. With my Chord 2Qute the difference between RPi USB and the DigiOne was small (although ticks and clicks were completely eliminated.)
You may fair better using an RPi DAC hat and bypassing the internal DAC. For instance a PCM512x based hat is likely to give you some improvement for less than $50.