No, this isn’t normal. It should be silent. Similar post here …
Are you sure the sound is from the RPi or from the power supply? Also, what DAC are you using?