Does Desert Island Discs count as a music podcast?
I know the title says no classical, but gonna break that rule and recommend the new series by Dev Hynes on BBC Sounds
Lastly not a podcast as such, but NTS radio has a huge archive of radio shows with some great musical guests