Unable to remove tag from an artist

I have also had this problem with a few artists. They appear twice in my tags. They are identical and if I remove the tag from both, it goes down to appearing once. So I can never remove the artist from the tag and have to live with those artsts being duplicates within the tags.

Note The Mars Volta and The Smashing Pumpkins. Both look identical when you click on either.