Spectating friends just doesn't work?

Pretty sure it’s a well known issue, since it’s has been a problem since OW1. Yet I’m still confused as to why it’s never been fixed? 90% of the time, when you spectate a friends game you’re just completely unable to swap between the people on their team. I wanna watch my friend play, not some random Mercy.