I can see their names pop up in the top left and they can hear me speak, but I cannot hear them. I have made sure to check and I do not have parental controls on. I have no other problems hearing any other audio in game and I do not know what to try.
This can be an issue caused by data being limited to your client. See this thread: Sound problem, missing soundeffects!