Its a bit more nuanced. They had some relation and trade originally with the Earthen but when Sargeras stabbed the world the Coreway became more dangerous and the High Speaker began to fall. He started having his Earthen kill the traders and trade ceased. (Its a side quest you have to do to piece that together.)