Well, as far as removing transmog restrictions I cover that in my massive post HERE and I agree.
However, to use the Zandalari as an example, if you honestly can imagine Queen Talanji bestowing the sacred armor of the Zandalari onto one who is not of Zandalarian blood, then you clearly do not understand their culture enough to wear that armor. And, you are correct, it is what it is.