This is a pretty common issue for me as I live in Australia. I get 20ms easily when just going through the open world but as soon as I join any party, raid, dungeon, etc I instantly go above 200ms. Makes it very hard for me to even want to do anything instanced.