I’ve played in many Alliance bgs, never once been vote-kicked out for being AFK. This is despite making the occasional “alliance sucks” style comment during losses (to pass the time) 
Maybe you had some enemies on the team or something? Someone had a grudge against you? That’s my best guess OP, because so far I’ve never ever ever been AFK kicked from an Alliance bg 