Might be related to this thread in CS? Same rhetoric.
Blue reply on how Kick works and why it exists (along with the debuff).
I am also going to add - there IS a cooldown on kicking within the system. People who kick too often find it on cooldown. The OP has had that explained too.
They were also told that they can make their own group, or run Follower dungeons. They do not get to force 4 other people to play with them their way. Voting in action - majority rules.