The vote is a majority of 6, with the host counting as 2. Ergo, you need 4 votes (host+2 others or the entire rest of the group) to pass an abandon vote.
This has very fun implications where you can list a key of a level you don’t have with a buddy, and you will control half the votes and prevent departure.