I would kick them, yes.
Edit: and to the people saying they would leave, that is a good thing! Guildies should get along, it’s a game. We’re all here to have fun, if a person is ruining your fun, get rid of them. If I’m ruining other peoples fun I hope they would tell me, so I could leave them in peace.