At that point you could also just make your friend GM to hold on for you, or just make it a point to hang with them once a quarter for some IRL fun and your login to avoid dethroning.
It’s a fine system. OP could have avoided this problem entirely but just ignored the published process. If they’re just using the guild as their bank, don’t invite other people, especially randoms. Do you guys just walk around giving keys to your house to strangers?