system can be abused in all scenarios.
maybe it just matter on what abuse of rules is fine and what ones are causing more harm than good.
maybe a solution would be to make the first kick or leave have no deserter. things happen. here is your benefit of doubt. odds get a lot smaller for repeated issues.
its prob unlikely to happen twice. or 5x etc before maybe the problem is the one seeing the problem.
if its not your fault, then really, it should be far less likely to happen again.