In that case, you might as well make it a strict queue hell with leavers and griefers.
If you are waiting on the normal queue pool to fulfill, you might as well never join a game as there is almost always going to be a steady flow of players queuing. Seems a bit overly harsh to me. But then again, leaving 5 games in a row is also a d!ck move.
Edit: just saw your edit. Yeah it makes sense now, and I agree with you.