Can't connect to server issue leads to ban

I have decent internet and don’t have major lag when playing Overwatch 2. However, I’d say 1 in every 10 games I get a ‘Failed to connect to server.’ error and get kicked out of the game I’m queuing into. This happens fairly often to the point where I’m now banned for the season on my main account.
To go into depth on my problem, I get put into the ban phase and pick my preferred and banned heros, then I see the screen where it shows the banned heros for the game. It gets stuck there and I get the notification in chat ‘Failed to connect to server.’ And I get kicked out of the game I didn’t even join yet. I get the full leave penalty for this.