Stuttering while other players are picking items in stadium

At the start of the round my game starts stuttering and my interpolation delay increases by ~8ms. I’m running a Ryzen 5 5600x and a RX 9070 XT. Lowest settings except anti aliasing at max. 99% sure it’s to do with other players being in the shop.