Personal stats not affecting SR.....?

A neutral win/loss is +/- 24 SR. So on your loss, you gained 3 SR, on an your win, you also gained 3 SR. It may be due to performance, but there are other factors as well. See How Competitive Skill Rating Works (Season 12). These other factors make it difficult to explain with certainty each SR lost and gained.