I am reposting this here to be helpful provide others experiencing this issue with a fix
Ok so I made a thread under technical support that kind of solved it self. It turned out to be a bug in the two newest Nvidia Drivers. The bug seems so far based on Nvidia forums and Reddit to only effect RTX 3000 series cards.
Here is the reader’s digest version of what is happening.
There is an issue with background games and apps on Nividia Driver 545.84 and 545.92 with 3000 series cards (Desktop and Mobile but more so on mobile). Seen no 4000 series reports yet. The more resources the App/Game uses while tabbed the bigger the FPS hit or “slow-down” of your PC. So if you play a game like wow with a Background frame limiter as an option? Drivers post 537.58 FORCES your fames limited to 5-10 fps (depends on the game) regardless on if its enabled or not while alt tabbed.
There are minor other issues too.
Here is my Thread and Fix.
As an alternative if you dont want to read the other thread and just want a Fast Fix you need to download driver 537.58 from the nividia site here. This is what most people were doing on reddit/nvidia forums also.
I really hope this helps some of you!