What if only class cards could be duplicated or replayed?

I’m not a card designer in any sense, but I had an idea, and wondered if it would be good or bad, and why?
What if Neutrals and Legendary cards, or their effects were not able to be duplicated, or bounced?
Would it make the game more fair? Would it cripple the game?
Something in between?