This 100% needs to be a thing. Please do not listen to the hardcore “superfans” who get pissy at the idea of the game being more convenient and more fun for casual players.
A charm inventory would be an incredible QOL change that changes nothing about gameplay whatsoever.