You need to hit the max level if you want the bar grayed out/empty. If you can’t, just use add-ons and customize your bars.