Lose vigor when starting Dragonflight race

I start each race with six full vigor bubbles. The moment the race starts, I lose three of them.