Grim Favors are glitching

Having an issue with the Grim Favors not registering. For example, Cull Constructs: each time I kill one it won’t count more than one for the total. I have not reached 10 Grim Favors to turn in for the Whispers of the Dead, so they should be counting. It is happening for all Grim Favor events. Only way to fix it is to exit the game and restart. But after awhile it will start doing the same thing again.