Physical damage from smiter question

Leveling a smiter currently, and curious on how to deal with physical immune. Is this not a problem with grief or do I put a point into vengence? Feedback welcome

https://us.forums.blizzard.com/en/d2r/t/smiter-vs-physical-immunity/45667