May be a long shot, but I had the same issue and what fixed it was going to Interface > !Combat and checking on Unit Frame Mouseover Cast, but leaving the key option as None. It immediately solved that delay on my unit frames. Hope it works for you guys as well.