I don’t understand how following them would change anything unless they are causing monsters that would not have appeared otherwise to spawn. If they don’t actually cause new monsters to spawn, then those monsters would have appeared anyway and likely had the same loot.
Either that, or they have some invisible aura that just boosts magic find for a time.