Well, you do get to keep progress.
Dungeons: you keep the affix you unlock for the codex.
Statues of Lilith: you get the status buffs etc from those applied to all future characters you create for that realm.
Biomes: meeting reputation grants permanent boosts- skill points being the main ones, as well as potion cap.