Did you do the quests? Most of the delve quests are someone asking you to do something and Brann just happens to be there. The first delve the main story has you do is Baelgrim sending you to the mines and saying “oh yeah Brann is here too” he’s not important to the story at all he’s incidental an could have been replaced by anyone.