No - the fights have a single difficulty. They are tuned to be clearable by 20 people, but you can bring more than that. There are separate leaderboards on warcraft logs for 20 man groups (considered Mythic raiding) and 20+ man groups. You can trivialize most SoD content by just bringing more people.