I don’t think I have done a dungeon in a group with other people since Cataclysm debuted. I might have done an LFR in Cata when it came out but otherwise, I pretty much stopped non-solo dungeons and raids by the time MoP came out.
I’m sure there are not a huge number of players that avoid them but it’s definitely more than you would think.