Foremost, hello and welcome to MG! Luckily you’ve made your interest check at a time that is particularly wonderful for NElf RP! We have both an abundance of guilds on the server that are relatively active as well as a good amount of NElf RPers searching for homes for their characters.
I would say that if you are interested in crafting a guild here, go for it! Although with a Druid-only guild you run the risk of slower recruitment, there are certainly bound to be individuals who are interested in the niche and will establish themselves within your ranks. MG and WrA are both wonderful servers for NElf RP, so I think you’d be successful in fleshing yourself out on either one. However, I am clearly a bit biased. 
If you are perhaps looking for people to help bounce ideas off of or a community to promote your idea in, feel free to check out the Celestial Coalition. We are a primarily Kaldorei organization that accepts all guilds (even non-NE ones) that align with our interests! We have a bunch of community events for you to attend and maybe get your group introduced both OOCly and ICly if it does come to fruition! I’ll post the link below.
Celestial Coalition forum: The Celestial Coalition
TLDR: Totally think it is feasible, and I wish you the best in your endeavors!