It is absolutely not griefing. You were removed by the majority vote. People are using the system as it’s intended to be used. People cannot be reported for using the vote-kick system as it’s meant to be used.
If you want to make a suggestion or offer your feedback constructively, you can make a post in the Dungeons & Raids forum or through the in-game suggestion and feedback interface.