People’s views do matter regardless if they agree or disagree with you. Telling someone they don’t matter because they don’t support you means you have no right to request anything. You can’t say “I matter more than you” to someone who pays the same money you do Dorp.
Either everyone matters, or no one matters. There is no in between.