So after some time this is what’s happening.
It started with being disconnected from some communities when starting D3, and being unable to reconnect.
So I tried to leave those communities, so I could rejoin them, but it wouldn’t let me remove them from my list, saying I’m not a member. Only after restarting D3, some of them got removed from my list.
Problem is I wasn’t able to rejoin those communities. And now when I start the game somehow I find most of them in my list again. With at times more than 10 communities in my list. Still unable to join the channels or remove/join them normally without playing a game of chance with game restarts.