Remember: No matter which "side" you're on when the people representing your side do bad things, you still need to stand up against them.

"Ok but when you stand up against bad people on your side, the other side sees it as a win and acts like you are an idiot."

You cannot avoid having some people see you as an idiot, all you can do is try to avoid being one.