It looks like you are blaming people for standing up for their rights. The reason they still have special status is also because they have not been shy about fighting for their rights in the past, otherwise it would have been taking away a long time ago.
Instead of blaming people for defending their rights (bringing everyone down), perhaps a better avenue would be to stand up with them and also protest and ask for more rights (bringing everyone up).