They're really weird and lots of them are gay so the social mechanisms that stop us giving groups a lot of shit for no good reason are weaker for them.

This is not a particularly comforting explanation, but I'm unaware of a better one (and I've discussed this with a bunch of smart furry friends over the years).