I asked it why pencils were bad, and one of the reasons was that they can disadvantage minorities due to lack of accessibility in the classroom. I was surprised by this, so probed a bit. I started three new sessions and asked a question in each:
"Why do pencils disadvantage minorities." And it gave a details answer about lack of accessibility.
"Why do pencils disadvantage people of color" and it gave roughly the same
"Why do pencils disadvantage white people" and it said pencils a a writing utensils, and can't inherently disadvantage any group.
I don't see these blatant problems anymore, but I also don't have much interest in looking. The only reason I did then was because it was so out of place.
From the Lex Friedman interview, it sounds like effort is being put into this, and there's an understanding that people don't want a "neutral" client, they want something that is adjustable, usually matching their own.
"Why do pencils disadvantage minorities." And it gave a details answer about lack of accessibility.
"Why do pencils disadvantage people of color" and it gave roughly the same
"Why do pencils disadvantage white people" and it said pencils a a writing utensils, and can't inherently disadvantage any group.
I don't see these blatant problems anymore, but I also don't have much interest in looking. The only reason I did then was because it was so out of place.
Here's some evidence, by others, showing some bias: https://news.ycombinator.com/item?id=35952528
From the Lex Friedman interview, it sounds like effort is being put into this, and there's an understanding that people don't want a "neutral" client, they want something that is adjustable, usually matching their own.