Isn't this what people would do? I'd definitely update my knowledge after a single failed test question, if it was something I'd care about, and I discovered my previous model of reality was wrong.
> I'd definitely update my knowledge after a single failed test question
Maybe you would, maybe you wouldn’t. There are several psychological experiments which show people don’t act the way they say they “definitely” would when confronted with the situation. Quite a few examples in the movie “Experimenter”: https://en.wikipedia.org/wiki/Experimenter_(film)
> if it was something I'd care about, and I discovered my previous model of reality was wrong.
Those two ifs are doing a ton of heavy lifting. LLMs neither “care” nor “discover”. It’s not like you’re giving it a new contradicting piece of information and it’s going “interesting, let me research on that and update my model of reality if after careful consideration I find your assertion to be true”. It’s closer to having someone who’ll just accept everything you say and repeat it.
