It happens with human artists that don't bother understanding the things they draw. What is just a way of saying that yes, human can emulate those NLP¹ AIs, but we can choose not to. (And no, it doesn't take a strong focus on realism. Our world has all kinds of mechanics that most people understand.)

1 - We do need a name for this characteristic, because NPL AI is anything that talks with humans