I would put a slight twist on it though: it seems to me like kids begin by default with very transactional patterns, and must be taught to have "relationships rooted in empathy and a steadfast commitment to the good of the other". The very patience that, say, teachers or nursery staff have to have give that impression: the ideal staff is always patient, never tired or irritable, never bored with what the children do or say, and so on; and it's partly the parents' job to help point out to children that the professional people they interact with are real people who have their own lives.
The challenge with LLMs is that there is no "real person" behind there to have an own life. The AI doesn't go home at the end of the day, never needs rest, never needs to have "me time" or let their guard down, has no other independent purpose than to serve the child (or some other human). So if we were to replace all the service workers in our lives with AIs, we'd lose loads of opportunities for developing empathy.
The challenge with LLMs is that there is no "real person" behind there to have an own life. The AI doesn't go home at the end of the day, never needs rest, never needs to have "me time" or let their guard down, has no other independent purpose than to serve the child (or some other human). So if we were to replace all the service workers in our lives with AIs, we'd lose loads of opportunities for developing empathy.