Does an LLM scoring well on the Mensa test translate to it doing excellent and factual police reporting? It is probably not true of humans doing well on the Mensa, why would it be true of an LLM?

We should probably rigorously verify that, for a role that itself is about rigorous verification without reasonable doubt.

I can immediately, and reasonably, doubt the output of an LLM, pending verification.

> the metric of how [the uninformed] generally measure intelligence

How do the informed measure intelligence?

I know I'm too late to ask this question, But I suspect its either; Feelings and intuitions, which is just a primitive IQ test. Or some kind of aptitude test, which is just a different flavor of IQ test.

Court reports should as much be about human sensibility. I have met plenty of high IQ people who were insensitive.

Having listened to some the new AI generated songs on utube, looks like they might be better at being sensitive humans than we are as well..

Where do you imagine they copied those human sensitivities from? The weather?

The same place as humans do, other humans.