Coming up with accurate financial data that you can't get it to report outright doesn't seem like one.

Models do not possess awareness of their training data. Also you are taking at face value that it is "accurate".

I don't understand the wording

Accurate financial data?

How do we know?

What does using not-web-search not having the data have to do with the claim that private chats with the data are being leaked?

> I found this company; it is real and numbers in the response are real.

???

That the financial data is accurate?

It's an ourobos - he can't verify it's real! If he can, its online and available by search.

Therefore what are the odds that this is just the LLM doing its thing versus "a vulnerability". Seem like a pretty obvious bet.