It does work, for in-distribution detection/generalization. Which is avery useful tool for a mathematician (basically, a calculator on steroids), but it's not at all what a good mathematician ultimately does. Discovering new maths is by definition stepping out of distribution and into the unknown. There, mathematical intuition is much more important, and that's not something we understand and even less can model today.