Lots of companies are just databases. Software engineering is verifiable, you can run it through the compiler and see if it works. AI has obviously gotten really good at making software. If you believe the world is just software, that means AI has gotten good, it's done. You can see the labs are talking about how they've achieved AGI or they will very soon and it is very much connected to the ability of AI to write software. I'm just not discounting that that's important. I'm just saying once you get outside of software, verifiability gets way harder.
Today's models can grind through calculations, combine known techniques, and search enormous spaces, but still struggle with intuition, theory building, identifying the right questions, and developing the kind of big-picture understanding that drives much of mathematical progress.
