But in AI research, the priorities are exactly reversed. AI labs mainly care about how any new algorithmic recipe empirically makes training more efficient or elicits smarter models. They don't care about theory for its own sake, and all the progress we've made in deep learning over the last decade and a half has not required much new theory anyway. The equivalent of grinding through random conjectures would be enormously valuable in machine learning in a way that it just isn't in mathematics.

— Dwarkesh Patel
underscored
@underscored·November 13, 2026