the inference that will matter most in the future, at least in terms of market size, will be "agentic inference", where humans aren't involved at all. That will lead to very different trade-offs in architectures, and is good news for both China and space (but maybe not Nvidia).
as four of the five megacaps continue to pour massive sums into AI (first quarter CapEx was more than three times that of the Manhattan Project), there are no signs of that pace slowing.
This acceleration of Capex directly correlates with an increased demand for compute in the age of inference. For every meme product like OpenClaw, that's a lot more tokens in the "tokenmaxxing" fad of the Generative AI movement. Large amounts of corporate bonds and Venture Capital funding are essentially subsidizing all of this burning of tokens and heating of GPUs.
But in reality, he's screwed the pooch compared to OpenAI, whose approach was, "Let's just sign these crazy fucking deals." OpenAI has got way more access to compute than Anthropic by the end of the year.
2mo ago
Underscored — save the words that stop you in your tracks.