underscored

@underscored

9 clips · 1 follower

Follow
Tag:ai-infrastructureClear

Polls show that roughly 70% to 75% of Americans oppose building large data centers near their homes, and more than half support a national moratorium.

Michael Spencer
3w ago

These companies were largely built around the winning assets of the previous energy system: oil fields, refineries, pipelines, tankers, centralized generation, poles, and wires. The energy transition that's been underway has already created new bottlenecks – the grid struggles matching variable supply with unpredictable demand, for example – and therefore new valuable positions. Then the most ravenous consumer of electrons in history entered the market in the form of data centers.

1mo ago

Three years ago we were still in the ChatGPT era of AI, and I was very excited about the possibility of local inference. Then came the reasoning era, blowing up KV cache (which increases the need for more memory) and emphasizing the importance of decode (to generate that many more tokens). Now we're in the agentic era, where CPU performance is incredibly important. To that end, the ideal setup for a local agent is strong local CPU performance and calling out to the cloud for inference.

3mo ago

the inference that will matter most in the future, at least in terms of market size, will be "agentic inference", where humans aren't involved at all. That will lead to very different trade-offs in architectures, and is good news for both China and space (but maybe not Nvidia).

4mo ago

as four of the five megacaps continue to pour massive sums into AI (first quarter CapEx was more than three times that of the Manhattan Project), there are no signs of that pace slowing.

4mo ago

This acceleration of Capex directly correlates with an increased demand for compute in the age of inference. For every meme product like OpenClaw, that's a lot more tokens in the "tokenmaxxing" fad of the Generative AI movement. Large amounts of corporate bonds and Venture Capital funding are essentially subsidizing all of this burning of tokens and heating of GPUs.

4mo ago

Google is the one that's made the most progress in terms of building a full-stack AI ecosystem.

6mo ago

Underscored — save the words that stop you in your tracks.

Start saving quotes →