The thing that's interesting about transformers is that, unlike previous neural network architectures, the operations they do are basically fixed. A transformer from 2024 does the same operations as a transformer from 2017. So you can build a chip that is essentially a transformer, etched in silicon, and it will always be doing the most important computation in AI.
You might also like
In the case of Anthropic, the revenue has gone as high as $50 million per megawatt. What that now enables them to do is: 'Hey, if I spend 10 bucks on inference capacity, I actually generate 50 bucks of revenue, and then I can turn around and incrementally spend all of that profit on training.'
Dylan Patel
Both include new chips optimized for AI, with the M6 Mac Mini getting a $200 price bump.
Luke Larsen
These companies were largely built around the winning assets of the previous energy system: oil fields, refineries, pipelines, tankers, centralized generation, poles, and wires. The energy transition that's been underway has already created new bottlenecks – the grid struggles matching variable supply with unpredictable demand, for example – and therefore new valuable positions. Then the most ravenous consumer of electrons in history entered the market in the form of data centers.
Packy McCormick