Invest Like the Best with Patrick O'Shaughnessy

Etched - Building AI Hardware to Make Inference Faster and Cheaper - [Invest Like the Best, EP.480]

The thing that's so special about a transformer ASIC is that you can literally etch the weights of a model into the chip itself. The weights never need to move — they're just there, on the chip, permanently. That means you eliminate the memory bandwidth bottleneck that makes GPUs so inefficient at inference.

Semafor

DeepMind Chief Demis Hassabis Says Google’s Still Winning AI Talent | Semafor Tech

It was basically sort of thought to be career suicide. Like of course we know AI doesn't work. You know, we tried it in the 90s, places like MIT and it was a dead end. You know, and that was the prevailing view. But we just felt the small band of us felt that that actually with the right ideas and using learning systems, reinforcement learning and betting on neural networks that a lot of fast progress could be made.