Invest Like the Best with Patrick O'Shaughnessy

Etched - Building AI Hardware to Make Inference Faster and Cheaper - [Invest Like the Best, EP.480]

The thing that's really interesting about transformers specifically is that it's not obvious that the architecture is going to change. Usually in the history of chip design, you build a chip for a specific algorithm and then the algorithm changes and your chip is worthless. But transformers have been around for seven years and they've just gotten bigger and bigger and more and more capable, and there's no real sign that they're going to go away.