What I believe is that driverless cars today and lots of automated systems look very much like NLP systems in the 2010s. They are these very complex very handtuned systems. They're intelligent but they're intelligent in sort of isolated ways and that those systems hold back what these technologies can do.
The thing that's really interesting about transformers specifically is that it's not obvious that the architecture is going to change. Usually in the history of chip design, you build a chip for a specific algorithm and then the algorithm changes and your chip is worthless. But transformers have been around for seven years and they've just gotten bigger and bigger and more and more capable, and there's no real sign that they're going to go away.
An eight-year-old today doesn't need a driver's license when they're 16. And I think, going back to your point, it's easy to get in these modes where geopolitical white knuckle moment. But if you look, I think ultimately Tesla autonomous is worth a trillion dollars going to a Tesla story.
6mo ago
Underscored — save the words that stop you in your tracks.
