The thing that's so special about transformers is they can be trained end to end with gradient descent. You don't have to come up with the algorithm yourself. You just show the network examples of inputs and outputs and it figures out the algorithm. And because the algorithm is learned rather than programmed, it can be much more sophisticated than anything a human could come up with.
3d ago
Underscored — save the words that stop you in your tracks.
