Advancements of transformer architecture
The transformer architecture, introduced by Vaswani et al. in 2017, brought significant advancements over the previously used Recurrent Neural Networks (RNNs).
What key advancement does the transformer architecture provide over RNNs?
This exercise is part of the course
Intermediate ChatGPT
Hands-on interactive exercise
Turn theory into action with one of our interactive exercises
Start Exercise