Relationships between distant words
A software company has been able to handle more complex customer queries since adopting the transformer architecture for its AI chatbot. One of the main reasons is the ability to process long-range dependencies.
Consider the sentence:
"Alice, a talented graphic designer based in London, enjoys attending concerts featuring her favorite bands in the city."
Which aspect of transformer architecture helps the chatbot understand the relationship between "Alice" and "enjoys attending concerts"?
This exercise is part of the course
Large Language Models (LLMs) Concepts
Hands-on interactive exercise
Turn theory into action with one of our interactive exercises
