Get startedGet started for free

Relationships between distant words

A software company has been able to handle more complex customer queries since adopting the transformer architecture for its AI chatbot. One of the main reasons is the ability to process long-range dependencies.

Consider the sentence:

"Alice, a talented graphic designer based in London, enjoys attending concerts featuring her favorite bands in the city."

Which aspect of transformer architecture helps the chatbot understand the relationship between "Alice" and "enjoys attending concerts"?

This exercise is part of the course

Large Language Models (LLMs) Concepts

View Course

Hands-on interactive exercise

Turn theory into action with one of our interactive exercises

Start Exercise