Get startedGet started for free

Talking to LLMs with Components

This exercise is part of the course

Building AI Agents with Haystack

View Course

Exercise instructions

You’re about to send your first prompts to a chat model using Haystack’s OpenAIChatGenerator. Let’s see how the model responds—with and without guidance.

  • Use the Haystack component to instantiate an OpenAI LLM.
  • Send a user message to ask a question to the LLM.
  • Add a system message to guide the model’s tone.


Note: If you’re running DataLab in Restricted Mode, this exercise isn’t supported yet. We’re actively working on making it available in the future.


Hands-on interactive exercise

Turn theory into action with one of our interactive exercises

Start Exercise