1. Learn
    2. /
  2. Courses
    3. /
  3. Working with Llama 3
Connected

Exercise

Chatting with Llama 3

A data analytics company is developing an internal AI assistant to help employees quickly access technical information. As part of this project, they want to integrate Llama 3, and have asked you to test it.

To get started, you initialize the Llama 3 model locally and generate a response to a question.

The model path is already stored as a variable named llama_path.

Instructions

100 XP
  • Import the Llama class from llama_cpp.
  • Initialize an instance of Llama, specifying llama_path as the path to the model file.