IniziaInizia gratis

Chatting with Llama 3

A data analytics company is developing an internal AI assistant to help employees quickly access technical information. As part of this project, they want to integrate Llama 3, and have asked you to test it.

To get started, you initialize the Llama 3 model locally and generate a response to a question.

The model path is already stored as a variable named llama_path.

Questo esercizio fa parte del corso

Working with Llama 3

Visualizza il corso

Istruzioni dell'esercizio

  • Import the Llama class from llama_cpp.
  • Initialize an instance of Llama, specifying llama_path as the path to the model file.

Esercizio pratico interattivo

Prova a risolvere questo esercizio completando il codice di esempio.

# Import the Llama class
from llama_cpp import ____

# Initialize the Llama model
llm = ____(model_path=____)

question = "What is the most used database for data storage?"
response = llm(question)
print(response)
Modifica ed esegui il codice