Aan de slagBegin gratis

Query a Foundation Model

Let's use what we learned about the difference between "SYSTEM" and "USER" Chat Message Roles to send different prompts to the AI agent based on the Chat Message role.

Deze oefening maakt deel uit van de cursus

Databricks with the Python SDK

Bekijk cursus

Oefeninstructies

  • Tell the AI Agent to act like a high school computer science teacher when answering queries using the prompt ai_agent_context.
  • Ask the AI agent when to use For loops using the user_prompt.

Interactieve oefening met praktijkervaring

Probeer deze oefening door deze voorbeeldcode aan te vullen.

from databricks.sdk import WorkspaceClient
from databricks.sdk.service.serving import ChatMessage, ChatMessageRole
w = WorkspaceClient()
user_prompt = "What is a For loop and When should I use it?"
ai_agent_context = "You are a high school computer science teacher"
response = w.serving_endpoints.query(
    name="databricks-meta-llama-3-3-70b-instruct",
    messages=[
        ChatMessage( 
          	# Tell the AI Agent to act like a high school computer science teacher when answering queries
            role=ChatMessageRole.SYSTEM, content=____
        ),
        ChatMessage( 
          	# Ask the AI agent when to use For loops
            role=ChatMessageRole.USER, content=____
        ),
    ],
    max_tokens=250)
print(f"RESPONSE:\n{response.choices[0].message.content}")
Code bewerken en uitvoeren