IniziaInizia gratis

Guiding customer support responses

You work for an e-commerce company and are integrating Llama into a customer support assistant. The assistant answers frequently asked questions, but you've noticed that responses are too repetitive.

You need to modify decoding parameters to encourage more varied wording while keeping responses informative.

The model is already instantiated with a model using llama_cpp and is stored in llm.

Questo esercizio fa parte del corso

Working with Llama 3

Visualizza il corso

Istruzioni dell'esercizio

  • Set the temperature parameter so that responses are less repetitive and more dynamic.

Esercizio pratico interattivo

Prova a risolvere questo esercizio completando il codice di esempio.

output = llm(
		"Can I exchange an item I purchased?", 
  		# Set the temperature parameter to provide more varied responses
		temperature=____,
        max_tokens=15
) 

print(output['choices'][0]['text'])
Modifica ed esegui il codice