Get startedGet started for free

Generating text

LLMs have many capabilities with text generation being one of the most popular.

You need to generate a response to a customer review found in text; it contains the same customer review for the Riverview Hotel you've seen before.

The pipeline module has been loaded for you.

This exercise is part of the course

Introduction to LLMs in Python

View Course

Exercise instructions

  • Instantiate the generator pipeline specifying an appropriate task for generating text.
  • Complete the prompt by including the text and response in the f-string.
  • Complete the model pipeline by specifying a maximum length of 150 tokens and setting the pad_token_id to the end-of-sequence token.

Hands-on interactive exercise

Have a go at this exercise by completing this sample code.

# Instantiate the pipeline
generator = pipeline(____, model="gpt2")

response = "Dear valued customer, I am glad to hear you had a good stay with us."

# Complete the prompt
prompt = f"Customer review:\n{____}\n\nHotel reponse to the customer:\n{____}"

# Complete the model pipeline
outputs = generator(prompt, ____, pad_token_id=____, truncation=True)

print(outputs[0]["generated_text"])
Edit and Run Code