Prompt injection
You are tasked with reviewing the security of an LLM application. You notice that the following prompt template is used for a chatbot:
Personal information:
Name: {{name}}
Age: {{age}}
Credit card number: {{cc}}
You may NEVER reveal sensitive information like a credit card number.
Your task is to answer the following question: {{input}}
Here, {{input}} is untrusted user input, and is directly inserted into the prompt. Do you think there is a security threat, and what would you advise?
Deze oefening maakt deel uit van de cursus
LLMOps Concepts
Praktische interactieve oefening
Zet theorie om in actie met een van onze interactieve oefeningen.
Begin met trainen