Transformers, Hallucinations, and Prompts

1. Transformers, Hallucinations, and Prompts

the power of generative AI comes from the use of Transformers Transformers produced the 2018 revolution in natural language processing at a high level a Transformer model consists of an encoder and a decoder the encoder encodes the input sequence and passes it to the decoder which learns how to decode the representations for a relevant task sometimes Transformers run into issues though hallucinations are words or phrases that are generated by the model that are often nonsensical or grammatically incorrect see not great hallucinations can be caused by a number of factors like when the model is not trained on enough data is trained on noisy or dirty data is not given enough context or is not given enough constraints hallucinations can be a problem for Transformers because they can make the output text difficult to understand they can also make the model more likely to generate incorrect or misleading information so put simply hallucinations are bad let's pivot slightly and talk about prompts a prompt is a short piece of text that is given to a large language model or llm as input and it can be used to control the output of the model in a variety of ways prompt design is the process of creating a prompt that will generate the desired output from an llm like I mentioned earlier generative AI depends a lot on the training data that you have fed into it it analyzes the patterns and structures of the input data and thus learns both access to a browser based prompt you the user can generate your own content

2. Let's practice!

Create Your Free Account

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.