Text prediction with LSTMs

During the following exercises you will build an LSTM model that is able to predict the next word using a small text dataset. This dataset consist of cleaned quotes from the The Lord of the Ring movies. You can find them in the text variable.

You will turn this text into sequences of length 4 and make use of the Keras Tokenizer to prepare the features and labels for your model!

The Keras Tokenizer is already imported for you to use. It assigns a unique number to each unique word, and stores the mappings in a dictionary. This is important since the model deals with numbers but we later will want to decode the output numbers back into words.

Split the text into an array of words using .split().
Make lines of 4 words each, moving one word at a time.
Instantiate a Tokenizer(), then fit it on the lines with .fit_on_texts().
Turn lines into a sequence of numbers calling .texts_to_sequences().

Take Hint (-30 XP)

Exercise

Text prediction with LSTMs

Instructions