Exercise

Create dictionary and corpus

In order to run an LDA topic model, you first need to define your dictionary and corpus first, as those need to go into the model. You're going to continue working on the cleaned text data that you've done in the previous exercises. That means that text_clean is available for you already to continue working with, and you'll use that to create your dictionary and corpus.

This exercise will take a little longer to execute than usual.

Instructions

100 XP

Import the gensim package and corpora from gensim separately.
Define your dictionary by running the correct function on your clean data text_clean.
Define the corpus by running doc2bow on each piece of text in text_clean.
Print your results so you can see dictionary and corpus look like.