1. Learn
    2. /
  2. Courses
    3. /
  3. Deep Learning for Text with PyTorch

Exercise

Preprocessing text

Building a recommendation system, or any model, requires text to be preprocessed first.

A block of text from Sherlock Holmes is loaded here. Preprocess this text using the various techniques presented in the video to prepare it for further analysis.

The text variable is an excerpt from The Hound of the Baskervilles by Arther Conan Doyle.

The following packages and functions have been loaded for you: nltk, torch, get_tokenizer, PorterStemmer, stopwords.

Instructions 1/3

undefined XP
    1
    2
    3
  • Initialize the tokenizer with "basic_english".
  • Tokenize the text using the tokenizer.