CommencerCommencer gratuitement

Tokenization with spaCy

In this exercise, you'll practice tokenizing text. You'll use the first review from the Amazon Fine Food Reviews dataset for this exercise. You can access this review by using the text object provided.

The en_core_web_sm model is already loaded for you. You can access it by calling nlp(). You can use list comprehension to compile output lists.

Cet exercice fait partie du cours

Natural Language Processing with spaCy

Afficher le cours

Instructions

  • Store Doc container for the pre-loaded review in a document object.
  • Store and review texts of all the tokens of the document in the variable first_text_tokens.

Exercice interactif pratique

Essayez cet exercice en complétant cet exemple de code.

# Create a Doc container of the given text
document = ____(____)
    
# Store and review the token text values of tokens for the Doc container
first_text_tokens = [____ for ____ in ____]
print("First text tokens:\n", first_text_tokens, "\n")
Modifier et exécuter le code