Word tokens from the Avengers
Now that you have tokenized your first string, it is time to iterate over items of a list and tokenize them as well. An easy way to do that with one line of code is with a list comprehension.
A list avengers has been created for you. It contains a few quotes from the Avengers movies. You can explore it in the IPython Shell.
This exercise is part of the course
Sentiment Analysis in Python
Exercise instructions
- Import the required function and package.
- Apply the word tokenizing function on each item of our list.
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
# Import the word tokenizing function
from ____ import _____
# Tokenize each item in the avengers
tokens_avengers = [____(item) for item in ____]
print(tokens_avengers)