Tokenize a string from GoT
A first standard step when working with text is to tokenize it, in other words, split a bigger string into individual strings, which are usually single words (tokens).
A string GoT has been created for you and it contains a quote from George R.R. Martin's Game of Thrones. Your task is to split it into individual tokens.
Bu egzersiz, kursun bir parçasıdır
Sentiment Analysis in Python
Egzersiz talimatları
- Import the word tokenizing function from
nltk. - Transform the
GoTstring to word tokens.
Uygulamalı etkileşimli egzersiz
Bu egzersizi bu örnek kodu tamamlayarak deneyin.
# Import the required function
from nltk import ____
# Transform the GoT string to word tokens
print(____(____))