1. Learn
    2. /
  2. Courses
    3. /
  3. Introduction to Natural Language Processing in Python

Exercise

Charting practice

Try using your new skills to find and chart the number of words per line in the script using matplotlib. The Holy Grail script is loaded for you, and you need to use regex to find the words per line.

Using list comprehensions here will speed up your computations. For example: my_lines = [tokenize(l) for l in lines] will call a function tokenize on each line in the list lines. The new transformed list will be saved in the my_lines variable.

You have access to the entire script in the variable holy_grail. Go for it!

Instructions

100 XP
  • Split the script holy_grail into lines using the newline ('\n') character.
  • Use re.sub() inside a list comprehension to replace the prompts such as ARTHUR: and SOLDIER #1. The pattern has been written for you.
  • Use a list comprehension to tokenize lines with regexp_tokenize(), keeping only words. Recall that the pattern for words is "\w+".
  • Use a list comprehension to create a list of line lengths called line_num_words.
    • Use t_line as your iterator variable to iterate over tokenized_lines, and then len() function to compute line lengths.
  • Plot a histogram of line_num_words using plt.hist(). Don't forgot to use plt.show() as well to display the plot.