1. Learn
    2. /
  2. Courses
    3. /
  3. Text Mining with Bag-of-Words in R

Exercise

Stop words and word clouds

Now that you are in the text mining mindset, sitting down for a nice glass of chardonnay, we need to dig deeper. In the last word cloud, "chardonnay" dominated the visual. It was so dominant that you couldn't draw out any other interesting insights.

Let's change the stop words to include "chardonnay" to see what other words are common, yet were originally drowned out.

Your workspace has a cleaned version of chardonnay tweets, but now let's remove some non-insightful terms. This exercise uses content() to show you a specific tweet for comparison. Remember to use double brackets to index the corpus list.

Instructions

100 XP
  • Apply content() to the 24th document in chardonnay_corp.
  • Append "chardonnay" to the English stopwords, assigning to stops.
  • Examine the last six words in stops.
  • Create cleaned_chardonnay_corp with tm_map() by passing in the chardonnay_corp, the function removeWords() and finally the stopwords, stops.
  • Now examine the content of the 24 tweet again to compare results.