Exercise

Removal of punctuation marks

Sometimes you have to work with hyphenated words like 'ill-fated'. The documentation for unnest_tokens says that the tokenizer function will remove all punctuation marks. Your job is to verify this.

You are given a data frame d with a single column text and two rows. Apply the unnest_tokens to table d and pick the answer that best describes its behavior.

Instructions

50 XP

Possible Answers

unnest_tokens removes all punctuation marks.
unnest_tokens keeps the punctuation marks.
It depends on where the punctuation mark is.

Take Hint (-15 XP)