Finding the most common words
Its always advisable once you have created your features to inspect them to ensure that they are as you would expect. This will allow you to catch errors early, and perhaps influence what further feature engineering you will need to do.
The vectorizer (cv
) you fit in the last exercise and the sparse array consisting of word counts (cv_trigram
) is available in your workspace.
Este exercício faz parte do curso
Feature Engineering for Machine Learning in Python
Instruções do exercício
- Create a DataFrame of the features (word counts).
- Add the counts of word occurrences and print the top 5 most occurring words.
Exercício interativo prático
Experimente este exercício completando este código de exemplo.
# Create a DataFrame of the features
cv_tri_df = ____(____,
columns=cv_trigram_vec.get_feature_names()).add_prefix('Counts_')
# Print the top 5 words in the sorted output
print(cv_tri_df.sum().____(ascending=____).head())