1. Learn
    2. /
  2. Courses
    3. /
  3. Building Recommendation Engines with PySpark

Exercise

Ratings data types

Markus watches a lot of movies, including documentaries, superhero movies, classics, and dramas. Drawing on your previous experience with Spark, use the markus_ratings dataframe, which contains data on the number of times Markus has seen movies in various genres, and think about whether these are implicit or explicit ratings. Use the groupBy() method to determine which genre has the highest rating, which could likely influence what recommendations ALS would generate for Markus.

Instructions

100 XP
  • Use the groupBy() method to group the markus_ratings dataframe by "Genre".
  • Apply the .sum() method to get the total number of movies watched for each genre.
  • Be sure to add the .show() method at the end to view the counts.