Get startedGet started for free

Read Dask DataFrames from Parquet

In Chapter 1, you analyzed some Spotify data, which was split across multiple files to find the top hits of 2005-2020. You did this using the dask.delayed() function and a loop. Let's see how much easier this analysis becomes using Dask DataFrames.

dask.dataframe has been imported for you as dd.

This exercise is part of the course

Parallel Programming with Dask in Python

View Course

Exercise instructions

  • Load the Parquet data folder located in "data/spotify_parquet".
  • Use the DataFrame's .nlargest() method to find the top 10 songs by 'popularity'.
  • Convert the delayed object into a pandas DataFrame by computing it.

Hands-on interactive exercise

Have a go at this exercise by completing this sample code.

# Read the spotify_parquet folder
df = ____

# Find the 10 most popular songs
top_10_songs = ____

# Convert the delayed result to a pandas DataFrame
top_10_songs_df = ____

print(top_10_songs_df)
Edit and Run Code