1. Learn
  2. /
  3. Courses
  4. /
  5. Cleaning Data with PySpark

Connected

Exercise

Removing a DataFrame from cache

You've finished the analysis tasks with the departures_df DataFrame, but have some other processing to do. You'd like to remove the DataFrame from the cache to prevent any excess memory usage on your cluster.

The DataFrame departures_df is defined and has already been cached for you.

Instructions

100 XP
  • Check the caching status on the departures_df DataFrame.
  • Remove the departures_df DataFrame from the cache.
  • Validate the caching status again.