Exercise

Hot-deck tricks & tips II: sorting by correlated variables

Another trick that can boost the performance of hot-deck imputation is sorting the data by variables correlated to the one we want to impute.

For instance, in all the margin plots you have been drawing recently, you have seen that air temperature is strongly correlated with sea surface temperature, which makes a lot of sense. You can exploit this knowledge to improve your hot-deck imputation. If you first order the data by sea_surface_temp, then every imputed air_temp value will come from a donor with a similar sea_surface_temp. Let's see how this will work!

Instructions

100 XP
  • Hot-deck-impute the missing values in air_temp in the tao data, ordering by sea_surface_temp and assign the result to tao_imp.
  • Create a margin plot of air_temp vs sea_surface_temp.