1. Learn
    2. /
  2. Courses
    3. /
  3. Dimensionality Reduction in R

Exercise

Calculating child entropies

You have completed the first step for measuring the information gain that color provides — you computed the disorder of the root node. Now you need to measure the entropy of the child nodes so that you can assess if the collective disorder of the child nodes is less than the disorder of the parent node. If it is, then you have gained some information about loan default status from the information found in color.

decison tree split by color

Instructions

100 XP
  • Calculate the class probabilities for the left split (blue side).
  • Calculate the entropy of left split using the class probabilities.
  • Calculate the class probabilities for the left split (green side).
  • Calculate the entropy of right split using the class probabilities.