Dummy trap

A dummy trap is a situation where different dummy variables convey the same information. In this case, if an employee is, say, from the accounting department (i.e. value in the accounting column is 1), then you're certain that s/he is not from any other department (values everywhere else are 0). Thus, you could actually learn about his/her department by looking at all the other departments.

For that reason, whenever \(n\) dummies are created (in your case, 10), only \(n\) - 1 (in your case, 9) of them are enough, and the \(n\)-th column's information is already included.

Therefore, you will get rid of the old department column, drop one of the department dummies to avoid dummy trap, and then join the two DataFrames.

This exercise is part of the course

HR Analytics: Predicting Employee Churn in Python

View Course

Exercise instructions

  • .drop() the accounting column to avoid "dummy trap".
  • .drop() the old column department as you do not need it anymore.
  • Join the new departments DataFrame to the employee dataset (this has been done for you).

Hands-on interactive exercise

Have a go at this exercise by completing this sample code.

# Drop the "accounting" column to avoid "dummy trap"
departments = departments.____("____", axis=1)

# Drop the old column "department" as you don't need it anymore
data = data.____("____", axis=1)

# Join the new DataFrame "departments" to your employee dataset: done
data = data.join(departments)