Evaluating SHAP explanation consistency
Evaluate the consistency of feature importance explanations using SHAP values across two different subsets of the insurance dataset.
The subsets X1, X2, y1, and y2 have been pre-loaded for you along with model1 trained on the first subset and model2 trained on the second subset.
This exercise is part of the course
Explainable AI in Python
Exercise instructions
- Calculate
shap_values1andfeature_importance1formodel1. - Calculate
shap_values2andfeature_importance2formodel2. - Calculate
consistencybetween feature importances.
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
# Calculate SHAP values and feature importance for model1
explainer1 = shap.TreeExplainer(model1)
shap_values1 = ____
feature_importance1 = ____
# Calculate SHAP values and feature importance for model2
explainer2 = shap.TreeExplainer(model2)
shap_values2 = ___
feature_importance2 =____
# Consistency calculation
consistency = ____
print("Consistency between SHAP values:", consistency)