Evaluating SHAP explanation consistency
Evaluate the consistency of feature importance explanations using SHAP values across two different subsets of the insurance dataset.
The subsets X1
, X2
, y1
, and y2
have been pre-loaded for you along with model1
trained on the first subset and model2
trained on the second subset.
This exercise is part of the course
Explainable AI in Python
Exercise instructions
- Calculate
shap_values1
andfeature_importance1
formodel1
. - Calculate
shap_values2
andfeature_importance2
formodel2
. - Calculate
consistency
between feature importances.
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
# Calculate SHAP values and feature importance for model1
explainer1 = shap.TreeExplainer(model1)
shap_values1 = ____
feature_importance1 = ____
# Calculate SHAP values and feature importance for model2
explainer2 = shap.TreeExplainer(model2)
shap_values2 = ___
feature_importance2 =____
# Consistency calculation
consistency = ____
print("Consistency between SHAP values:", consistency)