Evaluate the ensemble
So far, so good. But how good exactly? Prove your model evaluation skills by cross-validating your out-of-sample AUC!
The specification boost_spec and the customers_train tibble are still loaded.
Deze oefening maakt deel uit van de cursus
Machine Learning with Tree-Based Models in R
Oefeninstructies
- Create five CV folds of your training set and save them as
folds. - Fit and evaluate a model that predicts
still_customerfor every fold, using your specification, all predictor variables, and the AUC metric. - Collect the metrics of
cv_resultsand check the mean AUC.
Praktische interactieve oefening
Probeer deze oefening eens door deze voorbeeldcode in te vullen.
set.seed(99)
# Create CV folds
folds <- ___
# Fit and evaluate models for all folds
cv_results <- fit_resamples(___,
___,
resamples = ___,
___)
# Collect cross-validated metrics
___