Evaluate the ensemble
So far, so good. But how good exactly? Prove your model evaluation skills by cross-validating your out-of-sample AUC!
The specification boost_spec
and the customers_train
tibble are still loaded.
Diese Übung ist Teil des Kurses
Machine Learning with Tree-Based Models in R
Anleitung zur Übung
- Create five CV folds of your training set and save them as
folds
. - Fit and evaluate a model that predicts
still_customer
for every fold, using your specification, all predictor variables, and the AUC metric. - Collect the metrics of
cv_results
and check the mean AUC.
Interaktive Übung
Versuche dich an dieser Übung, indem du diesen Beispielcode vervollständigst.
set.seed(99)
# Create CV folds
folds <- ___
# Fit and evaluate models for all folds
cv_results <- fit_resamples(___,
___,
resamples = ___,
___)
# Collect cross-validated metrics
___