Measure AUC

In this exercise, you will compute the AUC of your churn prediction models to find the best one. Use the auc() function in the pROC package. The function has two arguments:

The true churn label in the test set, test_set$Future.
The model prediction:
a. For logistic regression, it is the prediction obtained from the predict function.
b. For random forest, it is the second column of the prediction obtained from the predict function.

The objects firstPredictions, secondPredictions, thirdPredictions, and rfPredictions have been loaded for you.

Which model has the highest AUC value?

Possible answers

Logistic regression model 1 (with simple network features)

Logistic regression model 2 (with link-based features)

Logistic regression model 3 (with all features)

Random forest model

Exercise

Measure AUC

Instructions

Possible answers