1. Lära sig
    2. /
  2. Courses
    3. /
  3. Monitoring Machine Learning in Python
Connected

exercise

Business calculation for hotel booking dataset

Previously, you were introduced to the challenge of predicting booking cancellations. Here, you will work with the actual Hotel Booking dataset, where a model predicts booking cancellations based on the customer's country of origin, time between booking and arrival, required parking spaces, and the chosen hotel.

The reference and analysis sets have already been loaded for you. Here are the first two rows:

  country  lead_time  parking_spaces       hotel  y_pred  y_pred_proba  is_canceled  timestamp
0  FRA     120        0               City Hotel  0       0.239983      0           2016-05-01
1  ITA     120        1               City Hotel  0       0.003965      0           2016-05-01

Your task is to check the model's monetary value and ROC AUC performance.

Instruktioner

100 XP
  • Initialize a custom threshold with 0 as the lower value and 150,000 as the upper value.
  • Specify the business value and roc_auc metric for monitoring.
  • Set TN to 0, FP to -100, FN to -200, and TP to 1500 in business_value_matrix.
  • Assign custom threshold to the business value metric.