1. Learn
    2. /
  2. Courses
    3. /
  3. Model Validation in Python

Exercise

Selecting the best precision model

Your boss has offered to pay for you to see three sports games this year. Of the 41 home games your favorite team plays, you want to ensure you go to three home games that they will definitely win. You build a model to decide which games your team will win.

To do this, you will build a random search algorithm and focus on model precision (to ensure your team wins). You also want to keep track of your best model and best parameters, so that you can use them again next year (if the model does well, of course). You have already decided on using the random forest classification model rfc and generated a parameter distribution param_dist.

Instructions

100 XP
  • Create a precision scorer, precision using make_scorer(<scoring_function>).
  • Complete the random search method by using rfc and param_dist.
  • Use rs.cv_results_ to print the mean test scores.
  • Print the best overall score.