Visualizing a Random Search

Visualizing the search space of random search allows you to easily see the coverage of this technique and therefore allows you to see the effect of your sampling on the search space.

In this exercise you will use several different samples of hyperparameter combinations and produce visualizations of the search space.

You have been provided the function sample_hyperparameters() which does the work you undertook in the previous exercise to create a (global) random sample of hyperparameter combinations from a (reduced) combinations_list you created previously. It takes an argument n_samples for how many combinations to sample.

You have been also provided the function visualize_search() which will produce a graph of the sample combinations. It takes no arguments.

Confirm how many possible hyperparameter combinations there are in combinations_list by assigning to the variable number_combs and print this out.
Sample 50, 500 and 1500 combinations and visualize them each. What do you notice about the visualization?
Sample all the hyperparameter combinations and visualize this. What does this look like?

Take Hint (-30 XP)

Exercise

Visualizing a Random Search

Instructions