Plotting power curves

Performing a power analysis prior to running an A/B test is one of the most important steps. It enables us to improve our chances of reaching conclusive results and better plan for resources and time allocated to each test. Moreover, plotting power curves makes it easier to visualize the impact of varying certain parameters on the required sample size to hit the desired levels of confidence. Although a larger sample size betters our chances of reaching a conclusive result, gathering additional units or spending more time is a waste of resources as the power curves saturate.

Let's see how it works in practice.

Create NumPy arrays for the sample_sizes ranging from 10 to 600, and effect_sizes of 0.1, 0.2, and 0.3.

Exercise

Plotting power curves

Instructions 1/4