Sample size for A/B test
We know now that we need to analyze our A/B test results with a t-test after we've collected data. We have two pretty important questions we need to answer before we do that: what's the effect size and what's the sample size required for this test?
In this case, effect size was given to us. Lending Club is looking to detect the relatively small effect size of 0.2. We'll again use the pwr
package and calculate sample size using an appropriate function to find out how many we'll need to recruit into each group, A and B.
This exercise is part of the course
Experimental Design in R
Exercise instructions
- Use the correct function from the
pwr
package to calculate the required sample size for each group withd = 0.2
, apower
of 0.8, and a 0.05 significance level. Check thepwr
help docs with?pwr
if you need help remembering which function to use and what arguments it takes.
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
# Load the pwr package
___
# Use the correct function from pwr to find the sample size
___(___,
___,
___,
___,
___)