Family-wise error rate
The likelihood of finding a Type I error increases with the number of tests being run. The significance level and number of tests being run can be used to determine the Family-wise error rate, or the likelihood of obtaining one or more false positives, or Type I errors, when running multiple tests.
Derive the Family-wise error rate for a small and large number of tests, noting the increase in likelihood of a false positive being found among the group of tests.
This exercise is part of the course
A/B Testing in R
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
# Find the family-wise error rate of five tests
___