Exercise

Calculating error rates

We talked a bit about the multiple comparisons problem in the slides, but let's take things a step further. In this exercise, you'll look into how the phenomenon affects error rate more precisely.

Your colleague is strongly considering running 60 distinct hypothesis tests. In order to convince them otherwise, compute the probability of a Type I error for 60 hypothesis tests with a single-test 5% significance level.

Instructions 1/3

undefined XP

1
Compute and print the probability of your colleague getting a Type I error.
2
You successfully talked them down to 30 tests; adapt your code to compute and print the new error rate.
3
One last try; adapt your code to compute and print the error rate for 10 tests.