Bonferroni correction

Let's implement multiple hypothesis tests using the Bonferroni correction approach that we discussed in the slides. You'll use the imported multipletests() function in order to achieve this.

Use a single-test significance level of .05 and observe how the Bonferroni correction affects our sample list of p-values already created.

This exercise is part of the course

Practicing Statistics Interview Questions in Python

Exercise instructions

Compute a list of the Bonferroni adjusted p-values using the imported multipletests() function.
Print the results of the multiple hypothesis tests returned in index 0 of your p_adjusted variable.
Print the p-values themselves returned in index 1 of your p_adjusted variable.

Hands-on interactive exercise

Have a go at this exercise by completing this sample code.

from statsmodels.sandbox.stats.multicomp import multipletests
pvals = [.01, .05, .10, .50, .99]

# Create a list of the adjusted p-values
p_adjusted = multipletests(____, alpha=____, method='bonferroni')

# Print the resulting conclusions
print(____)

# Print the adjusted p-values themselves 
print(____)

Edit and Run Code

This exercise is part of the course

Practicing Statistics Interview Questions in Python

AdvancedSkill Level

4.7+

Start Course for Free

This chapter kicks the course off by reviewing conditional probabilities, Bayes' theorem, and central limit theorem. Along the way, you will learn how to handle questions that work with commonly referenced probability distributions.

Exercise 1: Conditional probabilities Exercise 2: Setting up problems Exercise 3: Bayes' theorem applied Exercise 4: Central limit theorem Exercise 5: Samples from a rolled die Exercise 6: Simulating central limit theorem Exercise 7: Probability distributions Exercise 8: Bernoulli distribution Exercise 9: Binomial distribution Exercise 10: Normal distribution

In this chapter, you will prepare for statistical concepts related to exploratory data analysis. The topics include descriptive statistics, dealing with categorical variables, and relationships between variables. The exercises will prepare you for an analytical assessment or stats-based coding question.

Exercise 1: Descriptive statistics Exercise 2: Mean or median Exercise 3: Standard deviation by hand Exercise 4: Categorical data Exercise 5: Encoding techniques Exercise 6: Exploring laptop prices Exercise 7: Two or more variables Exercise 8: Types of relationships Exercise 9: Pearson correlation Exercise 10: Sensitivity to outliers

Prepare to dive deeper into crucial concepts regarding experiments and testing by reviewing confidence intervals, hypothesis testing, multiple tests, and the role that power and sample size play. We'll also discuss types of errors, and what they mean in practice.

Exercise 1: Confidence intervals Exercise 2: Confidence interval by hand Exercise 3: Applying confidence intervals Exercise 4: Hypothesis testing Exercise 5: One tailed z-test Exercise 6: Two tailed t-test Exercise 7: Power and sample size Exercise 8: Effect on type II error Exercise 9: Calculating sample size Exercise 10: Visualizing the relationship Exercise 11: Multiple testing Exercise 12: Calculating error rates Exercise 13: Bonferroni correction

Current Exercise

Wrapping up, we'll address concepts related closely to regression and classification models. The chapter begins by reviewing fundamental machine learning algorithms and quickly ramps up to model evaluation, dealing with special cases, and the bias-variance tradeoff.

Exercise 1: Regression models Exercise 2: Linear regression Exercise 3: Logistic regression Exercise 4: Evaluating models Exercise 5: Regression evaluation Exercise 6: Classification evaluation Exercise 7: Missing data and outliers Exercise 8: Handling null values Exercise 9: Identifying outliers Exercise 10: Bias-variance tradeoff Exercise 11: Test and training error Exercise 12: Visualizing the tradeoff Exercise 13: Wrapping up