Sensitivity to outliers

When we are analyzing the relationship of more than one variable, correlation is a great start. But how does correlation hold up against some more interesting datasets? How well does it hold up against outliers?

In this exercise, you will plot and compute the correlation for a dataset with an outlier and then remove it and see what changes. In the end, you want to see how correlation performs and come to a conclusion about when and where you should use it.

A sample dataset from the famous Anscombe's quartet has been imported for you as the df variable, along with the all the packages used previously in this chapter.

Cet exercice fait partie du cours

Practicing Statistics Interview Questions in Python

Afficher le cours

Exercice interactif pratique

Essayez cet exercice en complétant cet exemple de code.

# Display the scatter plot of X and Y
plt.scatter(____, ____)
plt.show()

Modifier et exécuter le code

Cet exercice fait partie du cours

Practicing Statistics Interview Questions in Python

AvancéNiveau de compétence

4.7+

38 reviews

Commencer le cours gratuitement

This chapter kicks the course off by reviewing conditional probabilities, Bayes' theorem, and central limit theorem. Along the way, you will learn how to handle questions that work with commonly referenced probability distributions.

Exercise 1: Conditional probabilities Exercise 2: Setting up problems Exercise 3: Bayes' theorem applied Exercise 4: Central limit theorem Exercise 5: Samples from a rolled die Exercise 6: Simulating central limit theorem Exercise 7: Probability distributions Exercise 8: Bernoulli distribution Exercise 9: Binomial distribution Exercise 10: Normal distribution

In this chapter, you will prepare for statistical concepts related to exploratory data analysis. The topics include descriptive statistics, dealing with categorical variables, and relationships between variables. The exercises will prepare you for an analytical assessment or stats-based coding question.

Exercise 1: Descriptive statistics Exercise 2: Mean or median Exercise 3: Standard deviation by hand Exercise 4: Categorical data Exercise 5: Encoding techniques Exercise 6: Exploring laptop prices Exercise 7: Two or more variables Exercise 8: Types of relationships Exercise 9: Pearson correlation Exercise 10: Sensitivity to outliers

Exercice en cours

Prepare to dive deeper into crucial concepts regarding experiments and testing by reviewing confidence intervals, hypothesis testing, multiple tests, and the role that power and sample size play. We'll also discuss types of errors, and what they mean in practice.

Exercise 1: Confidence intervals Exercise 2: Confidence interval by hand Exercise 3: Applying confidence intervals Exercise 4: Hypothesis testing Exercise 5: One tailed z-test Exercise 6: Two tailed t-test Exercise 7: Power and sample size Exercise 8: Effect on type II error Exercise 9: Calculating sample size Exercise 10: Visualizing the relationship Exercise 11: Multiple testing Exercise 12: Calculating error rates Exercise 13: Bonferroni correction

Wrapping up, we'll address concepts related closely to regression and classification models. The chapter begins by reviewing fundamental machine learning algorithms and quickly ramps up to model evaluation, dealing with special cases, and the bias-variance tradeoff.

Exercise 1: Regression models Exercise 2: Linear regression Exercise 3: Logistic regression Exercise 4: Evaluating models Exercise 5: Regression evaluation Exercise 6: Classification evaluation Exercise 7: Missing data and outliers Exercise 8: Handling null values Exercise 9: Identifying outliers Exercise 10: Bias-variance tradeoff Exercise 11: Test and training error Exercise 12: Visualizing the tradeoff Exercise 13: Wrapping up