Comparer la RMSE de deux modèles

Comme vous l’avez fait avec la somme des résidus au carré et le \(R^2\), évaluons et comparons à nouveau la qualité de vos deux modèles à l’aide de la root mean squared error (RMSE). Notez que la RMSE est plus souvent utilisée en contexte de prédiction que d’explication.

model_price_2 et model_price_4 sont disponibles dans votre espace de travail.

Cet exercice fait partie du cours

<cours>Modéliser des données avec le Tidyverse</cours>

Exercice interactif pratique

Essayez cet exercice en complétant ce code d’exemple.

# MSE and RMSE for model_price_2
get_regression_points(model_price_2) %>%
  mutate(sq_residuals = residual^2) %>%
  summarize(mse = mean(sq_residuals), rmse = sqrt(mean(sq_residuals)))

# MSE and RMSE for model_price_4
___

Modifier et exécuter le code

Cet exercice fait partie du cours

<cours>Modéliser des données avec le Tidyverse</cours>

IntermédiaireNiveau de compétence

4.9+

Commencer le cours gratuitement

This chapter will introduce you to some background theory and terminology for modeling, in particular, the general modeling framework, the difference between modeling for explanation and modeling for prediction, and the modeling problem. Furthermore, you'll start performing your first exploratory data analysis, a crucial first step before any formal modeling.

Exercise 1: Background on modeling for explanation Exercise 2: Exploratory visualization of age Exercise 3: Numerical summaries of age Exercise 4: Background on modeling for prediction Exercise 5: Exploratory visualization of house size Exercise 6: Log10 transformation of house size Exercise 7: The modeling problem for explanation Exercise 8: EDA of relationship of teaching & "beauty" scores Exercise 9: Correlation between teaching and "beauty" scores Exercise 10: The modeling problem for prediction Exercise 11: EDA of relationship of house price and waterfront Exercise 12: Predicting house price with waterfront

Equipped with your understanding of the general modeling framework, in this chapter, we'll cover basic linear regression where you'll keep things simple and model the outcome variable y as a function of a single explanatory/ predictor variable x. We'll use both numerical and categorical x variables. The outcome variable of interest in this chapter will be teaching evaluation scores of instructors at the University of Texas, Austin.

Exercise 1: Explaining teaching score with age Exercise 2: Plotting a "best-fitting" regression line Exercise 3: Fitting a regression with a numerical x Exercise 4: Predicting teaching score using age Exercise 5: Making predictions using "beauty score"Exercise 6: Computing fitted/predicted values & residuals Exercise 7: Explaining teaching score with gender Exercise 8: EDA of relationship of score and rank Exercise 9: Fitting a regression with a categorical x Exercise 10: Predicting teaching score using gender Exercise 11: Making predictions using rank Exercise 12: Visualizing the distribution of residuals

In the previous chapter, you learned about basic regression using either a single numerical or a categorical predictor. But why limit ourselves to using only one variable to inform your explanations/predictions? You will now extend basic regression to multiple regression, which allows for incorporation of more than one explanatory or one predictor variable in your models. You'll be modeling house prices using a dataset of houses in the Seattle, WA metropolitan area.

Exercise 1: Explaining house price with year & size Exercise 2: EDA of relationship Exercise 3: Fitting a regression Exercise 4: Predicting house price using year & size Exercise 5: Making predictions using size and bedrooms Exercise 6: Interpreting residuals Exercise 7: Explaining house price with size & condition Exercise 8: Parallel slopes model Exercise 9: Interpreting the parallel slopes model Exercise 10: Predicting house price using size & condition Exercise 11: Making predictions using size and waterfront Exercise 12: Automating predictions on "new" houses

In the previous chapters, you fit various models to explain or predict an outcome variable of interest. However, how do we know which models to choose? Model assessment measures allow you to assess how well an explanatory model "fits" a set of data or how accurate a predictive model is. Based on these measures, you'll learn about criteria for determining which models are "best".

Exercise 1: Évaluation et sélection de modèles Exercise 2: Rappel : somme des résidus au carré Exercise 3: Quel modèle sélectionner ?Exercise 4: Évaluer l’ajustement du modèle avec R‑carré Exercise 5: Calculer le R-carré d’un modèle Exercise 6: Comparer les R-carré de deux modèles Exercise 7: Évaluer les prédictions avec la RMSE Exercise 8: Calculer la MSE et la RMSE d’un modèle Exercise 9: Comparer la RMSE de deux modèles

Exercice actuel

Exercise 10: Cadre de prédiction avec ensemble de validation Exercise 11: Ajuster un modèle aux données d’entraînement Exercise 12: Prédire sur les données de test Exercise 13: Conclusion - Où aller à partir d’ici ?