Using Visualizations: lmplot
Creating linear model plots helps us visualize if variables have relationships with the dependent variable. If they do they are good candidates to include in our analysis. If they don't it doesn't mean that we should throw them out, it means we may have to process or wrangle them before they can be used.
seaborn is available in your workspace with the customary alias sns.
Deze oefening maakt deel uit van de cursus
Feature Engineering with PySpark
Oefeninstructies
- Using the loaded data set
dffilter it down to the columns 'SALESCLOSEPRICE' and 'LIVINGAREA' withselect(). - Sample 50% of the dataframe with
sample()making sure to not use replacement and setting the random seed to 42. - Convert the Spark DataFrame to a
pandas.DataFrame()withtoPandas(). - Using 'SALESCLOSEPRICE' as your dependent variable and 'LIVINGAREA' as your independent, plot a linear model plot using seaborn
lmplot().
Praktische interactieve oefening
Probeer deze oefening eens door deze voorbeeldcode in te vullen.
# Select a the relevant columns and sample
sample_df = df.____([____, ____]).____(____, ____, ____)
# Convert to pandas dataframe
pandas_df = sample_df.____()
# Linear model plot of pandas_df
sns.____(x=____, y=____, data=____)
plt.show()