Complex Aggregations
To get you familiar with more of the built in aggregation methods, let's do a slightly more complex aggregation! The goal is to merge all these commands into a single line.
Remember, a SparkSession called spark is already in your workspace, along the Spark DataFrame salaries_df.
Este ejercicio forma parte del curso
Introduction to PySpark
Instrucciones del ejercicio
- Calculate the average salaries of large US companies using the
"salary_in_usd"column. - Calculate the total salaries of large US companies.
Ejercicio interactivo práctico
Prueba este ejercicio y completa el código de muestra.
# Average salaries at large us companies
large_companies=salaries_df.filter(salaries_df.company_size == "L").filter(salaries_df.company_location == "US").groupBy().____
#set a large companies variable for other analytics
large_companies=salaries_df.filter(salaries_df.company_size == "L").filter(salaries_df.company_location == "US")
# Total salaries in usd
large_companies.groupBy().____.show()