Cleaning the online retail dataset
You're a data engineer at Global Retail Analytics. Your manager has flagged quality issues in the online_retail dataset - missing customer IDs, duplicated rows, and cancelled orders are skewing weekly reports.
Before any analysis can begin, you need to define an explicit schema, diagnose the data quality problems, and build a cleaning pipeline that removes invalid records.
Este exercício faz parte do curso
Data Transformation with Spark SQL in Databricks
Exercício interativo prático
Transforme a teoria em ação com um de nossos exercícios interativos
Começar o exercício