Adding column-level quality checks
A pipeline that loads bad data on schedule is worse than one that fails loudly. Before downstream teams consume daily_summary, you'll add a column-level quality gate that runs right after the load and rejects the run if revenue dips below zero or order counts go missing.
The load task and SQL file are pre-filled from previous lessons.
Deze oefening maakt deel uit van de cursus
Building Data Pipelines with Airflow
Interactieve oefening met praktijkervaring
Zet theorie om in actie met een van onze interactieve oefeningen
Begin oefening