Scheduling on partitioned assets
Now that the upstream emits partitioned daily_sales events, the reporting Dag can react to them automatically, running only for the partition that was just refreshed instead of reprocessing every date. The upstream emits a full timestamp, but the report only cares about the calendar date; normalizing that key is exactly what StartOfDayMapper is for. In this exercise, you'll schedule the downstream report on the partitioned asset and map each event to its day.
The upstream is pre-filled in the file for context, and you'll see both Dags work together in the next exercise.
Deze oefening maakt deel uit van de cursus
Building Data Pipelines with Airflow
Interactieve oefening met praktijkervaring
Zet theorie om in actie met een van onze interactieve oefeningen
Begin oefening