Inizia subitoInizia gratis

Scheduling on partitioned assets

Now that the upstream emits partitioned daily_sales events, the reporting Dag can react to them automatically, running only for the partition that was just refreshed instead of reprocessing every date. The upstream emits a full timestamp, but the report only cares about the calendar date; normalizing that key is exactly what StartOfDayMapper is for. In this exercise, you'll schedule the downstream report on the partitioned asset and map each event to its day.

The upstream is pre-filled in the file for context, and you'll see both Dags work together in the next exercise.

Questo esercizio fa parte del corso

Building Data Pipelines with Airflow

Visualizza corso

esercizio interattivo pratico

Trasforma la teoria in pratica con uno dei nostri esercizi interattivi

Inizia esercizio