Comece agoraComece grátis

Scheduling on partitioned assets

Now that the upstream emits partitioned daily_sales events, the reporting Dag can react to them automatically, running only for the partition that was just refreshed instead of reprocessing every date. The upstream emits a full timestamp, but the report only cares about the calendar date; normalizing that key is exactly what StartOfDayMapper is for. In this exercise, you'll schedule the downstream report on the partitioned asset and map each event to its day.

The upstream is pre-filled in the file for context, and you'll see both Dags work together in the next exercise.

Este exercicio faz parte do curso

Building Data Pipelines with Airflow

Ver curso

exercicio interativo prático

Transforme teoria em prática com um dos nossos exercicio interativos

Iniciar exercicio