НачатьНачать бесплатно

Scheduling on partitioned assets

Now that the upstream emits partitioned daily_sales events, the reporting Dag can react to them automatically, running only for the partition that was just refreshed instead of reprocessing every date. The upstream emits a full timestamp, but the report only cares about the calendar date; normalizing that key is exactly what StartOfDayMapper is for. In this exercise, you'll schedule the downstream report on the partitioned asset and map each event to its day.

The upstream is pre-filled in the file for context, and you'll see both Dags work together in the next exercise.

Это упражнение является частью курса

Building Data Pipelines with Airflow

Посмотреть курс

Практическое интерактивное упражнение

Превратите теорию в практику с помощью одного из наших интерактивных упражнений

Начать упражнение