EmpezarEmpieza gratis

Watching partitioned assets trigger a downstream Dag

The upstream sales_pipeline_v3 and downstream sales_report Dags from the previous exercise are deployed and ready to run. The sales pipeline runs every minute and emits a partitioned daily_sales event on every run, while the report only cares about the date; that's exactly what StartOfDayMapper is for. Time to watch them work together.

Follow these steps in order:

  1. In the Dags view, activate sales_report first so it is ready to react when the asset event arrives.
  2. Then activate sales_pipeline_v3; it runs every minute and emits a partitioned daily_sales event on each run.
  3. Wait about a minute for sales_pipeline_v3 to complete — sales_report then triggers automatically from the asset event.
  4. Open sales_report, go to the Runs tab, open the latest run, and find the Mapped Partition key at the top of the run details.

What is the date format of Mapped Partition key?

Este ejercicio forma parte del curso

Building Data Pipelines with Airflow

Ver curso

ejercicio interactivo práctico

Convierte la teoría en práctica con uno de nuestros ejercicios interactivos

Empezar ejercicio