Defining pipeline execution order
After building your DAG, it's time to define the order of execution for the DAG's tasks.
In the previous exercise, you set up the first task to check the API. All the other tasks from the pipeline are set up for you.
You need to follow the order of tasks from the diagram below.
Deze oefening maakt deel uit van de cursus
Designing Forecasting Pipelines for Production
Oefeninstructies
- Set the API check pipeline and check status tasks.
- Set the data validation pipeline tasks.
- Set the forecast pipeline tasks.
Praktische interactieve oefening
Probeer deze oefening eens door deze voorbeeldcode in te vullen.
# Set the API check pipeline tasks
____ >> ____ >> [data_refresh, no_updates]
data_refresh >> [data_validation, data_failure]
# Set the data validation pipeline tasks
data_validation >> check_validation >> [____, ____]
# Set the forecast pipeline tasks
data_valid >> ____ >> ____
print(f"DAG '{dag.dag_id}' ready with {len(dag.tasks)} tasks")