Defining pipeline execution order
After building your DAG, it's time to define the order of execution for the DAG's tasks.
In the previous exercise, you set up the first task to check the API. All the other tasks from the pipeline are set up for you.
You need to follow the order of tasks from the diagram below.
This exercise is part of the course
Designing Forecasting Pipelines for Production
Exercise instructions
- Set the API check pipeline and check status tasks.
- Set the data validation pipeline tasks.
- Set the forecast pipeline tasks.
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
# Set the API check pipeline tasks
____ >> ____ >> [data_refresh, no_updates]
data_refresh >> [data_validation, data_failure]
# Set the data validation pipeline tasks
data_validation >> check_validation >> [____, ____]
# Set the forecast pipeline tasks
data_valid >> ____ >> ____
print(f"DAG '{dag.dag_id}' ready with {len(dag.tasks)} tasks")