Defining pipeline execution order
After building your DAG, it's time to define the order of execution for the DAG's tasks.
In the previous exercise, you set up the first task to check the API. All the other tasks from the pipeline are set up for you.
You need to follow the order of tasks from the diagram below.
本练习是课程的一部分
Designing Forecasting Pipelines for Production
练习说明
- Set the API check pipeline and check status tasks.
- Set the data validation pipeline tasks.
- Set the forecast pipeline tasks.
交互式实操练习
通过完成这段示例代码来试试这个练习。
# Set the API check pipeline tasks
____ >> ____ >> [data_refresh, no_updates]
data_refresh >> [data_validation, data_failure]
# Set the data validation pipeline tasks
data_validation >> check_validation >> [____, ____]
# Set the forecast pipeline tasks
data_valid >> ____ >> ____
print(f"DAG '{dag.dag_id}' ready with {len(dag.tasks)} tasks")