Returning data from a TaskFlow function
Your team stores pipeline configuration in a separate task so it can be reused across downstream steps. Centralizing config this way is common in production: one task defines the settings, and every other task reads the same values instead of hardcoding them. The get_config task already returns the config dictionary, and run_pipeline is ready to use it.
This exercise is part of the course
Building Data Pipelines with Airflow
Hands-on interactive exercise
Turn theory into action with one of our interactive exercises
Start Exercise