Parameterizing SQL and extracting it into files
Inline SQL strings get unwieldy fast and can't be reviewed by your data team. Your team has extracted the aggregation into include/sql/aggregate_sales.sql so it lives next to the rest of the project. Make the query date-aware so each run processes a single day, then point the pipeline at the file. Use /home/repl/workspace/include/sql as the SQL folder path.
This exercise is part of the course
Building Data Pipelines with Airflow
Hands-on interactive exercise
Turn theory into action with one of our interactive exercises
Start Exercise