Scheduling tools
The last piece of the puzzle is the scheduler. In this example, Apache Airflow is used. You could see the scheduler as the glue of a data engineering system, holding each small piece together and organizing how they work together.
Do you know which one is not a responsibility of the scheduler?
This exercise is part of the course
Introduction to Data Engineering
Hands-on interactive exercise
Turn theory into action with one of our interactive exercises
Start Exercise