Airflow, Luigi and cron
In the video, you saw several tools that can help you with the scheduling of your Spark jobs. You saw the limitations of cron and how it has led to the development of frameworks like Airflow and Luigi.
There's a lot of useful features in Airflow, but can you select the feature from the list below which is also provided by cron?
This exercise is part of the course
Introduction to Data Engineering
Hands-on interactive exercise
Turn theory into action with one of our interactive exercises
Start Exercise