Configuring a sensor for production
Your pipeline uses a FileSensor to wait for an incoming CSV report before processing it. In the default poke mode, the sensor holds a worker slot the entire time it waits, even when the file takes several minutes to arrive.
For production, a sensor should release the slot between checks and have a safety timeout so it doesn't wait indefinitely.
Este ejercicio forma parte del curso
Building Data Pipelines with Airflow
ejercicio interactivo práctico
Convierte la teoría en práctica con uno de nuestros ejercicios interactivos
Empezar ejercicio