CommencerCommencez gratuitement

Configuring a sensor for production

Your pipeline uses a FileSensor to wait for an incoming CSV report before processing it. In the default poke mode, the sensor holds a worker slot the entire time it waits, even when the file takes several minutes to arrive.

For production, a sensor should release the slot between checks and have a safety timeout so it doesn't wait indefinitely.

Cet exercice fait partie du cours

<cours>Building Data Pipelines with Airflow</cours>
Voir le cours

Exercice interactif pratique

Transformez la théorie en action avec l’un de nos exercices interactifs

Commencer l’exercice