Comece agoraComece grátis

Configuring a sensor for production

Your pipeline uses a FileSensor to wait for an incoming CSV report before processing it. In the default poke mode, the sensor holds a worker slot the entire time it waits, even when the file takes several minutes to arrive.

For production, a sensor should release the slot between checks and have a safety timeout so it doesn't wait indefinitely.

Este exercicio faz parte do curso

Building Data Pipelines with Airflow

Ver curso

exercicio interativo prático

Transforme teoria em prática com um dos nossos exercicio interativos

Iniciar exercicio