LoslegenKostenlos starten

Processing multiple endpoints with expand

Your team pulls data from multiple API endpoints that change over time, and hardcoding a separate task for each one means editing the Dag every time an endpoint is added or removed. In this exercise, you'll turn that rigid pipeline into a data-driven one: with expand(), Airflow reads the list of endpoints at runtime and spins up one task instance per item, so the pipeline automatically adjusts as the number of endpoints changes.

Diese Übung ist Teil des Kurses

<Kurs>Building Data Pipelines with Airflow</Kurs>
Kurs ansehen

Interaktive praktische Übung

Verwandle Theorie mit einer unserer interaktiven Übungen in die Praxis

Übung starten