Understanding XCom limitations
A colleague on your team has a pipeline where one task produces a 5 GB Parquet file that a downstream task needs to process. They ask you for advice on the best way to pass this data between the tasks using XCom.
What is the recommended approach?
This exercise is part of the course
Building Data Pipelines with Airflow
Hands-on interactive exercise
Turn theory into action with one of our interactive exercises
Start Exercise