1. 학습
    2. /
  2. 강의
    3. /
  3. Scaling and Optimizing Data Pipelines with Polars
Connected

연습 문제

Processing query results in batches

The team wants to push digital checkout rows to a downstream system in chunks rather than collect one huge DataFrame. Iterate through 5,000-row batches and capture a small summary of each.

A LazyFrame digital_rows with the filtered digital checkouts is preloaded.

지침

100 XP
  • Iterate through digital_rows in batches of 5,000 rows on the streaming engine.