Targeting the streaming engine
You're back with the Seattle library team. Their checkout history is growing, and queries are starting to flirt with memory limits. The simplest fix is to run lazy queries on Polars' streaming engine instead of the default in-memory one.
polars is loaded as pl. The LazyFrame monthly_digital is pre-loaded and totals digital checkouts by month.
Deze oefening maakt deel uit van de cursus
Scaling and Optimizing Data Pipelines with Polars
Oefeninstructies
- Run
monthly_digitalusing the streaming engine.
Interactieve oefening met praktijkervaring
Probeer deze oefening door deze voorbeeldcode aan te vullen.
# Run the query on the streaming engine
result = monthly_digital.collect(____="____")
print(result)