Mulai sekarangMulai gratis

When to use a broadcast join

Now that you know shuffle is the bottleneck, your team at Global Retail Analytics wants to fix a slow query. It joins a sales_transactions table (50 million rows) with a product_categories table (2,000 rows) using a standard left join, and it runs for over ten minutes. You suggest switching to a broadcast join using F.broadcast().

Why would a broadcast join speed up this query?

Latihan ini merupakan bagian dari kursus

Data Transformation with Spark SQL in Databricks

Lihat Kursus

Latihan interaktif langsung

Ubah teori menjadi aksi dengan salah satu latihan interaktif kami

Mulai latihan