thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

Data & Analytics · Advanced

Adaptive Query Execution (AQE)

A Spark 3 feature that re-optimizes query plans at run time using actual shuffle statistics.

Definition

AQE, enabled by default since Spark 3.2, coalesces small shuffle partitions, converts sort-merge joins to broadcast joins when one side turns out to be small, and splits skewed partitions.

Exam tip

AQE handles skew joins and partition coalescing automatically at run time.

Related terms