thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

Data & Analytics · Advanced

Wide Transformation

A Spark transformation in which output partitions depend on data from many input partitions, requiring a shuffle.

Definition

Wide transformations such as groupBy, join, distinct and repartition create stage boundaries and are the most expensive operations.

Exam tip

Stage boundaries occur at wide transformations.

Related terms