thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Advanced

SHARP

Scalable Hierarchical Aggregation and Reduction Protocol: NVIDIA in-network computing that performs collectives inside switches.

Definition

SHARP offloads reductions such as all-reduce to InfiniBand (and NVLink Switch) hardware, reducing data movement and latency for distributed training.

Exam tip

SHARP performs reductions in the switch, cutting all-reduce traffic and latency.

Related terms