thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Advanced

Transformer Engine

NVIDIA hardware and software that dynamically manages FP8/FP4 precision to accelerate transformer models.

Definition

Introduced with Hopper, Transformer Engine chooses per-layer precision and scaling factors to keep accuracy while using lower-precision Tensor Core math. Blackwell's second-generation version adds FP4 support.

Exam tip

Transformer Engine is what enables FP8 training on Hopper and FP4 inference on Blackwell.

Related terms