thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Intermediate

Decoding Strategy

The method used to choose each next token from the model's probability distribution.

Definition

Strategies include greedy decoding, beam search and sampling controlled by temperature, top-k and top-p. Deterministic strategies favor consistency; sampling favors diversity and creativity.

Exam tip

Deterministic decoding suits extraction and classification; sampling suits creative generation.

Related terms