thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Foundational

Inference Parameters

Settings supplied at request time that shape model output, such as temperature, top-p, max tokens and stop sequences.

Definition

Inference parameters change generation behavior without modifying model weights. They are exposed in APIs such as Amazon Bedrock, Microsoft Foundry, Vertex AI and the Claude API.

Exam tip

Tuning inference parameters is cheaper than fine-tuning; try it first.

Related terms