thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Intermediate

Benchmark

A standardized dataset and metric used to compare model capabilities.

Definition

Benchmarks such as MMLU (knowledge), GSM8K (math), HumanEval (code), SWE-bench (software engineering) and GPQA (expert science) allow apples-to-apples comparison. Benchmark contamination, where test items leak into training data, and saturation limit their usefulness, so task-specific evals remain essential.

Exam tip

Public benchmark scores do not guarantee performance on your specific use case.

Related terms