thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Intermediate

Hyperparameter Tuning

Searching for the hyperparameter values that give the best validation performance.

Definition

Tuning strategies include grid search, random search, Bayesian optimization and Hyperband/early-stopping-based methods. Each trial trains a model with a configuration and evaluates it on validation data. Managed services such as SageMaker Automatic Model Tuning, Vertex AI Vizier and Azure ML sweep jobs automate the process.

Exam tip

Bayesian optimization finds good values in fewer trials than grid search; random search beats grid search in high dimensions.

Related terms