thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Intermediate

Adam

Adaptive Moment Estimation: an optimizer combining momentum with per-parameter adaptive learning rates.

Definition

Adam tracks running averages of gradients and squared gradients to scale each parameter's update. It converges quickly with little tuning and is the default for many deep learning tasks. AdamW decouples weight decay from the gradient update and is standard for transformers.

Exam tip

Adam is the safe default optimizer answer when no specific optimizer is required.

Related terms