thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Intermediate

Batch Normalization

Normalizing each layer's inputs across the mini-batch to stabilize and speed up training.

Definition

Batch norm standardizes activations using the batch mean and variance, then applies learned scale and shift. It permits higher learning rates and is common in CNNs. It behaves differently in training and inference and depends on batch size.

Exam tip

Batch normalization depends on batch statistics, which is why transformers use layer normalization instead.

Related terms