thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Foundational

Batch Inference

Generating predictions for a large dataset offline in a single job rather than per request.

Definition

Batch inference (SageMaker Batch Transform, Vertex AI batch prediction, Bedrock batch inference) is cheaper for non-urgent, high-volume workloads and needs no persistent endpoint.

Exam tip

Large offline datasets with no latency requirement point to batch inference to save cost.

Related terms