thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Foundational

Real-Time Inference

Serving predictions synchronously with low latency in response to individual requests.

Definition

Real-time endpoints stay provisioned (or scale) to answer each request in milliseconds to seconds, for interactive apps such as fraud checks or chat. Serverless inference suits intermittent traffic but has cold starts.

Exam tip

Interactive, per-request predictions need real-time endpoints; nightly scoring of millions of rows needs batch.

Related terms