thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Foundational

Model Serving

Hosting a trained model behind an interface so applications can request predictions.

Definition

Serving options include real-time endpoints, serverless inference, asynchronous inference, batch jobs and edge deployment. Choices balance latency, throughput, cost and scaling behavior.

Exam tip

Choose the serving option by latency needs and traffic pattern: real-time, serverless, async or batch.

Related terms