thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Intermediate

Streaming

Returning a model's output incrementally as tokens are generated instead of waiting for the full response.

Definition

Streaming, often via server-sent events, lowers perceived latency for chat interfaces because the user sees text immediately. Total generation time is unchanged.

Exam tip

Streaming improves perceived latency (time to first token), not total throughput.

Related terms