thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Advanced

NVIDIA Dynamo

NVIDIA's open-source distributed inference framework for serving reasoning and generative models across many GPUs.

Definition

Dynamo adds disaggregated prefill and decode, KV-cache-aware routing, KV cache offloading and GPU planning on top of engines such as TensorRT-LLM, vLLM and SGLang to maximize throughput in large deployments.

Exam tip

Dynamo targets large multi-node inference with disaggregated serving and KV-aware routing.

Related terms