thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Intermediate

NVIDIA NIM

NVIDIA Inference Microservices: prebuilt, optimized containers that serve AI models through industry-standard APIs.

Definition

Each NIM packages a model with an optimized engine (such as TensorRT-LLM, vLLM or SGLang) and exposes OpenAI-compatible endpoints, deployable on any NVIDIA GPU infrastructure in cloud, data center or workstation. NIMs cover LLMs, embeddings, reranking, speech, vision and safety models.

Example

docker run --gpus all -p 8000:8000 nvcr.io/nim/meta/llama-3.1-8b-instruct

Exam tip

NIM is about fast, standardized deployment of inference; NeMo is about building and customizing models.

Related terms