thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

AI & Machine Learning · Advanced

RAG Evaluation

Measuring a RAG system's retrieval quality and answer quality, typically with faithfulness, relevance and context metrics.

Definition

Frameworks such as Ragas, Bedrock knowledge base evaluations, Mosaic AI Agent Evaluation and NVIDIA NeMo Evaluator compute metrics over test sets. Evaluation should cover both the retriever (hit rate, recall, MRR) and the generator (groundedness, correctness).

Exam tip

Evaluate retrieval and generation separately to find whether failures come from the retriever or the model.

Related terms