AI & LLM Evals / Quiz

RAG Retrieval Quality Metrics

Before you blame the LLM, measure the retriever. precision@k, recall@k, MRR, NDCG: the numbers that tell you whether the evidence ever arrived.

Difficulty
Easy
Format
Quiz
Points
100
Estimate
9 min

// MISSION BRIEF

Your Mission

In RAG, a bad answer often means a bad retrieval. But "bad retrieval" has to be measured. This quiz covers the ranking metrics that quantify whether the right chunks were fetched, and fetched high enough.

Scoring: equal weight per question.

// FIRST CONTACT

Battle teaser

precision@k measures:

  1. AOf the top-k retrieved chunks, what fraction are actually relevant
  2. BHow fast retrieval ran
  3. CWhether all relevant chunks were retrieved
  4. DThe number of tokens retrieved
Answers, scoring, hints, and the full battle stay sealed.

// SKILL TAGS

ai-evalsragretrieval-metricsndcgmrr