Agentic AI Testing / Quiz
Testing the RAG Pipeline
Chunking, embeddings, retrieval, reranking, generation, test each stage of a RAG system where the bug could be hiding anywhere.
- Difficulty
- Medium
- Format
- Quiz
- Points
- 150
- Estimate
- 9 min
// MISSION BRIEF
Your Mission
A RAG pipeline has five failure surfaces: chunking, embedding, retrieval, reranking, and generation. A bad answer could originate in any of them, and the fix is different for each.
This quiz drills stage-by-stage diagnosis, the skill that separates "the AI is dumb" from "the chunk size is wrong".
// FIRST CONTACT
Battle teaser
Answers are missing details that ARE in the source docs. Retrieval returns chunks that cut sentences mid-thought. The likely culprit:
- AChunking strategy, chunk size/overlap splits coherent ideas across boundaries
- BThe user is asking bad questions
- CThe LLM's temperature is too high
- DThe system prompt is too short
Answers, scoring, hints, and the full battle stay sealed.
// SKILL TAGS
ragretrievalrerankingchunking