AI & LLM Evals / Repair Lab
AI Quality Command Center
Repair an AI quality program across DeepEval, RAGAS, LangChain trajectories, LangGraph state, Langflow runs, datasets, and CI gates.
- Difficulty
- Boss
- Format
- Repair Lab
- Points
- 300
- Estimate
- 45 min
// MISSION BRIEF
Mission
Orbit Assist answers employee policy questions through a Langflow RAG pipeline and a LangChain/LangGraph action agent. The current checks compare one output string and average every result into a reassuring green number. Build a quality system that can localize retrieval, generation, tool, trajectory, and release regressions.
// FIRST CONTACT
Battle teaser
Four repairs from one grounded LLM case to a versioned, slice-aware AI release command center.
Answers, scoring, hints, and the full battle stay sealed.
// SKILL TAGS
deepevalragaslangchainlanggraphlangflowllm-evalsrag-evaluationciinterview-lab