AI for QA / Scenario
Triage the Jira RAG Pipeline
Use controlled experiments to isolate which stage of the retrieval pipeline failed.
- Difficulty
- Hard
- Format
- Scenario
- Points
- 200
- Estimate
- 20 min
// MISSION BRIEF
Your Mission
A Jira-to-test-case workflow produces irrelevant cases for a billing ticket. Follow the ticket metadata through the vector query, index inventory, and model prompt. Identify each failing stage and choose experiments that isolate it.
// FIRST CONTACT
Battle teaser
First artifact
n8n vector-query mapping
What is the first demonstrated cause of the irrelevant cases?
- AA score below 1.0 is always an index error
- BThe hard-coded PAY metadata filter excludes the BILL project's evidence
- CThe LLM cannot generate any test case from retrieved context
- DtopK 3 guarantees an empty result
Answers, scoring, hints, and the full battle stay sealed.
// SKILL TAGS
workflow-testingn8nragjiraai-for-qa