AI for QA / Scenario
Code-Review the AI's Test Suite
An AI submitted a passing test file in a PR. It is green for the wrong reasons. Review it like a gatekeeper.
- Difficulty
- Hard
- Format
- Scenario
- Points
- 200
- Estimate
- 15 min
// MISSION BRIEF
Your Mission
A PR adds an AI-written test file. It passes CI. Your job on review is to decide whether these tests would actually catch a regression, or whether they are green theater. Read for tautologies, over-mocking, and assertions that never fail.
// FIRST CONTACT
Battle teaser
First artifact
AI-written test file (passes CI)
Test 1 ('applies 10% discount') is defective because:
- AIt uses the wrong percentage
- BIt is actually fine
- CtoBe(90) is the wrong matcher
- DIt defines a local fake applyDiscount and tests the fake, never importing the real discountService, so it cannot catch a bug in production code
Answers, scoring, hints, and the full battle stay sealed.
// SKILL TAGS
ai-workflowscode-reviewtest-qualityscenarioai-for-qa