Agentic AI Testing / Quiz
Testing Long-Term Agent Memory
Your agent now 'remembers users'. That is a datastore with an LLM for a keyboard, and it needs write, update, recall, isolation, and delete tests.
- Difficulty
- Medium
- Format
- Quiz
- Points
- 150
- Estimate
- 10 min
// MISSION BRIEF
Your Mission
Persistent memory turns an agent into a stateful product feature: it extracts facts, stores them across sessions, and recalls them later. Every verb in that sentence fails in its own way. This quiz builds the test matrix for memory as a FEATURE, not just a context window.
Scoring: equal weight per question.
// FIRST CONTACT
Battle teaser
A user said 'I switched to a vegetarian diet' last month. Today the agent recommends a chicken recipe 'because you loved it before'. The failure:
- AThe model's vocabulary is too small
- BStale memory won: the update never superseded the old preference. Preference-change flows need explicit tests (old fact must stop surfacing)
- CRecipes cannot be personalized
- DThe user changed their mind too often
Answers, scoring, hints, and the full battle stay sealed.
// SKILL TAGS
agenticmemoryisolationdata-hygiene