Subdomain 1.1: Context failure diagnosis
1.A retrieval step returns three chunks: one relevant passage about a product's warranty policy and two unrelated chunks about a different product line that happened to match on shared keywords. The agent's final answer paraphrases details from one of the unrelated chunks instead of the relevant warranty passage. Which failure mode best explains this behavior?
- A.Context confusion
- B.Context poisoning
- C.Context distraction
- D.Context clash
Show answer & explanation
Correct answer: A — Context confusion
- A. Correct. Irrelevant content (the unrelated product chunks) was present in the context and ended up being used to generate the response instead of the relevant passage — this is context confusion, where superfluous content degrades output quality.
- B. Incorrect. Context poisoning requires a hallucinated or erroneous fact to be introduced and then repeatedly relied on; here the unrelated chunks are real content, just irrelevant to the question.
- C. Incorrect. Context distraction is about over-weighting a large volume of prior actions/history, not about a small number of irrelevant retrieved documents being misused.
- D. Incorrect. Context clash requires two contradictory statements both present in context; the unrelated chunks do not contradict the warranty passage, they are simply off-topic.