Diagnose context failures

processopen source

Check long-context failures by type: poisoning, distraction, confusion and clash.

Drew Breunig's four failure modes give evals a vocabulary: an error that keeps getting referenced (poisoning), over-long context (distraction), superfluous content (confusion) and conflicting content (clash).

Signals

No signals collected yet.

How it stacks up

Diagnose context failures next to similar tools, using only numbers both have. Bigger isn't always better: read each number's meaning first.

No fair match yet: no similar tool shares at least two of Diagnose context failures's numbers. We only compare like-for-like numbers.

Relationship map