Storia in 1 fonti

Passing the Eval Isn't Solving the Task: 3 Leaks, 60 Lines

A 60-line static probe found 3 contamination points in an agent eval harness, exit 1, without running the agent. Passing the eval is not solving the task.

Raccontata da

dev.to

Timeline cronologica

venerdì 26 giugno 2026·dev.to
Passing the Eval Isn't Solving the Task: 3 Leaks, 60 Lines
A 60-line static probe found 3 contamination points in an agent eval harness, exit 1, without running the agent. Passing the eval is not solving the task.