Coding agents pass tests but fail code review. Repository-level benchmarks measure test passage but ignore review acceptance criteria. This is the blind spot in every benchmark from SWE-bench onward.
SWE-Gate is a new benchmark that measures both. It derives review constraints from real pull request comments, synthesizes repair tasks around those constraints, and scores agents on two gates: does the patch pass tests, and does it satisfy the review rules that would block merge in production?
The results are sobering. Among 644 agent-generated patches that passed functional tests, 221 failed review constraints. That's a 34% false-positive rate if you only measure test passage.
The Problem with Functional-Only Evaluation
Repository-level benchmarks like SWE-bench measure whether an agent can resolve a GitHub issue by generating a patch that passes the existing test suite. This is a useful proxy for capability, but it ignores the second gate every production patch must clear: human review.
