Home
Storia in 1 fonti
I made my agent more capable and it got worse
An ARC Prize 2026 builder's log entry. I taught my agent to solve more kinds of games and the leaderboard score fell from 0.09 to 0.04. The capability was real. The cost of using it was the problem. More powerful is not better.
Raccontata da
dev.to
Timeline cronologica
- ·
I looked unbeatable in practice and lost the real fight
An ARC Prize 2026 builder's log entry. A change that gained on my home bench lost three times as much on the real, hidden leaderboard, and my own tooling couldn't even reproduce…
- ·
I made my agent more capable and it got worse
An ARC Prize 2026 builder's log entry. I taught my agent to solve more kinds of games and the leaderboard score fell from 0.09 to 0.04. The capability was real. The cost of using…