Originally published on Loop & Retry — field notes on building LLM agents that survive production.
Here is the intuition to kill: a failed run is cheap because you can just run it again. A deterministic system earns you that assumption — the bug is sitting there, reproducible on demand, and debugging is a bounded search through code you control. An agent is not that system. When a run fails, the run that failed is gone. What you re-run is a different run that happens to share a prompt, and it may well succeed. The token cost of the failure was never the expensive part. The expensive part is that you have to pay, over and over, to make the failure happen again in front of you.
This post is about that second bill — the cost of reproduction — and why it dominates the cost of the actual fix. It's the cost twin of the measuring-failure-in-production post: that one was about noticing silent failures; this one is about what it costs to understand one once you've noticed it. Together with the $200 postmortem, this is why the cost of a failure often has nothing to do with the failure itself and everything to do with what you do (or don't) to recover from it.
The failed run is a crime scene with no recording
