Coding agents are trained against a snapshot of the world. So when you ask one to wire up an LLM call, it reaches for whatever model string was current at its training cutoff — and writes something like gpt-4-vision-preview into your code without checking whether it still exists, or will exist in 2 months.
The code compiles, tests pass, CI is green. Then one morning the provider retires that model, and your production calls start returning errors.
I kept falling into that gap, so I built a tool for it.
The moment that made me write it
Last week I ran it across my own repos. It found claude-sonnet-4-20250514 in three of my live apps — days before Anthropic retires that model on June 15. Nothing in my dependency tooling had flagged it, because a model ID isn't a dependency. I'd have shipped straight into the outage.
