You Can't Reproduce What the Vendor Changes Under You
Reproducibility is the floor under every debugging loop. A pattern spreading across AI-agent tooling removes that floor — and doesn't tell you.
Reproducibility is the contract that makes debugging possible: same input, same code, same output. You reproduce a bug, you bisect it, you fix it, you confirm the fix by reproducing its absence. Remove reproducibility and the whole loop becomes guessing. A pattern now common in AI-agent tooling does exactly that.
The mechanism
Modern AI agent tools ship a static-looking client, but not all of the instructions that steer the model live in that client. A chunk of the operating context is fetched from the vendor's servers at runtime, merged into the model's behavioral instructions, and refreshed on a short timer — on the order of once a minute — from a feature-flag service the vendor controls.
