At 2:47 AM, a payment service starts retrying charges.
Not because someone wrote a bug. Because someone wrote a retry loop, and the retry loop was correct in every way a code reviewer checks: it had backoff, it had a max attempt count, it had a context timeout, it had a nice comment explaining the exponential backoff strategy. It had test coverage. Two humans approved it in under four minutes with the industry-standard incantation:
LGTM 🚀
By 6 AM, 1,100 customers had been charged twice.
The AI didn't write a bug. The AI wrote correct-looking code for the wrong world — one where HTTP timeouts mean "nothing happened" instead of "I have no idea what happened." And nobody caught it, because catching it required knowing something that wasn't in the diff.
