Why LLM agents are so hard to reproduce, why some of that nondeterminism is a feature you should not remove, and how record and replay gets you the one thing you actually need.