The Most Important AI Agent Design Choice: Don’t Let the Model Be the Final Authority

AI agents are getting very good at doing things.

They can search databases, call APIs, modify tickets, draft code, update records, trigger workflows, and interact with production systems.

And that changes the engineering problem.

When an LLM only generates text, a bad answer is usually just that: a bad answer.

When an LLM can take an action, a bad answer can become a bad state change.