An LLM can generate an answer.

But an AI Agent needs to do something beyond generating text.

The important distinction is the layer around the model:

LLM → Instructions → Tools → State/Memory → Permissions → Control Loop

For example, imagine an agent that needs to retrieve the current weather.