One of the most expensive debugging mistakes in AI systems is assuming the model is the problem.

A user receives a bad answer.

The response looks wrong.

The immediate reaction is usually:

"The model hallucinated."