A few months ago I was demoing my RAG-powered support bot to a colleague, feeling pretty confident about it.

Then it confidently told her our refund policy was “30 days, no questions asked.”

Our actual policy is 14 days, with conditions.

The bot didn’t hedge. It didn’t say “I’m not sure.” It just made it up and said it with the same calm tone it uses for everything else.

That demo stung.