I received following comment on my hallucinations blog post.
The model basically raised its hand and said "hey, we've been at this a while." That's actually the best-case scenario.
A lot of models won't do that. They'll just silently get worse. Same confident tone, less reliable answers. You won't know it's happening until something is clearly wrong.
You paste a long document in, ask about something in the middle, and you get a confident answer that's wrong. Or you have a twenty-message conversation and the model starts contradicting itself.
Not because it's hallucinating. Because it's running out of room.
