Category: My AI Experiments

There's a mental model most people use when working with AI: describe your problem, get a solution.

It works well enough, until it doesn't. And when it fails, the failure is invisible — because AI doesn't say "I don't have enough to go on." It gives you a confident, well-reasoned, completely wrong answer.

I learned this the hard way during a website security investigation. The AI and I ran a thorough analysis, reached a clear conclusion, and were wrong. Not because the AI was weak — because I gave it the wrong kind of input. When I changed the input, the same AI found the answer in seconds.

That gap — between the input that produces a wrong answer and the input that produces a right one — is what I want to talk about.