This is a submission for DEV's Summer Bug Smash: Smash Stories powered by Sentry.
I maintain a small CLI called llm-council. It puts one question to several models, hides the authorship, and has them rank each other's answers. I use it as an adversarial reviewer on my own work — the whole point is to get disagreement from something that has no reason to be polite to me.
On 26 July I pointed it at its own repository.
It found a prompt-injection hole in its own prompts. That was mildly embarrassing. What actually kept me up was the second finding: I had already written a test for exactly that hole, and the test was green.
The thing being defended
