Author(s): Mikhail Shytsko

Originally published on Towards AI.

Your coding agent builds the whole app and gets the suite passing in an afternoon. But those tests ran against a handful of placeholder rows, or nothing at all, so the bugs that only show up against real data walked straight through.

Photo by Sunder Muthukumaran on Unsplash

Last month I handed a coding agent a one-line brief and let it run. It wrote the migrations and wired the routes on top of them, and by the time it stopped, pnpm dev came up clean and the test suite was green on the first try, then I clicked around a build that rendered every page perfectly and had nothing on any of them. The dashboard reported zeros across the board, the orders table held no orders, and the "recent activity" feed was a blank rectangle where the demo was supposed to live.