TL;DR — I gave a team of AI coding agents a real kanban board (Kanboard) and a real git server (Gitea), wired together by an MCP orchestrator (Marcus), and had them build a content management system one ticket at a time. I didn't write code. What I did do was read every diff before it merged and catch the decisions that mattered — a weak session store, a permission check that wasn't actually checking permissions, an XSS hole in comment rendering — while each ticket was still open. That's the whole point: the board turns "audit the black box after launch" into "steer the build while it's happening."

The thing that actually changes when agents write the code

Everyone's excited that an AI agent can take a ticket and produce a working feature. Fewer people talk about what you lose in that trade: visibility. A finished app that an agent built is a black box. It runs, the happy path works, and the hundred small decisions that determine whether it's secure, fast, and correct are buried in a diff nobody read.

The ticket said "add user login." It didn't say which password hash, whether the session cookie is HttpOnly, whether sessions survive a restart, or whether the "publish" button checks your role or just that you're logged in. The agent decided all of that — silently — and unless you look, you find out in production.