Where This Started

A few years ago, I started thinking about a simple question:

How far can we actually push an LLM on a complex software project?

That's already well established. I mean something harder:

Can an LLM take a complex problem, break it into smaller pieces, solve those pieces, test the results, and eventually assemble everything into a working product?