Two weeks ago I had zero dollars, one gaming PC with an RTX 3060 Ti, and a stubborn idea: what if the cost of running a small, useful LLM-backed API could be close to zero, if you just... hosted the model yourself?

Here's what I shipped, and the specific things that broke along the way — because the failures were more instructive than the plan.

The idea

A small API that turns plain English into working code artifacts:

/v1/regex — "validate a Brazilian CEP" → a working regex, an explanation, and match/no-match examples