This is a submission for DEV's Summer Bug Smash: Smash Stories powered by Sentry.

My first eval scoreboard said both engines failed almost every case. Local llama3.2: 5 out of 6 malformed. Anthropic Sonnet: 6 out of 6 malformed.

When I opened the raw records, three different failures were hiding under the same word — malformed:

An API error (credits exhausted) that never reached the model.

Terminal control bytes from the Ollama CLI corrupting captured output.