A Tiny LLM Request Recorder I Use to Reproduce Production Failures

Most LLM failures are easy to describe and surprisingly hard to reproduce. A user reports that the...

venerdì 17 luglio 2026 New tab

1,216 words~6 min read

Most LLM failures are easy to describe and surprisingly hard to reproduce.

A user reports that the model returned an empty answer. A tool call disappeared halfway through a stream. One provider rejected a request that worked everywhere else.

Then I open the logs and find something like this:

LLM request failed: 400 Bad Request

Enter fullscreen mode

A Tiny LLM Request Recorder I Use to Reproduce Production Failures

A Tiny LLM Request Recorder I Use to Reproduce Production Failures

Related reading

Why your LLM tool calls silently break — and a ~10µs fix

My LLM API Calls Were Failing Silently. Here's the Logging Setup I Wish I Had…

Your Agent Failed in Prod. Good Luck Reproducing It.

Structured Outputs: How We Stopped Parsing LLM Responses by Hand

Stop Treating LLM API Errors Like Normal HTTP Errors

LLM observability tools are blind to the voice layer. Here is what I checked 6…

Related reading

Why your LLM tool calls silently break — and a ~10µs fix

My LLM API Calls Were Failing Silently. Here's the Logging Setup I Wish I Had…

Your Agent Failed in Prod. Good Luck Reproducing It.

Structured Outputs: How We Stopped Parsing LLM Responses by Hand

Stop Treating LLM API Errors Like Normal HTTP Errors

LLM observability tools are blind to the voice layer. Here is what I checked 6…