I trained a model that scored 4 percentage points better than the one I ship. It's gone. I deleted it...
I trained a model that scored 4 percentage points better than the one I ship. It's gone. I
deleted it from the roadmap yesterday.
That's not the interesting part. The interesting part is how I found out it was broken — because
it passed every check I had, and then shipped a file that answered neutral to every question you
could ask it.
Repo: github.com/AmmarHassona/trainsafe I was working on fine-tuning an open-source small language...
This is a submission for DEV's Summer Bug Smash: Smash Stories powered by Sentry. My first eval...
A different-vendor LLM audited ten queued blog posts written by my main model and caught three copy-paste-breaking macOS/Linux…
Every time a new model ships, I face the same question for spectr-ai: does my contract auditor get...
Everyone ships the RAG system. Almost nobody ships the eval system that tells them when the RAG...
A frontier model scored 0.241 on my hardened benchmark, the same as five small local models. That was not about the models. It…
