Home
Storia in 1 fonti
Evaluating Agents With an LLM-as-Judge Harness (Without Kidding Yourself About It)
Key Takeaways You can't unit-test a coach agent the way you test a pure function — the output is...
Raccontata da
dev.to
Timeline cronologica
- ·
LLM-as-a-Judge: I Built One From Scratch, Then Checked It Against Humans
Part 2 of an eval series. A 15-line LLM judge, scored against real Chatbot Arena human votes. It agreed with people on just 43% of pairs, tied a third of them, parked every score…
- ·
Evaluating Agents With an LLM-as-Judge Harness (Without Kidding Yourself About It)
Key Takeaways You can't unit-test a coach agent the way you test a pure function — the output is...
- ·
A RAG evaluator that admits what it can't judge
Fail-closed groundedness, deterministic corroborators, and a self-test — because an evaluator should...