TL;DR Last week I benchmarked 5 open-weight models (Llama 4 Scout, Llama 3.3 70B, Qwen3...
TL;DR
Last week I benchmarked 5 open-weight models (Llama 4 Scout, Llama 3.3 70B, Qwen3 32B, GPT-OSS, Gemini 2.5 Flash) and the best scored 62.5%. People asked the obvious follow-up: does the closed-frontier story look better?
Short answer: yes, but with a twist that surprised me.
I ran the same harness against 5 frontier closed models accessed via OpenRouter:
Rank
Comparing Gemini 3.5 Flash, Claude Haiku 4.5, and GPT-4o mini with migration code and honest tradeoffs from production use.
Anthropic shipped Claude Opus 4.8 today. The benchmark numbers went up, as they always do. But that's...
This is a submission for the Gemma 4 Challenge: Write About Gemma 4 Google released four Gemma 4...
OpenAI just made history by open-sourcing their first language models in over six years. The gpt-oss series includes two…
This is a submission for the Gemma 4 Challenge: Write About Gemma 4 The Problem: Developers...
Anthropic releases Claude Opus 4.8, which beats GPT-5.5 and Gemini 3.1 Pro in most benchmarks. The model also catches its own…
