Gemma 4 Didn't Just Get Smarter. It Became a Different Kind of Model. Here's What the Agentic Numbers Actually Mean.

This is a submission for the Gemma 4 Challenge: Write About Gemma 4

Every open-weight model release in 2026 comes with a benchmark table and a claim about efficiency. Most of them are incremental. Gemma 4 has one number that isn't: 6.6% to 86.4% on agentic tool use. That's not an improvement. That's a category change.

The Number That Actually Matters

When Google DeepMind dropped Gemma 4 on April 2, 2026, the coverage focused on the headline scores - AIME 2026, LiveCodeBench, Arena AI rankings. Those numbers are impressive. The 31B dense model scores 89.2% on AIME (up from Gemma 3 27B's 20.8%), 80% on LiveCodeBench (up from 29.1%), and sits third among all open models on Arena AI.

But the benchmark that actually changes what developers can build is τ2-bench - the agentic tool use evaluation that measures whether a model can reliably execute multi-step tasks across real tool schemas, partial information, and policy constraints. Gemma 3 27B scored 6.6% on τ2-bench Retail. Gemma 4 31B scores 86.4%.