We ran 904 DeepSWE rollouts on GLM-5.3 and GPT-5.6 Sol. Sol leads pass@1 by 3.7 points; GLM-5.3 wins pass@4 at half the cost, and a GLM-first cascade hits 85.9%.
We ran GLM-5.3 (max) against GPT-5.6 Sol (max) on all 113 DeepSWE tasks, four trials each, from the published per-trial records: 904 rollouts in total, 452 per side. Sol is the precision flagship. GLM-5.3 is the open-weight challenger that closed the gap. Every figure below comes from this run, so it can differ from other public GLM-5.3 vs. GPT-5.6 Sol scorecards.
DeepSWE · Head to Head
GLM 5.3 vs GPT 5.6 Sol at a glance
Model
Pass@1
We ran 904 DeepSWE rollouts on Kimi K3 and GPT-5.6 Sol. Sol leads pass@1; Kimi K3 wins pass@4 at 2.8x the solves per dollar, and…
We ran 904 DeepSWE rollouts on GLM-5.3 and Claude Fable 5. A tie on pass@1, but GLM-5.3 wins pass@4 and costs 5.4x less: \$3.99…
We ran 900 DeepSWE rollouts on DeepSeek-V4 Flash and GPT-5.6 Luna. Luna leads pass@1 by 14 points; DeepSeek delivers 4.8x the…
GPT-5.6 is live, but Sol is not the default answer. I ran the cost math on Sol, Terra, Luna, long context, caching, and four real…
OpenAI's multifaceted release of GPT-5.6 Sol dominated the intelligence streams today as the model...
Three flagship models shipped in fifteen days. Where Claude Opus 5, GPT-5.6 Sol and Kimi K3 actually lead, with the losses kept…
