Nvidia is building Nemotron 4, a new open-weight model designed to compete with the best freely available models in the world. According to The Information, the largest model in the family will have at least one trillion parameters, twice the size of Nemotron 3 Ultra. Nvidia has tripled its cloud spending on in-house model training to $28 billion through 2031. The earliest possible release would be this fall.
Even at one trillion parameters, Nvidia would only be reaching a scale that Chinese labs already occupy. Moonshot AI's Kimi K3 has 2.8 trillion parameters, and DeepSeek V4 Pro has 1.6 trillion. Nemotron 3 Ultra scored 48 points on the Artificial Analysis Intelligence Index, making it the strongest open US model but still trailing Kimi K2.6 at 54. K3 now sits at 57.
Nvidia is also among the signatories of a petition against regulating open models, even as the Trump administration considers targeted bans on specific Chinese models. The more companies self-host open models, the more GPUs Nvidia sells. But Nemotron 4 would also put Nvidia in direct competition with its own major customers like OpenAI.
AI News Without the Hype – Curated by Humans
Subscribe now
