Three insights you may have missed from theCUBE’s coverage of the ‘Scaling the Agentic Era’ event
As AI agents move from proof-of-concept tools to production systems, the cost of every generated token is becoming a direct business concern.
The shift is pushing infrastructure providers to focus not just on raw performance, but on efficiency, throughput and the economics of running agentic workloads continuously at scale. That pressure is reshaping how AI infrastructure is evaluated, according to Chen Goldberg (pictured), executive vice president of product and engineering at CoreWeave Inc.
“When your product is an AI agent, every token you generate has a cost and business impact,” Goldberg said. “Vera Rubin delivers 10 times better inference throughput per watt and one-tenth the cost per million tokens versus Blackwell. That is way more than a spec sheet improvement; that’s a technical leap.”
Goldberg spoke with theCUBE during “Scaling the Agentic Era With Nvidia Vera Rubin NVL72 on CoreWeave Cloud,” a virtual event hosted by theCUBE, SiliconANGLE Media’s livestreaming studio. Leaders from CoreWeave, Nvidia Corp. and Dell Technologies Inc. discussed how Vera Rubin is changing AI infrastructure, from end-to-end systems engineering to continuous operations and rack-scale validation. (* Disclosure below.)
