OpenAI showed off "Jalapeño," its first in-house inference chip, with benchmarks at the Hot Chips conference. According to SemiAnalysis tests, the chip beats Nvidia's Blackwell and even Rubin in throughput and energy efficiency. "Usually first generation chips aren't competitive, but OpenAI is beating Nvidia Blackwell and even Rubin," SemiAnalysis CEO Dylan Patel said.

OpenAI still isn’t giving up Nvidia chips, though.

128 chips, 1.7 exaFLOPS, and 27 TB of HBM give Altman and crew a leg up over Blackwell, and maybe even Rubin