OpenAI has provided further details about its custom AI accelerator 'Jalapeño,' developed in partnership with Broadcom.
At the Hot Chips event, the company revealed that the processor is rated at 700 watts, but the chip's measured sustained power remained at or below 550W on the workloads tested.
– OpenAI
OpenAI will deploy Jalapeño in racks featuring 128 chips, while "a full pod is 2,048 ASICs," the company's VP of hardware, Richard Ho, said in a presentation attended by DCD. The 128 deployment is capable of 1.7 exaflops of 4-bit compute, with 27.5TB of HBM4. Each package has 15.4TBps of memory bandwidth.
Ho said that the company tested the chip on three models, its own GPT-OSS-120B, as well as DeepSeek's R1 and Moonshot AI's Kimi K2.5. "Across the three models we tried this on, we showed that the architecture works across not just internal models, but others," Ho said. "This is a general purpose, very flexible accelerator."
