AI and ML

Jalapeño is the latest announcement that attempts to portray OpenAI as more than a race-to-the-bottom model maker

OpenAI and Broadcom have teamed up – with a little help from some of the former’s AI models – to develop the frontier model lab’s very first inference chip, dubbed Jalapeño, the companies announced in a press release on Wednesday. Details of the spicily named silicon are scarce in the announcement, with the company admitting that it’s running engineering samples of Jalapeño in its lab “at target frequency and power,” but noting that it won’t have any technical details to share until a report on its performance is released in the coming months. But that doesn't stop it from claiming that "early testing shows that Jalapeño will deliver performance per watt substantially better than current state-of-the-art." Alright then! OpenAI said that it designed Jalapeño itself, with Broadcom serving as its implementation and integration partner (i.e., they made the darn thing), but it wasn’t humans alone who helped come up with Jalapeño’s made-for-inference ASIC architecture: AI helped, natch, and the result is what OpenAI says is the fastest ASIC development cycle ever in the high-performance advanced semiconductor space.