OpenAI unveils Jalapeño inference chip, outperforming Nvidia and AMD in tests

OpenAI has revealed details of Jalapeño, a custom inference chip developed with Broadcom over roughly 16 months, at the Hot Chips conference. SemiAnalysis tested the chip using its InferenceX benchmark suite and found it outperforms Nvidia, AMD, and Google chips across multiple open-source models, despite being OpenAI's first hardware effort.