GoKawiilIn context: When a market is utterly dominated by a single player as AI infrastructure has been by Nvidia, it's tough for any rival to make a dent. No company knows this better than AMD. They've been battling in many segments against Nvidia, as well as other semiconductor giants like Intel, for decades now.
That challenge hasn't deterred AMD. If anything, it seems to have sharpened the company's focus. At its recent Advancing AI event in San Francisco, AMD rolled out an unusually dense wave of announcements spanning AI infrastructure for the cloud and enterprise data centers, AI-powered client devices, and physical AI for robotics.
The big news was the official launch of the Helios rack, AMD's first full AI infrastructure rack solution powered by 6th-gen Epyc CPUs, Instinct MI455X datacenter GPUs, and Pensando networking chips.
AMD first previewed Helios at last year's event, but actually shipping it is an important step, both philosophically and practically. Nvidia has trained the market to expect rack- and datacenter-scale solutions as table stakes for AI infrastructure, and without a shipping rack product of its own, AMD was at a real disadvantage. With Helios shipments now set to begin later this quarter, AMD can credibly call itself a serious contender in AI infrastructure, and organizations shopping for the technology now have a legitimate alternative to weigh.
That new confidence was reflected in the customers and partners AMD paraded on stage. From Anthropic and OpenAI on the frontier-model side to Meta and enterprise customers like AT&T, there was a genuine sense of energy and partnership running through the event.
CEO Lisa Su went out of her way to highlight how closely AMD had co-designed Helios with its earliest customers, a reminder of how much it pays to actually listen to what buyers want before finalizing a product.
AMD didn't stop at building a credible alternative; it also made some aggressive claims about outperforming the competition outright.
How well benchmark claims translate to real-world performance is always hard to judge in advance, but AMD touted 20% greater per-core performance for its latest Epyc CPUs over Nvidia's new Vera CPU, among other figures.
The company also highlighted Helios's larger HBM4 memory capacity and faster memory bandwidth compared with similar Nvidia rack systems. However those numbers hold up once independent, third-party benchmarks arrive, it's fair to say AMD is now offering a hardware alternative to Nvidia. For customers chasing low-latency inference, AMD also announced a partnership with Cerebras that will let a Cerebras rack sit side by side with a Helios rack for demanding workloads.
Of course, AI infrastructure is about more than hardware, and one of the more intriguing announcements from Advancing AI was a new version of AMD's software stack, called ROCm.ai. It's designed to use AI-assisted programming to make building software optimized for AMD hardware significantly easier – including, for example, porting code originally written in CUDA over to ROCm.
... continue reading