At $3,999, you’re not that far off from a faster, more refined GB10 box
Takes all the guesswork out of setting up a Strix Halo box for local AI
The Ryzen AI Halo lives up to its promise as a turn-key local AI platform within AMD’s AI ecosystem, and it comes with helpful docs and useful software to get you rolling quickly. But its performance trails DGX Spark and GB10 boxes, and it’s not much cheaper than those systems.
Why you can trust Tom's Hardware Our expert reviewers spend hours testing and comparing products and services so you can choose the best for you. Find out more about how we test.
Nvidia's DGX Spark and its GB10 SoC have set the template for what a purpose-built local AI developer sandbox should be. The combination of a standardized hardware platform with robust first-party software support and thorough documentation lets those curious about local AI get up and running faster than buying a bare-metal box and building everything up from scratch, especially in the rapidly evolving AI space.
AMD's Ryzen AI Max+ 395, aka Strix Halo, SoC, is the best x86 spoiler for GB10 so far. It has the same 128GB of unified memory, a powerful 16C/32T Zen 5 CPU, and a Radeon 8060S integrated GPU with 2560 RDNA 3.5 stream processors. It also has an AMD XDNA 2 NPU for those who want to experiment with that accelerator in addition to the general-purpose Radeon GPU. And it can run Windows and Windows apps natively, whereas GB10 boxes are Linux-only for now.
AMD's partners have been building around this hardware for about a year and a half, and it's a well-known quantity at this point. But once you have that hardware in hand, setting it up for AI workloads involves digging through scattered GitHub pages, Reddit threads, and AMD official documentation to get all the software pieces lined up right for the best performance and compatibility.
AMD is trying to change all that today with the launch of the Ryzen AI Halo, a first-party, turn-key Strix Halo mini-PC that puts local AI first. This system can be had with Windows or Linux, and at least in the Linux form we're testing today, it comes preloaded with the full AMD ROCm software stack and an assortment of applications you need to immediately start generating tokens with your preferred model.
And on the support side, AMD has taken a page directly out of Nvidia’s book and cooked up an entire set of its own playbooks that cover various local AI applications and usage scenarios with the AI Halo (and Strix Halo systems more generally) to serve as a springboard for local AI explorers.
The grand tour
... continue reading