AMD, Intel, Nvidia, Arm, and Qualcomm are all selling datacenter CPUs into the AI buildout. The previous piece mapped them across five sockets orbiting the GPU and ranked those sockets by value: coherent host, standard host, thinker, doer, traditional cloud.
The coherent host is the most valuable. The traditional cloud CPU is the least.
Many readers asked if it matters whether the CPU is x86 or Arm.
Honestly, not as much as made out to be. But let’s go socket by socket.
Quick context
The ISA is the language a CPU speaks. Software gets compiled into that language, and a chip can only run code written for its dialect.
x86 has been the server default for decades. Yet Arm has been gaining in servers, first slowly, then quickly as Graviton, Axion, and Cobalt took hold in cloud, and now inside AI infrastructure as hyperscalers build Arm into their GPU server stacks.
Naturally, everyone asks which ISA is “better” for agentic AI; they’re both just fine.
The more interesting question at each socket is whether the software running there cares which ISA it runs on? Specifically, is the ISA a “moat” at any of the agentic sockets? Let’s see:
1. Coherent host: ISA is irrelevant
... continue reading