GoKawiilReddit builder runs Moonshot AI's 2.8T-parameter Kimi K3 on discontinued Intel Optane memory
A homelab enthusiast on Reddit got Moonshot AI's 2.8-trillion-parameter Kimi K3 model running entirely on CPU, using discontinued second-generation Intel Optane PMem 200 modules paired with a 40-core 3rd-gen Xeon Scalable processor instead of a GPU. Using 1-bit quantization, the setup managed just 0.85 tokens per second and required active cooling with dual 12W blower fans aimed directly at the memory modules. It follows an earlier similar project that used first-generation Optane memory in Memory Mode rather than the App Direct Mode used here.