GoKawiilNew Janas-LLM engine outpaces llama.cpp by streaming 'expert' weights from SSD
A project called Janas-LLM has published benchmarks showing it can run large mixture-of-experts models, including a 48GB Qwen3-Next-80B model, on a 32GB laptop by streaming model 'experts' from an NVMe SSD rather than keeping everything in RAM. Tests on an Intel Core Ultra 9 185H laptop with its integrated Arc GPU showed Janas-LLM generating text at 24 tokens/sec versus llama.cpp's 2.8 tokens/sec on that model, with similar gains across a dozen other open models from Qwen and Gemma families. The developers released a benchmarking tool, janas-bench, and installation instructions for Linux x86-64 so others can reproduce results on their own hardware.