Tech News
← Home  ·  All topics

Qwen3 Next

2 GoKawiil briefs on this topic · RSS for qwen3 next

New Janas-LLM engine outpaces llama.cpp by streaming 'expert' weights from SSD

A project called Janas-LLM has published benchmarks showing it can run large mixture-of-experts models, including a 48GB Qwen3-Next-80B model, on a 32GB laptop by streaming model 'experts' from an NVMe SSD rather than keeping everything in RAM. Tests on an Intel Core Ultra 9 185H laptop with its integrated Arc GPU showed Janas-LLM generating text at 24 tokens/sec versus llama.cpp's 2.8 tokens/sec on that model, with similar gains across a dozen other open models from Qwen and Gemma families. The developers released a benchmarking tool, janas-bench, and installation instructions for Linux x86-64 so others can reproduce results on their own hardware.

AI startup releases Kolibri, an open-weight 'sovereign' language model

A new open-weight AI model called Kolibri has been released, positioned as a 'sovereign' alternative to existing large language models. The release includes benchmark comparisons against models such as Qwen3.6-35B-A3B, Qwen3-Next 80B-A3B, Nemotron 3 Super 120B-A12B and Mistral Small 4 119B-A6B, with metrics focused on non-hallucination rates and grounding accuracy when source documents lack answers.