A GitHub project called jevper reimplements the documented 'System One' wire format used by the Jev interface, letting developers run typed questions (choice, score, noul) against any OpenAI-compatible model instead of the hosted TypeSafe API. It works with self-hosted llama.cpp servers or other duck-typed clients, requiring no dependency on typesafe-sdk or openai at runtime, and is installable via pip as a Python 3.10+ package.
A technical blog post demonstrates how the buzzy AI concept known as 'Jev' can be replicated using an open-source Qwen3-0.6B model and roughly 25 lines of Python code. The example loads the model, prompts it to classify an email as legitimate, spam, or phishing, and extracts probability scores directly from the model's output logits rather than relying on an external API or specialized training pipeline.
Following a rushed 'Lite' GGUF release four days after Qwen 3.8 27B launched, the team has now finished fully optimized ShapeLearn quantizations and benchmarked them against both the Lite versions and rival quants. The full models push the quality-versus-speed tradeoff further, with all five new variants topping the performance frontier across six GPU test configurations.
Georgi Gerganov, creator of llama.cpp, addressed Nvidia's acquisition of Hugging Face, noting Nvidia engineers have contributed code and hardware to the project for over a year. He said llama.cpp and its ggml backend will remain hardware-agnostic and community-driven despite the new corporate ties.
A user ran Alibaba's new Qwen3.8 27B model locally on a Mac Studio M3 Ultra for 10 days, using it for daily tasks like summarizing RSS feeds and renaming scanned PDFs, then formally benchmarked it against its predecessor. The Q4_K_M version generated at about 14 tokens per second versus 28.6 tokens/s for Qwen3.6 27B, but produced answers using roughly a third as many tokens, making total response time nearly equal. A 1-bit quantized version ran much faster at 27 tokens/s and stayed factually accurate but struggled to commit to definitive answers.
GoKawiil