Salvatore Sanfilippo, the creator of Redis, has released DwarfStar 4 (ds4), a lightweight C-based inference engine for running large open-weight language models locally on high-memory Mac, CUDA and ROCm hardware. The tool supports models including DeepSeek V4, V4.1 Flash, GLM 5.x and Qwen3.8 Flash Next, covering text and vision, with a local API, CLI and native agent, and is released under the MIT license.
dwarfstar.sh
· 2026-10-02
OpenJev is a browser-based experiment that runs a local AI model entirely on a user's own GPU, with no backend or waitlist required. It lets users compare how quickly a model can read probability scores for a set of allowed options versus generating the same distribution token by token, using models like MiniCPM5 2B or the lighter Qwen3 0.6B for smaller devices.
openjev.com
· 2026-09-18
A developer created Varkos, an AI-driven companion mod for Skyrim that can fight, loot, fetch items, and carry out multi-step commands in real time using local inference instead of cloud-based LLM calls. The project aims to fix the latency and weak world-interaction problems common in existing AI NPC dialogue systems, while giving Varkos a persistent personality that evolves with shared gameplay experiences.
pantel.is
· 2026-08-23