GoKawiilJeff: open-source 0.8B zero-shot decision models compatible with Jev API
An independent developer released Jeff, a set of small fine-tuned models (based on Qwen3.5 and Gemma 4) that return calibrated probabilities across user-defined options in a single forward pass, taking roughly 22-28ms per decision on consumer hardware like an RTX PRO 6000 or Apple M4 Max. The models share Jev's request format but were trained entirely locally using synthetic data generated by an open model, with no cloud GPUs or closed-model training data involved. Three model variants are available on Hugging Face: Jeff-Qwen3.5-0.8B, Jeff-Qwen3.5-2B, and Jeff-Gemma4-E2B.