GoKawiilNo model call
to decide the route Deterministic
and fully offline Calibrate
on your own data Bring your own key
self-hosted
Wayfinder reads the shape of a prompt — its length, headings, lists, and code — plus difficulty cues in the wording, like proofs, math, and hard constraints, and tells you whether to send it to your small local model or your big cloud one. It decides in microseconds, runs offline, and never calls another model to make the call. No API key, no network, no model call to decide. You get a score and a recommendation; what you do with it is up to you.
Cheap prompts stay local, hard ones go to the expensive model, and you stop paying frontier prices for "summarize this" and "fix my typo."
How it compares
Most routers decide by calling a model: a trained classifier, an LLM judge, or a hosted API. That adds latency, cost, and a little randomness to the exact step that is meant to save you money. Wayfinder reads structure and wording instead, so the decision is free and the same every time.
router decides by model call? self-host calibrate Wayfinder deterministic structural score no yes yes RouteLLM trained classifier (preference data) yes yes retrain NotDiamond / Martian learned, hosted yes no via platform OpenRouter (Auto) hosted auto-router yes no — LiteLLM provider proxy (not complexity-routed) no yes n/a
... continue reading