GoKawiilJevstiller open-sourced: local model distills Jev with a set disagreement budget
A Show HN project called Jevstiller introduces a local CPU model trained on outputs from the Jev classification API, aiming to answer most requests in about 15 milliseconds instead of the roughly 300 milliseconds a network call to Jev takes. Users set a target agreement rate (e.g. 98%), and the system routes only enough traffic to the local model to keep its combined coverage and error rate within that budget, sending the rest to Jev.