JevBench publishes reproducible per-decision cost benchmark for typed decision models
A Show HN post introduces JevBench, a benchmark that measures typed decision models by cost per 1,000 decisions rather than per token, using actual token counts from 534 v1.2 test decisions. The methodology prices systems with public tariffs at their listed per-token rates, while unlisted open-weight models are priced using OpenRouter or DeepInfra hosting rates for the same or comparable weights, explicitly avoiding raw GPU rental costs. Reported figures include Jev 1.13.0 at $0.0399 per 1,000 decisions, SemIf at roughly $0.022, and Winnow-12B Q8 at roughly $0.037.