GoKawiilFlide launches open-source inference engine claiming up to 9.5x speedup for Jev decision models
A new open-source project called Flide was shown on Hacker News, offering fast inference infrastructure for Jev-style decision models via an exact state-forking technique. Its creators say it runs up to 9.5 times faster than existing engines vLLM and SGLang while preserving model-only answers, and version 0.1.10 adds support for several new decision models including Ainvest-Decision, Darwin-27B-RSI-Decision and KnowLine-31B-Gen1.5, the latter now able to read images.