Respan, a Y Combinator W24 startup, has released an open-source AI gateway written in Rust that treats every component—providers, protocols like MCP and voice, modalities, and features such as fallbacks and PII redaction—as a swappable plugin. The team says the design stems from running a LiteLLM-based gateway since 2024 whose wrapper code grew past 100,000 lines, culminating in a January upgrade that caused unresolved connection errors and forced them to stop upgrading LiteLLM directly.
news.ycombinator.com
· 2026-10-20
Vercel reported that its Jev decision model, released in limited form on September 15 by TypeSafe AI, reached 35% of paid teams within two weeks — nearly double the reach of the next most popular model, Sonnet 5.5. The data, drawn from Vercel's AI gateway, also shows open source models now handle over 70% of tokens processed but only about 25% of total spend, while frontier-lab spending has grown tenfold.
techcrunch.com
· 2026-10-16
Cloudflare has released a beta Web Search API that lets AI agents and applications query the live internet rather than relying on a model's training data or guessed URLs. Developers can choose from three launch partners—Ceramic.ai, Exa, and Linkup—all of which support Zero Data Retention and Cloudflare's verified bot crawling standards. The API runs through AI Gateway, logging requests and billing them at each provider's list price with no markup, and can be called via REST API or a Worker AI binding.
developers.cloudflare.com
· 2026-10-05
GitLab issued an advisory urging immediate patching of CVE-2026-90970, a critical vulnerability in its AI Gateway service that powers GitLab Duo. The flaw lets an authenticated user with Duo Agent Platform access escape a prompt template sandbox via a crafted flow configuration and run arbitrary commands on self-hosted AI Gateway instances. GitLab released versions 19.2.4, 19.3.2, and 19.4.1 to fix the issue, noting GitLab-hosted AI Gateway customers are already protected.
bleepingcomputer.com
· 2026-10-02
TypeSafe's Jev, a rapidly adopted AI classification model, has become the fastest-growing model in Vercel's AI Gateway history. A commentator argues OpenAI could quickly replicate Jev's core approach and bundle it directly into its own models and agents, since OpenAI's LLMs already function as implicit classifiers that could be retrained for this purpose.
arcturus-labs.com
· 2026-09-22