YC-backed Respan launches open-source Rust AI gateway built entirely on plugins
Respan, a Y Combinator W24 startup, has released an open-source AI gateway written in Rust that treats every component—providers, protocols like MCP and voice, modalities, and features such as fallbacks and PII redaction—as a swappable plugin. The team says the design stems from running a LiteLLM-based gateway since 2024 whose wrapper code grew past 100,000 lines, culminating in a January upgrade that caused unresolved connection errors and forced them to stop upgrading LiteLLM directly.