Arch is a proxy server designed as a modular edge and AI gateway for agentic apps
Arch handles the pesky low-level work in building agentic apps — like applying guardrails, clarifying vague user input, routing prompts to the right agent, and unifying access to any LLM. It’s a language and framework friendly infrastructure layer designed to help you build and ship agentic apps faster. Quickstart • Demos • Build agentic apps with Arch • Route LLMs • Documentation • Contact
Overview
AI demos are easy to build. But past the thrill of a quick hack, you are left building, maintaining and scaling low-level plumbing code for agents that slows down AI innovation. For example:
You want to build specialized agents, but get stuck building routing and handoff code.
code. You want use new LLMs, but struggle to quickly and safely add LLMs without writing integration code.
without writing integration code. You're bogged down with prompt engineering work to clarify user intent and validate inputs .
. You're wasting cycles choosing and integrating code for observability instead of it happening transparently.
With Arch, you can move faster by focusing on higher-level objectives in a language and framework agnostic way. Arch was built by the contributors of Envoy Proxy with the belief that:
... continue reading