🦙 LlamaFarm
Build powerful AI locally, extend anywhere.
LlamaFarm is an open-source framework for building retrieval-augmented and agentic AI applications. It ships with opinionated defaults (Ollama for local models, Chroma for vector storage) while staying 100% extendable—swap in vLLM, remote OpenAI-compatible hosts, new parsers, or custom stores without rewriting your app.
Local-first developer experience with a single CLI ( lf ) that manages projects, datasets, and chat sessions.
with a single CLI ( ) that manages projects, datasets, and chat sessions. Production-ready architecture that mirrors server endpoints and enforces schema-based configuration.
that mirrors server endpoints and enforces schema-based configuration. Composable RAG pipelines you can tailor through YAML, not bespoke code.
you can tailor through YAML, not bespoke code. Extendable everything: runtimes, embedders, databases, extractors, and CLI tooling.
📺 Video demo (90 seconds): https://youtu.be/W7MHGyN0MdQ
🚀 Quickstart (TL;DR)
Prerequisites:
... continue reading