Gerbil
A desktop app to easily run Large Language Models locally.
Core Features
Run LLMs locally powered by KoboldCpp which itself is a highly modified fork of llama.cpp
powered by KoboldCpp which itself is a highly modified fork of llama.cpp Cross-platform desktop app - Native support for Windows, macOS, and Linux (including Wayland)
- Native support for Windows, macOS, and Linux (including Wayland) Automatic updates - Download and keep your KoboldCpp binary up-to-date effortlessly
- Download and keep your KoboldCpp binary up-to-date effortlessly Smart process management - Prevents runaway background processes and system resource waste
- Prevents runaway background processes and system resource waste Optimized performance - Automatically unpacks binaries for faster operation and reduced memory usage
- Automatically unpacks binaries for faster operation and reduced memory usage Image generation support - Built-in presets for Flux and Chroma image generation workflows
- Built-in presets for Flux and Chroma image generation workflows SillyTavern integration - Seamlessly launch SillyTavern for advanced character interactions (requires Node.js)
... continue reading