Why This Matters
Filament is a new open-source Go engine for moving data between sources and sinks, supporting full, incremental, and change data capture replication with durable checkpointing and batch verification. It targets a space usually dominated by heavier or SaaS-only ETL/replication tools, offering an embeddable library, a service with API and web UI, and self-hosted deployment options. For teams that want control over data pipelines without vendor lock-in, it's a lightweight alternative worth watching.
Key Takeaways
- Pluggable interfaces for sources, sinks, state storage, and event transport let teams swap components rather than adopt a fixed stack.
- Durable checkpointing and per-batch verification on both sides of a write aim to make pauses, resumes, and integrity checks routine rather than manual.
- Flexible deployment: embed the engine in a Go app, run it as a service with UI, use Helm on Kubernetes, or one-click deploy to Railway, Render, or DigitalOcean.
Filament
Filament is pluggable data replication with checkpointing, batching, and integrity events.
It moves data from sources to sinks using full, incremental, or change data capture replication. Filament keeps progress durable as data moves, verifies batches on both sides of a write, and safely pauses or resumes runs from their checkpoints.
Sources, sinks, state storage, and event transport are replaceable interfaces. Run Filament as a service with its API and web UI, deploy it to your own infrastructure, or embed the engine in a Go application.
Install
curl -fsSL https://getgalaxy.io/filament/install | sh
On macOS via Homebrew
brew install galaxy-io/tap/filament
Prebuilt binaries for Linux and macOS are on the releases page.
Getting started
... continue reading
GoKawiil