GoKawiilGalaxy releases Filament, an open-source Go engine for data replication
Galaxy has published Filament, an open-source tool written in Go that moves data between systems using full, incremental, or change-data-capture replication. It tracks progress with durable checkpoints, verifies batches on both the read and write sides, and can pause or resume runs safely, while letting developers swap in custom sources, sinks, storage, and event transport.
GoKawiil's interpretation of the reporting above, not reported fact.
Reliable data movement between databases and systems is a persistent infrastructure headache, and many teams either build brittle in-house scripts or pay for heavyweight ETL platforms. By offering a lightweight, embeddable, and self-hostable engine with built-in fault tolerance, Filament gives developers a middle path that can run standalone, in Kubernetes, or inside their own Go applications.
- Filament supports full, incremental, and change-data-capture replication modes.
- Its checkpointing and batch verification let interrupted transfers resume safely without data loss.
- It can be deployed via Kubernetes/Helm, hosted platforms like Railway or DigitalOcean, or embedded directly in Go code.
The Go Programming Language book — If Filament's Go-based engine has you curious about writing your own high-throughput data tooling, Donovan and Kernighan's classic is the reference to keep on your desk. It covers concurrency, interfaces, and idiomatic patterns — exactly the building blocks behind pluggable sources and sinks.
See The Go Programming Language book on Amazon → Affiliate link — we may earn a commission on purchases, at no extra cost to you. Product picked by AI based on this article; it is not a tested recommendation.Source: github.com, 2026-09-08
Published there as: “Show HN: Filament – Fast data movement engine in Go”
Read the original report → The summary and analysis above are GoKawiil's own, written from reporting by the source above. Facts and quotes belong to the original publisher.