Show HN: GlassFlow – OSS streaming dedup and joins from Kafka to ClickHouse

Join our weekly office hours every Wednesday 15:00-18:00 CET GlassFlow for ClickHouse Streaming ETL GlassFlow for ClickHouse Streaming ETL is a real-time stream processor designed to simplify data pipeline creation and management between Kafka and ClickHouse. It provides a powerful, user-friendly interface for building and managing real-time data pipelines with built-in support for deduplication and temporal joins. Built specifically for data engineers, GlassFlow handles late-arriving events, ensures exactly-once correctness, and scales with high-throughput data. It delivers accurate, low-latency results from streaming data without compromising simplicity or performance. The tool's intuitive web interface makes it easy to configure and monitor pipelines, while its robust architecture ensures reliable data processing. Key Features Streaming Deduplication : Real-time deduplication of Kafka streams before ingestion into ClickHouse Configurable time windows up to 7 days for deduplicat ... Read full article.