Walrus: A Distributed Message Streaming Engine
Walrus is a distributed message streaming platform built on a high-performance log storage engine. It provides fault-tolerant streaming with automatic leadership rotation, segment-based partitioning, and Raft consensus for metadata coordination.
Key Features:
Automatic load balancing via segment-based leadership rotation
via segment-based leadership rotation Fault tolerance through Raft consensus (3+ nodes)
through Raft consensus (3+ nodes) Simple client protocol (connect to any node, auto-forwarding)
(connect to any node, auto-forwarding) Sealed segments for historical reads from any replica
for historical reads from any replica High-performance storage with io_uring on Linux
Architecture
System Overview
... continue reading