Show HN: Slipstream - a python library for stateful stream processing

Slipstream provides a data-flow model to simplify development of stateful streaming applications. Speed: optimized and configurable defaults to get started quickly Consume any source that can be turned into an Async Iterable ; Kafka, streaming API’s, et cetera. Sink or cache data to any Callable ; Kafka, RocksDB, API’s. Perform any arbitrary stateful operation – joining, aggregating, filtering – using regular Python code. Detect dependency stream downtimes, pause dependent streams, or send out corrections. Because everything is built with basic python building blocks, framework-like features can be crafted with ease. For instance, while timers aren’t included, you can whip one up effortlessly: from asyncio import run , sleep async def timer ( interval = 1.0 ): while True : await sleep ( interval ) yield We’ll use print as our sink: print Let’s send our mascot 🐟 – blub downstream on a regular 1 second interval: from slipstream import handle , stream @handle ( timer (), sink = [ ... Read full article.