Stream processing
ksqlDB & RisingWave are neat. I use go-streams for stream processing in Go.
Links
- Logrange - High performance data aggregating storage.
- Mantis - Platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications.
- ksqlDB - Event streaming database purpose-built for stream processing applications. (HN) (Code) (0.24.0 release)
- Transparent Synchronous Dataflow (2019)
- Fluvio - Programmable data streaming platform. (Code)
- Gazette - Makes it easy to build platforms that flexibly mix SQL, batch, and millisecond-latency streaming processing paradigms. (Docs) (HN)
- Apache Flink - Stateful Computations over Data Streams. (Code) (Apache Flink SQL Cookbook) (Web Code)
- Introduction to Stream Processing with Apache Flink (2020)
- Storm Applied: Strategies for real-time event processing
- Template Haskell and Stream-processing programs (2020)
- Eventual Consistency isn’t for Streaming (2020) (HN)
- Hazelcast Jet - Open-Source Distributed Stream and Batch Processing. (Web)
- WTF are streams? (2019)
- Benthos - Stream processor for mundane tasks written in Go. (Web) (Reddit) (Data streaming and Benthos)
- Amazon Kinesis - Process & Analyze Streaming Data .
- Kiner - Python AWS Kinesis Producer with error handling and thread support.
- Modern Distributed Data Architecture with Event Streams, Stream Processing and Derived Data (2020)
- Apache Samza - Distributed stream processing framework.
- Voik - Experimental distributed streaming platform.
- Internal consistency in streaming systems (2021)
- Are We There Yet? The Query Your Database Can't Answer (2021)
- Apache Heron - Real time, distributed, fault-tolerant stream processing engine. (Code)
- The Art of the Meta Stream Protocol: Torrents of Streams
- rlink-rs - High-performance Stream Processing Framework. An alternative to Apache Flink.
- Architecting a Boring Stream Processing Tool With Ashley Jeffs of Benthos (2021)
- Monibuca - Modularized, Extensible framework for building Streaming Server.
- rtsp-simple-server - Ready-to-use RTSP / RTMP / HLS server and proxy that allows to read, publish and proxy video and audio streams.
- Apache Griffin - Big Data Quality Solution For Batch and Streaming. (Code)
- Mirabelle - Stream processing engine for monitoring.
- Kleenex - Programming language for stream processing of data in a regular domain. (Code)
- Callysto - Stream processing framework.
- Database Stream Processor - Streaming and Incremental Computation Framework.
- Conduit - Data Integration for Production Data Stores.
- StreamX - Make stream processing easier.
- Debezium - Change data capture for a variety of databases. (Web)
- Tigris - Modern, scalable backend for building real-time websites and apps. (Web)
- The Dodgy State of Delivery Guarantees (2022) - Summarizing a decades worth of stream processing delivery guarantee misconceptions and bugs.
- Reducing Data Streaming cost by 90% using Benthos (2022)
- Nussknacker - Lets you design, deploy and monitor real time decision algorithms with easy to use GUI.
- Quine - Streaming graph interpreter; a server-side program that consumes data, builds it into a stateful graph structure, and runs live computation on that graph to answer questions or compute results.
- rspl - Stream processor language.
- Readings in Stream Processing
- Serverless Makes Streaming Accessible (2023)
- SeaStreamer - Stream processing toolkit for Rust.
- Arroyo - Distributed stream processing engine written in Rust. (Reddit)
- Top Mistakes to Avoid in Streaming Applications (2023)
- FuncFrog - Library for performing parallel, lazy map, reduce, and filter operations on slices in one pipeline.
- kawa - Fast stream-processing framework and daemon.