Streaming

Libraries & Tools

Distributed Messaging

  • Kafka: A distributed event streaming platform.
  • Pulsar: A distributed pub-sub messaging platform.
  • RabbitMQ: A message broker that implements the Advanced Message Queuing Protocol (AMQP).
  • Redis Streams: A data structure for managing streams of messages.
  • RSocket: A binary protocol for use on byte stream transports.
  • ZeroMQ: A high-performance asynchronous messaging library.

Stream Processing

  • Gazette: A high-performance, horizontally scalable, distributed storage system.
  • Apache Flink: A stream processing framework.
  • Apache Storm: A real-time computation system.
  • Apache Samza: A distributed stream processing framework.
  • Apache Beam: A unified programming model for batch and stream processing.
  • Apache NiFi: A data integration and distribution system.

Cloud Streaming Platforms