7 Real-Time Data Streaming Tools You Should Consider On Your Next Project

Big Data Stream Processing Databases

Apache Storm Landing Page
1

Apache Storm

Apache Storm is a free and open source distributed realtime computation system.
Pricing:
- Open Source
Storm is a popular distributed real-time computation system that works for big data with a simple processing model to carry out powerful abstractions. This framework --- made an open source project by Twitter --- has been touted as the real-time Hadoop.

#Big Data #Data Management #Databases 11 social mentions
Materialize Landing Page
2

Materialize

A Streaming Database for Real-Time Applications
Pricing:
- Open Source
Materialize is an SQL streaming database startup built on top of the open source Timely Dataflow project.

#Database Tools #Databases #Relational Databases 65 social mentions
Apache Kafka Landing Page
3

Apache Kafka

Apache Kafka is an open-source message broker project developed by the Apache Software Foundation written in Scala.
Pricing:
- Open Source
The Apache Kafka framework is a distributed publish-subscribe messaging system that receives data streams from disparate source systems.

#Stream Processing #Data Integration #ETL 120 social mentions
Apache Flink Landing Page
4

Apache Flink

Flink is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations.
Pricing:
- Open Source
Apache Flink is another popular open source distributed data streaming engine that performs stateful computations over bounded and unbounded data streams. This framework is written in Scala and Java and is ideal for complex data stream computations.

#Stream Processing #Big Data #Developer Tools 27 social mentions
Amazon Kinesis Landing Page

5

Amazon Kinesis

Amazon Kinesis services make it easy to work with real-time streaming data in the AWS cloud.

Kinesis is a managed streaming service on AWS. AWS Kinesis being managed provides several advantages compared to some of the other tools on this list. It allows your team to spend less time managing infrastructure components and services and instead focuses more on development. Kinesis allows you to ingest everything from videos, IoT telemetry data, application logs, and just about any other data format live. This means you can run various processes and machine learning models on the data live as it flows through your system instead of having to go to a traditional database first.

#Stream Processing #Data Management #Analytics 22 social mentions