Software Alternatives & Reviews

Top 15 Kafka Alternatives Popular In 2021

Recommended and mentioned products

  1. Apache Kafka is an open-source message broker project developed by the Apache Software Foundation written in Scala.

    Horizontally scaling Kafka consumers with rendezvous hashing about 13 days ago:

    Apache Kafka is the foundational architecture most developers choose when building streaming applications. It’s incredibly scalable, fault-tolerant, and dependable. And its popularity has yielded vast knowledge with an active community to support developers when they build applications. Naturally, Kafka is now a table-stakes data platform component for nearly every major enterprise that deals with events data.
  2. Apache Spark is an engine for big data processing, with built-in modules for streaming, SQL, machine learning and graph processing.

    Databricks explained for busy engineers | Databricks quick... about 15 days ago

    **Databricks **is built on top of Apache Spark, which provides a fast and general-purpose cluster-computing framework for big data processing.
  3. RabbitMQ is an open source message broker software.

  4. Apache ActiveMQ is an open source messaging and integration patterns server.

    Data Engineering and DataOps: A Beginner's Guide to Building... about 18 days ago:

    For real-time streaming, we have other frameworks and tools like Apache Kafka, ActiveMQ, and AWS Kinesis.
  5. Amazon Kinesis services make it easy to work with real-time streaming data in the AWS cloud.

    AWS Beginner's Key Terminologies about 16 days ago:

    Amazon Kinesis (analytics) Amazon Kinesis is a platform for streaming data on AWS. Kinesis offers services that simplify the loading and analysis of streaming data. Https://aws.amazon.com/kinesis/.
  6. Red Hat AMQ is a cost-effective messaging platform that enables safe & secure transmission of information among devices, applications, and services.

  7. Apache Storm is a free and open source distributed realtime computation system.

    Data Engineering and DataOps: A Beginner's Guide to Building... about 18 days ago:

    There are several frameworks available for batch processing, such as Hadoop, Apache Storm, and DataTorrent RTS.
  8. Amazon Simple Queue Service is a fully managed message queuing service.

    Resolving the paradox of cloud-native solutions: more agility... about 7 days ago:

    During two weeks, I led a team that re-architected an existing solution and delivered a modern, lean batch application: a distributed data processor made from a combination of serverless building blocks like Amazon EventBridge rules, Amazon SQS queues, and AWS Lambda Functions. As you can see in the image above, this drastically reduced the amount of code needed (and thus its complexity), the resources used, and...
  9. IBM MQ is messaging middleware that simplifies and accelerates the integration of diverse applications and data across multiple platforms.

  10. From error tracking to performance monitoring, developers can see what actually matters, solve quicker, and learn continuously about their applications - from the frontend to the backend.

    Encrypting and storing server troubleshooting data in HTTP... about about 3 hours ago

    The other common pattern requires a solid exception-capture capability, and allows one to ship off exceptions/errors to a SaaS provider (i.e. Sentry). But if the apps themselves aren't throwing exceptions for these issues...
  11. Redis is an open source in-memory data structure project implementing a distributed, in-memory key-value database with optional durability.

    open-source

    When not to use Deno ☄️ about 1 day ago:

    Database reads are expensive and slow. There's a multitude of other reasons why caching is essential, but for the project I'm working on I'm using supabase and their free tier supports only a limited amount of bandwidth. To avoid any rate-limiting I added a Redis layer in front of it to reduce the number of queries that hit the database directly.
  12. Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data

    7 Open-Source Log Management Tools that you may consider in 2023 about 7 days ago:

    Apache Flume is an open-source log management tool designed to efficiently collect, aggregate, and transport large volumes of log data from various sources to a centralized data store, such as HDFS or Hbase. It excels in handling large amounts of log data in real-time and is highly scalable, able to handle the load from multiple servers, network devices, and applications.
  13. Fluentd is a cross platform open source data collection solution originally developed at Treasure Data.

  14. Build powerful reactive, concurrent, and distributed applications in Java and Scala

    About Elixir and the microservices architecture about about 2 months ago:

    Note Akka, the Java & friends framework, is working with the actor model and have as main inspiration Erlang to mimic some features of the BEAM on top of the JVM.
  15. Experts agree - we're the leader. Forrester Research names Workato a Leader in iPaaS for Dynamic Integration. Get the report. Gartner recognizes Workato as a “Cool Vendor in Social Software and Collaboration”.

  16. Appmixer embedded iPaaS and workflow automation system is a product of client IO s.r.o. (http://client.io). Built proudly by developers for developers.

  17. Flink is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations.

    Which MQTT (or similar protocol) broker for a few 10k IoT... about 21 days ago:

    One can also consider https://flink.apache.org/ instead of Kafka for connecting a large number of devices.
  18. Cloud Pub/Sub is a flexible, reliable, real-time messaging service for independent applications to publish & subscribe to asynchronous events.

    Effortlessly Scale Your Applications with FaaS: Learn How... about about 1 month ago:

    Google Cloud Functions is a FaaS offering from Google Cloud Platform (GCP). It allows developers to run their code in response to events, such as changes in a database or the arrival of a message in a Pub/Sub topic. Like AWS Lambda, Google Cloud Functions can be used to build a variety of applications, including serverless websites, data processing pipelines, and real-time data streams.
  19. Kubernetes message broker and message queue platform. An open-source project providing the most efficient way to connect microservices.

  20. Enterprise-scale integration platform

    Project management about 7 days ago

    Check out tray.io they have connectors with Monday.com and Atera which can do alot of the heavy lifting. All you would need to do is create rules. Use Monday.com to house the information tied to the Atera Customer or Device.
  21. StreamSets provides Continuous Ingest technology for the next generation of big data applications.

    Best way to automate JSON to CSV/Relational Tables at scale?... about 9 months ago

    If you would like to take a look at https://streamsets.com/ the Data Collector product can handle this for you as well as dynamically generate the target tables. It has a number of functions to handle your JSON no matter the complexity. However, given the dynamic nature it may benefit to touch base so please feel free to chat or message me.
  22. Your data. Where you need it. HVR is the leading independent real-time data replication solution that offers efficient data integration for cloud and more.

  23. AA

    Apace Airflow

    This hasn't been added to SaaSHub yet

  24. Airflow is a platform to programmaticaly author, schedule and monitor data pipelines.

    How do you backup running systems? about 2 days ago

    If you have the spare capacity Apache Airflow is great for this.
  25. NServiceBus is a service bus for .NET offering enterprise-grade scalability and reliability for your workflows and integrations.