Software Alternatives & Reviews

Apache NiFi VS Apache Kafka

Compare Apache NiFi VS Apache Kafka and see what are their differences

Apache NiFi logo Apache NiFi

An easy to use, powerful, and reliable system to process and distribute data.

Apache Kafka logo Apache Kafka

Apache Kafka is an open-source message broker project developed by the Apache Software Foundation written in Scala.
  • Apache NiFi Landing page
    Landing page //
    2019-01-17
  • Apache Kafka Landing page
    Landing page //
    2022-10-01

Apache NiFi videos

Forget Duplicating Local Changes: Apache NiFi and the Flow Development Lifecycle (FDLC)

Apache Kafka videos

Apache Kafka Tutorial | What is Apache Kafka? | Kafka Tutorial for Beginners | Edureka

More videos:

  • Review - Apache Kafka - Getting Started - Kafka Multi-node Cluster - Review Properties
  • Review - 4. Apache Kafka Fundamentals | Confluent Fundamentals for Apache Kafka®
  • Review - Apache Kafka in 6 minutes
  • Review - Apache Kafka Explained (Comprehensive Overview)
  • Review - 2. Motivations and Customer Use Cases | Apache Kafka Fundamentals

Category Popularity

0-100% (relative to Apache NiFi and Apache Kafka)
Analytics
100 100%
0% 0
Data Integration
16 16%
84% 84
Stream Processing
0 0%
100% 100
ETL
100 100%
0% 0

User comments

Share your experience with using Apache NiFi and Apache Kafka. For example, how are they different and which one is better?
Log in or Post with

Reviews

These are some of the external sources and on-site user reviews we've used to compare Apache NiFi and Apache Kafka

Apache NiFi Reviews

Top 8 Apache Airflow Alternatives in 2024
Another product by Apache is called NiFi – even though it’s also dedicated to data workflow management, it differs from Apache Airflow in many aspects. First of all, Apache NiFi is a completely web-based tool with a drag&drop interface and no coding. It’s easy to add and configure processors as graph nodes of data workflow, set up routing directions as graph edges, and...
Source: blog.skyvia.com
11 Best FREE Open-Source ETL Tools in 2024
Apache NiFi allows you to automate and manage the flow of information systems. It also enables NiFi to be an effective platform for building scalable and powerful dataflows. NiFi follows the fundamental concept of Flow-Based Programming. It has a highly configurable web-based UI, and houses features such as Data Provenance, Extensibility, and Security features.
Source: hevodata.com
10 Best Airflow Alternatives for 2024
Apache NiFi is a free and open-source application that automates data transfer across systems. The application comes with a web-based user interface to manage scalable directed graphs of data routing, transformation, and system mediation logic. It is a sophisticated and reliable data processing and distribution system. To edit data at runtime, it provides a highly flexible...
Source: hevodata.com
15 Best ETL Tools in 2022 (A Complete Updated List)
Apache Nifi simplifies the data flow between various systems using automation. The data flows consist of processors and a user can create their own processors. These flows can be saved as templates and later can be integrated with more complex flows. These complex flows can then be deployed to multiple servers with minimal efforts.
Top 10 Popular Open-Source ETL Tools for 2021
Apache NiFi allows you to automate and manage the flow of information systems. It also enables NiFi to be an effective platform for building scalable and powerful dataflows. NiFi follows the fundamental concept of Flow-Based Programming. It has a highly configurable web-based UI, and houses features such as Data Provenance, Extensibility, and Security features.
Source: hevodata.com

Apache Kafka Reviews

Best message queue for cloud-native apps
If you take the time to sort out the history of message queues, you will find a very interesting phenomenon. Most of the currently popular message queues were born around 2010. For example, Apache Kafka was born at LinkedIn in 2010, Derek Collison developed Nats in 2010, and Apache Pulsar was born at Yahoo in 2012. What is the reason for this?
Source: docs.vanus.ai
Are Free, Open-Source Message Queues Right For You?
Apache Kafka is a highly scalable and robust messaging queue system designed by LinkedIn and donated to the Apache Software Foundation. It's ideal for real-time data streaming and processing, providing high throughput for publishing and subscribing to records or messages. Kafka is typically used in scenarios that require real-time analytics and monitoring, IoT applications,...
Source: blog.iron.io
10 Best Open Source ETL Tools for Data Integration
It is difficult to anticipate the exact demand for open-source tools in 2023 because it depends on various factors and emerging trends. However, open-source solutions such as Kubernetes for container orchestration, TensorFlow for machine learning, Apache Kafka for real-time data streaming, and Prometheus for monitoring and observability are expected to grow in prominence in...
Source: testsigma.com
11 Best FREE Open-Source ETL Tools in 2024
Apache Kafka is an Open-Source Data Streaming Tool written in Scala and Java. It publishes and subscribes to a stream of records in a fault-tolerant manner and provides a unified, high-throughput, and low-latency platform to manage data.
Source: hevodata.com
NATS vs RabbitMQ vs NSQ vs Kafka | Gcore
One of the biggest drawbacks of Apache Kafka is the architecture that makes it so efficient. The combination of brokers and ZooKeeper nodes, along with numerous configurable options, can make it difficult and complex for new teams to set up and manage without encountering performance issues or data loss. However, Kafka can work without ZooKeeper after 3.3.1 version using...
Source: gcore.com

Social recommendations and mentions

Based on our record, Apache Kafka should be more popular than Apache NiFi. It has been mentiond 120 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.

Apache NiFi mentions (16)

  • Ask HN: What low code platforms are worth using?
    Apache NIFI (https://nifi.apache.org/). It uses the concept of Flow-based programming. Also its so underacknolged but this tool is very flexible. I have used as an Event Bus all the 3rd-Party Integrations. - Source: Hacker News / 7 months ago
  • Help with choosing techstack for a new DE team
    Presently setting up Apache Nifi + Apache MiNiFi for the ETL portion of my work. NiFi was easy enough to figure out; but the docs for MiNiFi have been a pain due to differences between the Java and C++ versions. I then entirely configured it with the Java version so that it was easier to search for answers for the MiNiFi yaml syntax. Source: 10 months ago
  • Json splitting and Rerouting (new to nifi)
    NIFI, like most Apache projects does most of its discussion on its mailing lists, but also has a slack. Source: 12 months ago
  • Recommend ETL tool in Linux
    You might want to give a tool like nifi a try: Https://nifi.apache.org/. Source: about 1 year ago
  • Anki shared decks for Clickhouse and Apache Nifi
    Recently I got a job at a new company and now I need to learn about Clickhouse, Docker, Apache Nifi and Kafka. I've found the decks about Docker and Kafka, but I can't find ones about Clickhouse and Nifi. Https://clickhouse.com/docs/en/intro Https://nifi.apache.org/. Source: about 1 year ago
View more

Apache Kafka mentions (120)

  • Empowering Real-Time Data Pipelines: Leveraging Apache Kafka and Rudderstack
    In today’s fast-paced digital landscape, effective data management and analysis are essential for businesses aiming to stay ahead of the curve. Fortunately, modern tools like Apache Kafka and RudderStack have revolutionized the way we handle and derive insights from large datasets. In this blog post, we’ll explore our experience implementing the Kafka Sink Connector to facilitate seamless event data transfer to... - Source: dev.to / about 1 month ago
  • Choosing Between a Streaming Database and a Stream Processing Framework in Python
    Stream-processing platforms such as Apache Kafka, Apache Pulsar, or Redpanda are specifically engineered to foster event-driven communication in a distributed system and they can be a great choice for developing loosely coupled applications. Stream processing platforms analyze data in motion, offering near-zero latency advantages. For example, consider an alert system for monitoring factory equipment. If a... - Source: dev.to / 3 months ago
  • How to Use Reductstore as a Data Sink for Kafka
    Apache Kafka is a distributed streaming platform capable of handling high throughput of data, while ReductStore is a databases for unstructured data optimized for storing and querying along time. - Source: dev.to / 3 months ago
  • 🦿🛴Smarcity garbage reporting automation w/ ollama
    *Push data *(original source image, GPS, timestamp) in a common place (Apache Kafka,...). - Source: dev.to / 3 months ago
  • How to Build & Deploy Scalable Microservices with NodeJS, TypeScript and Docker || A Comprehesive Guide
    RabbitMQ comes with administrative tools to manage user permissions and broker security and is perfect for low latency message delivery and complex routing. In comparison, Apache Kafka architecture provides secure event streams with Transport Layer Security(TLS) and is best suited for big data use cases requiring the best throughput. - Source: dev.to / 3 months ago
View more

What are some alternatives?

When comparing Apache NiFi and Apache Kafka, you can also consider the following products

StatCounter - StatCounter is a simple but powerful real-time web analytics service that helps you track, analyse and understand your visitors so you can make good decisions to become more successful online.

RabbitMQ - RabbitMQ is an open source message broker software.

Histats - Start tracking your visitors in 1 minute!

Apache ActiveMQ - Apache ActiveMQ is an open source messaging and integration patterns server.

AFSAnalytics - AFSAnalytics.

Amazon SQS - Amazon Simple Queue Service is a fully managed message queuing service.