Software Alternatives & Reviews

Apache NiFi VS Spark Streaming

Compare Apache NiFi VS Spark Streaming and see what are their differences

Apache NiFi logo Apache NiFi

An easy to use, powerful, and reliable system to process and distribute data.

Spark Streaming logo Spark Streaming

Spark Streaming makes it easy to build scalable and fault-tolerant streaming applications.
  • Apache NiFi Landing page
    Landing page //
    2019-01-17
  • Spark Streaming Landing page
    Landing page //
    2022-01-10

Apache NiFi videos

Forget Duplicating Local Changes: Apache NiFi and the Flow Development Lifecycle (FDLC)

Spark Streaming videos

Spark Streaming Vs Kafka Streams || Which is The Best for Stream Processing?

More videos:

  • Tutorial - Spark Streaming Vs Structured Streaming Comparison | Big Data Hadoop Tutorial

Category Popularity

0-100% (relative to Apache NiFi and Spark Streaming)
Analytics
79 79%
21% 21
Stream Processing
0 0%
100% 100
Data Integration
100 100%
0% 0
Data Management
0 0%
100% 100

User comments

Share your experience with using Apache NiFi and Spark Streaming. For example, how are they different and which one is better?
Log in or Post with

Reviews

These are some of the external sources and on-site user reviews we've used to compare Apache NiFi and Spark Streaming

Apache NiFi Reviews

Top 8 Apache Airflow Alternatives in 2024
Another product by Apache is called NiFi – even though it’s also dedicated to data workflow management, it differs from Apache Airflow in many aspects. First of all, Apache NiFi is a completely web-based tool with a drag&drop interface and no coding. It’s easy to add and configure processors as graph nodes of data workflow, set up routing directions as graph edges, and...
Source: blog.skyvia.com
11 Best FREE Open-Source ETL Tools in 2024
Apache NiFi allows you to automate and manage the flow of information systems. It also enables NiFi to be an effective platform for building scalable and powerful dataflows. NiFi follows the fundamental concept of Flow-Based Programming. It has a highly configurable web-based UI, and houses features such as Data Provenance, Extensibility, and Security features.
Source: hevodata.com
10 Best Airflow Alternatives for 2024
Apache NiFi is a free and open-source application that automates data transfer across systems. The application comes with a web-based user interface to manage scalable directed graphs of data routing, transformation, and system mediation logic. It is a sophisticated and reliable data processing and distribution system. To edit data at runtime, it provides a highly flexible...
Source: hevodata.com
15 Best ETL Tools in 2022 (A Complete Updated List)
Apache Nifi simplifies the data flow between various systems using automation. The data flows consist of processors and a user can create their own processors. These flows can be saved as templates and later can be integrated with more complex flows. These complex flows can then be deployed to multiple servers with minimal efforts.
Top 10 Popular Open-Source ETL Tools for 2021
Apache NiFi allows you to automate and manage the flow of information systems. It also enables NiFi to be an effective platform for building scalable and powerful dataflows. NiFi follows the fundamental concept of Flow-Based Programming. It has a highly configurable web-based UI, and houses features such as Data Provenance, Extensibility, and Security features.
Source: hevodata.com

Spark Streaming Reviews

We have no reviews of Spark Streaming yet.
Be the first one to post

Social recommendations and mentions

Based on our record, Apache NiFi should be more popular than Spark Streaming. It has been mentiond 16 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.

Apache NiFi mentions (16)

  • Ask HN: What low code platforms are worth using?
    Apache NIFI (https://nifi.apache.org/). It uses the concept of Flow-based programming. Also its so underacknolged but this tool is very flexible. I have used as an Event Bus all the 3rd-Party Integrations. - Source: Hacker News / 8 months ago
  • Help with choosing techstack for a new DE team
    Presently setting up Apache Nifi + Apache MiNiFi for the ETL portion of my work. NiFi was easy enough to figure out; but the docs for MiNiFi have been a pain due to differences between the Java and C++ versions. I then entirely configured it with the Java version so that it was easier to search for answers for the MiNiFi yaml syntax. Source: 10 months ago
  • Json splitting and Rerouting (new to nifi)
    NIFI, like most Apache projects does most of its discussion on its mailing lists, but also has a slack. Source: about 1 year ago
  • Recommend ETL tool in Linux
    You might want to give a tool like nifi a try: Https://nifi.apache.org/. Source: about 1 year ago
  • Anki shared decks for Clickhouse and Apache Nifi
    Recently I got a job at a new company and now I need to learn about Clickhouse, Docker, Apache Nifi and Kafka. I've found the decks about Docker and Kafka, but I can't find ones about Clickhouse and Nifi. Https://clickhouse.com/docs/en/intro Https://nifi.apache.org/. Source: about 1 year ago
View more

Spark Streaming mentions (3)

  • Choosing Between a Streaming Database and a Stream Processing Framework in Python
    Other stream processing engines (such as Flink and Spark Streaming) provide SQL interfaces too, but the key difference is a streaming database has its storage. Stream processing engines require a dedicated database to store input and output data. On the other hand, streaming databases utilize cloud-native storage to maintain materialized views and states, allowing data replication and independent storage scaling. - Source: dev.to / 3 months ago
  • Machine Learning Pipelines with Spark: Introductory Guide (Part 1)
    Spark Streaming: The component for real-time data processing and analytics. - Source: dev.to / over 1 year ago
  • Spark for beginners - and you
    Is a big data framework and currently one of the most popular tools for big data analytics. It contains libraries for data analysis, machine learning, graph analysis and streaming live data. In general Spark is faster than Hadoop, as it does not write intermediate results to disk. It is not a data storage system. We can use Spark on top of HDFS or read data from other sources like Amazon S3. It is the designed... - Source: dev.to / over 2 years ago

What are some alternatives?

When comparing Apache NiFi and Spark Streaming, you can also consider the following products

StatCounter - StatCounter is a simple but powerful real-time web analytics service that helps you track, analyse and understand your visitors so you can make good decisions to become more successful online.

Confluent - Confluent offers a real-time data platform built around Apache Kafka.

Histats - Start tracking your visitors in 1 minute!

Amazon Kinesis - Amazon Kinesis services make it easy to work with real-time streaming data in the AWS cloud.

AFSAnalytics - AFSAnalytics.

Google Cloud Dataflow - Google Cloud Dataflow is a fully-managed cloud service and programming model for batch and streaming big data processing.