Software Alternatives & Reviews
Register | Login

Apache NiFi VS Apache Spark

Compare Apache NiFi VS Apache Spark and see what are their differences

Assembly
Work smarter, not harder. Save 1 day/week with free customizable workflows. Get access to 40+ workflow templates such as Employee Recognition & Engagement. Simplify your day-to-day workflows, increase team productivity & add simplicity to your work. featured
Contents:
  1. » Base Details
  2. » Videos
  3. » Reviews
  4. » Alternatives

Apache NiFi logo Apache NiFi

An easy to use, powerful, and reliable system to process and distribute data.

Apache Spark logo Apache Spark

Apache Spark is an engine for big data processing, with built-in modules for streaming, SQL, machine learning and graph processing.
  • Apache NiFi Landing page
    Landing page //
    2019-01-17
  • Apache Spark Landing page
    Landing page //
    2021-12-31

Apache NiFi videos

+ Add

Forget Duplicating Local Changes: Apache NiFi and the Flow Development Lifecycle (FDLC)

Apache Spark videos

+ Add

Weekly Apache Spark live Code Review -- look at StringIndexer multi-col (Scala) & Python testing

More videos:

  • Review - What's New in Apache Spark 3.0.0
  • Review - Apache Spark for Data Engineering and Analysis - Overview

Category Popularity

0-100% (relative to Apache NiFi and Apache Spark)

Apache NiFi

Apache Spark

Data Integration
100 100%
Data Integration
0% 0
Databases
0 0%
Databases
100% 100
Analytics
100 100%
Analytics
0% 0
Big Data
0 0%
Big Data
100% 100

User comments

Share your experience with using Apache NiFi and Apache Spark. For example, how are they different and which one is better?
Log in or Post with

Reviews

These are some of the external sources and on-site user reviews we've used to compare Apache NiFi and Apache Spark

Apache NiFi Reviews

Top 8 Apache Airflow Alternatives in 2024
Another product by Apache is called NiFi – even though it’s also dedicated to data workflow management, it differs from Apache Airflow in many aspects. First of all, Apache NiFi is a completely web-based tool with a drag&drop interface and no coding. It’s easy to add and configure processors as graph nodes of data workflow, set up routing directions as graph edges, and...
Source: blog.skyvia.com
11 Best FREE Open-Source ETL Tools in 2024
Apache NiFi allows you to automate and manage the flow of information systems. It also enables NiFi to be an effective platform for building scalable and powerful dataflows. NiFi follows the fundamental concept of Flow-Based Programming. It has a highly configurable web-based UI, and houses features such as Data Provenance, Extensibility, and Security features.
Source: hevodata.com
10 Best Airflow Alternatives for 2024
Apache NiFi is a free and open-source application that automates data transfer across systems. The application comes with a web-based user interface to manage scalable directed graphs of data routing, transformation, and system mediation logic. It is a sophisticated and reliable data processing and distribution system. To edit data at runtime, it provides a highly flexible...
Source: hevodata.com
15 Best ETL Tools in 2022 (A Complete Updated List)
Apache Nifi simplifies the data flow between various systems using automation. The data flows consist of processors and a user can create their own processors. These flows can be saved as templates and later can be integrated with more complex flows. These complex flows can then be deployed to multiple servers with minimal efforts.
Source: www.softwaretestinghelp.com
Top 10 Popular Open-Source ETL Tools for 2021
Apache NiFi allows you to automate and manage the flow of information systems. It also enables NiFi to be an effective platform for building scalable and powerful dataflows. NiFi follows the fundamental concept of Flow-Based Programming. It has a highly configurable web-based UI, and houses features such as Data Provenance, Extensibility, and Security features.
Source: hevodata.com

Apache Spark Reviews

15 data science tools to consider using in 2021
Apache Spark is an open source data processing and analytics engine that can handle large amounts of data -- upward of several petabytes, according to proponents. Spark's ability to rapidly process data has fueled significant growth in the use of the platform since it was created in 2009, helping to make the Spark project one of the largest open source communities among big...
Source: searchbusinessanalytics.techtarget.com
Top 15 Kafka Alternatives Popular In 2021
Apache Spark is a well-known, general-purpose, open-source analytics engine for large-scale, core data processing. It is known for its high-performance quality for data processing – batch and streaming with the help of its DAG scheduler, query optimizer, and engine. Data streams are processed in real-time and hence it is quite fast and efficient. Its machine learning...
Source: www.spec-india.com
5 Best-Performing Tools that Build Real-Time Data Pipeline
Apache Spark is an open-source and flexible in-memory framework which serves as an alternative to map-reduce for handling batch, real-time analytics and data processing workloads. It provides native bindings for the Java, Scala, Python, and R programming languages, and supports SQL, streaming data, machine learning and graph processing. From its beginning in the AMPLab at...
Source: www.analyticsinsight.net

Social recommendations and mentions

Based on our record, Apache Spark should be more popular than Apache NiFi. It has been mentiond 56 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.

Apache NiFi mentions (16)

  • Ask HN: What low code platforms are worth using?
    Apache NIFI (https://nifi.apache.org/). It uses the concept of Flow-based programming. Also its so underacknolged but this tool is very flexible. I have used as an Event Bus all the 3rd-Party Integrations. - Source: Hacker News / 7 months ago
  • Help with choosing techstack for a new DE team
    Presently setting up Apache Nifi + Apache MiNiFi for the ETL portion of my work. NiFi was easy enough to figure out; but the docs for MiNiFi have been a pain due to differences between the Java and C++ versions. I then entirely configured it with the Java version so that it was easier to search for answers for the MiNiFi yaml syntax. Source: 10 months ago
  • Json splitting and Rerouting (new to nifi)
    NIFI, like most Apache projects does most of its discussion on its mailing lists, but also has a slack. Source: 12 months ago
  • Recommend ETL tool in Linux
    You might want to give a tool like nifi a try: Https://nifi.apache.org/. Source: about 1 year ago
  • Anki shared decks for Clickhouse and Apache Nifi
    Recently I got a job at a new company and now I need to learn about Clickhouse, Docker, Apache Nifi and Kafka. I've found the decks about Docker and Kafka, but I can't find ones about Clickhouse and Nifi. Https://clickhouse.com/docs/en/intro Https://nifi.apache.org/. Source: about 1 year ago
View more

Apache Spark mentions (56)

  • Groovy 🎷 Cheat Sheet - 01 Say "Hello" from Groovy
    Recently I had to revisit the "JVM languages universe" again. Yes, language(s), plural! Java isn't the only language that uses the JVM. I previously used Scala, which is a JVM language, to use Apache Spark for Data Engineering workloads, but this is for another post 😉. - Source: dev.to / about 2 months ago
  • 🦿🛴Smarcity garbage reporting automation w/ ollama
    Consume data into third party software (then let Open Search or Apache Spark or Apache Pinot) for analysis/datascience, GIS systems (so you can put reports on a map) or any ticket management system. - Source: dev.to / 3 months ago
  • Go concurrency simplified. Part 4: Post office as a data pipeline
    Also, this knowledge applies to learning more about data engineering, as this field of software engineering relies heavily on the event-driven approach via tools like Spark, Flink, Kafka, etc. - Source: dev.to / 4 months ago
  • Five Apache projects you probably didn't know about
    Apache SeaTunnel is a data integration platform that offers the three pillars of data pipelines: sources, transforms, and sinks. It offers an abstract API over three possible engines: the Zeta engine from SeaTunnel or a wrapper around Apache Spark or Apache Flink. Be careful, as each engine comes with its own set of features. - Source: dev.to / 4 months ago
  • Spark – A micro framework for creating web applications in Kotlin and Java
    A JVM based framework named "Spark", when https://spark.apache.org exists? - Source: Hacker News / 11 months ago
View more

What are some alternatives?

When comparing Apache NiFi and Apache Spark, you can also consider the following products

StatCounter - StatCounter is a simple but powerful real-time web analytics service that helps you track, analyse and understand your visitors so you can make good decisions to become more successful online.

Apache Flink - Flink is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations.

Histats - Start tracking your visitors in 1 minute!

Apache Airflow - Airflow is a platform to programmaticaly author, schedule and monitor data pipelines.

AFSAnalytics - AFSAnalytics.

Hadoop - Open-source software for reliable, scalable, distributed computing

Loading...