Apache NiFi VS Singer

Apache NiFi

An easy to use, powerful, and reliable system to process and distribute data.

Singer

Simple, Composable, Open Source ETL

Landing page //
2019-01-17

Landing page //
2019-09-08

Forget Duplicating Local Changes: Apache NiFi and the Flow Development Lifecycle (FDLC)

Singer videos

+ Add

30 Day Vocal Transformation | Horrible Singer Learns to Sing + SINGR Review

Category Popularity

0-100% (relative to Apache NiFi and Singer)

Singer

Analytics

100 100%

Analytics

0% 0

Data Integration

77 77%

Data Integration

23% 23

ETL

70 70%

ETL

30% 30

Workflow Automation

100 100%

Workflow Automation

0% 0

User comments

Share your experience with using Apache NiFi and Singer. For example, how are they different and which one is better?

Reviews

These are some of the external sources and on-site user reviews we've used to compare Apache NiFi and Singer

Apache NiFi Reviews

Top 8 Apache Airflow Alternatives in 2024

Another product by Apache is called NiFi – even though it’s also dedicated to data workflow management, it differs from Apache Airflow in many aspects. First of all, Apache NiFi is a completely web-based tool with a drag&drop interface and no coding. It’s easy to add and configure processors as graph nodes of data workflow, set up routing directions as graph edges, and...

Source: blog.skyvia.com

11 Best FREE Open-Source ETL Tools in 2024

Apache NiFi allows you to automate and manage the flow of information systems. It also enables NiFi to be an effective platform for building scalable and powerful dataflows. NiFi follows the fundamental concept of Flow-Based Programming. It has a highly configurable web-based UI, and houses features such as Data Provenance, Extensibility, and Security features.

Source: hevodata.com

10 Best Airflow Alternatives for 2024

Apache NiFi is a free and open-source application that automates data transfer across systems. The application comes with a web-based user interface to manage scalable directed graphs of data routing, transformation, and system mediation logic. It is a sophisticated and reliable data processing and distribution system. To edit data at runtime, it provides a highly flexible...

Source: hevodata.com

15 Best ETL Tools in 2022 (A Complete Updated List)

Apache Nifi simplifies the data flow between various systems using automation. The data flows consist of processors and a user can create their own processors. These flows can be saved as templates and later can be integrated with more complex flows. These complex flows can then be deployed to multiple servers with minimal efforts.

Source: www.softwaretestinghelp.com

Top 10 Popular Open-Source ETL Tools for 2021

Apache NiFi allows you to automate and manage the flow of information systems. It also enables NiFi to be an effective platform for building scalable and powerful dataflows. NiFi follows the fundamental concept of Flow-Based Programming. It has a highly configurable web-based UI, and houses features such as Data Provenance, Extensibility, and Security features.

Source: hevodata.com

Singer Reviews

10 Best Open Source ETL Tools for Data Integration

One thing to keep in mind is that Singer is a script-based ETL tool; you have to write specific codes to perform ETL duties. Data extraction scripts are called ‘tags,’ and data loading scripts are termed ‘targets.’ These scripts can be run in any sequence or combination to execute the ETL processes of your choice. Singer further allows you to create your own tags and targets...

Source: testsigma.com

11 Best FREE Open-Source ETL Tools in 2024

Some Open-Source ETL Tools have a command line interface. Singer is one such tool that uses a command-line interface to allow users to build modular ETL Pipelines using its “Tap” and “Target” modules. Singer provides a framework that allows users to connect data sources to storage locations directly.

Source: hevodata.com

Top 10 Popular Open-Source ETL Tools for 2021

Some Open-Source ETL Tools have a command line interface. Singer is one such tool that uses a command-line interface to allow users to build modular ETL Pipelines using its “Tap” and “Target” modules. Singer provides a framework that allows users to connect data sources to storage locations directly.

Source: hevodata.com

Top ETL Tools For 2021...And The Case For Saying "No" To ETL

As with Fivetran, Airbyte integrates with dbt for transformations, making it an ELT tool. However, contrary to Singer, Airbyte uses one single open-source repo to standardize and consolidate all developments from the community, leading to higher quality connectors. They built a compatibility layer with Singer so that Singer taps can run within Airbyte.

Source: blog.panoply.io

Social recommendations and mentions

Based on our record, Apache NiFi should be more popular than Singer. It has been mentiond 18 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.

Apache NiFi mentions (18)

NSA Ghidra open-source reverse engineering framework
They also contributed Apache NiFi but that was much earlier: https://nifi.apache.org/. - Source: Hacker News / 16 days ago
Workbench for Apache NiFi data flows
This article presents the concept and implementation of a universal workbench for Apache NiFi data flows. - Source: dev.to / 28 days ago
Ask HN: What low code platforms are worth using?
Apache NIFI (https://nifi.apache.org/). It uses the concept of Flow-based programming. Also its so underacknolged but this tool is very flexible. I have used as an Event Bus all the 3rd-Party Integrations. - Source: Hacker News / 9 months ago
Help with choosing techstack for a new DE team
Presently setting up Apache Nifi + Apache MiNiFi for the ETL portion of my work. NiFi was easy enough to figure out; but the docs for MiNiFi have been a pain due to differences between the Java and C++ versions. I then entirely configured it with the Java version so that it was easier to search for answers for the MiNiFi yaml syntax. Source: 11 months ago
Json splitting and Rerouting (new to nifi)
NIFI, like most Apache projects does most of its discussion on its mailing lists, but also has a slack. Source: about 1 year ago

Singer mentions (7)

Why do companies still build data ingestion tooling instead of using a third-party tool like Airbyte?
Coincidently, I saw a presentation today on a nice half-way-house solution: using embeddable Python libraries like Sling and dlt - both open-source. See https://www.youtube.com/watch?v=gAqOLgG2iYY There is also singer.io which is more of a protocol than a library, but can also be installed although it looks like it is a true community effort and not so well maintained. Source: 6 months ago
Data sources episode 2: AWS S3 to Postgres Data Sync using Singer
Singer is an open-source framework for data ingestion, which provides a standardized way to move data between various data sources and destinations (such as databases, APIs, and data warehouses). Singer offers a modular approach to data extraction and loading by leveraging two main components: Taps (data extractors) and Targets (data loaders). This design makes it an attractive option for data ingestion for... - Source: dev.to / about 1 year ago
CDC (Change Data Capture) with 3rd party APIs
Or you could build your own such system and run it on Airflow, Prefect, Dagster, etc. Check out the Singer project for a suite of Python packages designed for such a task. Quality varies greatly, though. Source: over 1 year ago
Looking to build a database for BI reports
This is good advice and I think Airbyte created a great product here. I tried singer.io and pipewise but Airbyte is much better in my opinion and I love the UI. Source: almost 3 years ago
Recommendation for approach for populating and refreshing new data lake
Suspect my question should have been regarding FREE systems, rather than BUYING a system. Sounds like singer.io will do what I need. Source: about 3 years ago