Kestra.io
Dagster
n8n.io
Prefect.io
Make.com
AWS Step Functions
Apache NiFi
Astronomer
Apache Airflow
Make.com
ifttt
Microsoft Power Automate
Pipefy
Pushwoosh
Kissflow
Process Street
Kestra.io Apache AirflowNo features have been listed yet.
Apache Airflow is recommended for data engineers, data scientists, and IT professionals who need to automate and manage workflows. It is particularly suited for organizations handling large-scale data processing tasks, requiring integration with various systems, and those looking to deploy machine learning pipelines or ETL processes.
Based on our record, Apache Airflow seems to be a lot more popular than Kestra.io. While we know about 75 links to Apache Airflow, we've tracked only 1 mention of Kestra.io. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
I'd recommend Kestra[1] since it can be run on a single node [1] https://kestra.io/. - Source: Hacker News / 10 months ago
Is this really true? Something that can be supported by clear evidence? I’ve seen this trotted out many times, but it seems like there are interesting Apache projects: https://airflow.apache.org/ https://iceberg.apache.org/ https://kafka.apache.org/ https://superset.apache.org/. - Source: Hacker News / 3 months ago
Apache Airflow offers simplicity when it comes to scheduling, authoring, and monitoring ML workflows using Python. The tool's greatest advantage is its compatibility with any system or process you are running. This also eliminates manual intervention and increases team productivity, which aligns with the principles of Platform Engineering tools. - Source: dev.to / 4 months ago
Data orchestration tools are key for managing data pipelines in modern workflows. When it comes to tools, Apache Airflow, Dagster, and Flyte are popular tools serving this need, but they serve different purposes and follow different philosophies. Choosing the right tool for your requirements is essential for scalability and efficiency. In this blog, I will compare Apache Airflow, Dagster, and Flyte, exploring... - Source: dev.to / 4 months ago
Data pipelines: Apache Kafka and Airflow are often used for building data pipelines that can continuously feed data to models in production. - Source: dev.to / 5 months ago
This article demonstrates how to work with near real-time and historical data using the dlt package. Whether you need to scale data access across the enterprise or provide historical data for post-event analysis, you can use the same framework to provide customer data. In a future article, I'll demonstrate how to use dlt with a workflow orchestrator such as Apache Airflow or Dagster.``. - Source: dev.to / 6 months ago
Dagster - The cloud-native open source orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability.
Make.com - Tool for workflow automation (Former Integromat)
n8n.io - Free and open fair-code licensed node based Workflow Automation Tool. Easily automate tasks across different services.
ifttt - IFTTT puts the internet to work for you. Create simple connections between the products you use every day.
Prefect.io - Prefect offers modern workflow orchestration tools for building, observing & reacting to data pipelines efficiently.
Microsoft Power Automate - Microsoft Power Automate is an automation platform that integrates DPA, RPA, and process mining. It lets you automate your organization at scale using low-code and AI.