Luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs.
Some of the top features or benefits of Luigi are: Scalability, Task Dependencies, Integration, Visualization, and Extensible. You can visit the info page to learn more.
Luigi Alternatives & Competitors
The best Luigi alternatives based on verified products, community votes, reviews and other factors.
Filter:
12
Open-Source Alternatives.
Latest update:
-
Airflow is a platform to programmaticaly author, schedule and monitor data pipelines.
Key Apache Airflow features:
Scalability Extensibility Visualization Flexibility
-
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
-
Modern PSA and RMM Software for MSP's and IT Teams.
Key SuperOps features:
User-Friendly Interface Comprehensive ITSM Tools Automation Capabilities Integration Options
-
The cloud-native open source orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability.
Key Dagster features:
Modular Design Type Safety Integrated Scheduler Rich Metadata
-
Free and open fair-code licensed node based Workflow Automation Tool. Easily automate tasks across different services.
Key n8n.io features:
Open Source Flexibility Extensive Integrations Self-hosting Option
-
Prefect offers modern workflow orchestration tools for building, observing & reacting to data pipelines efficiently.
-
Tool for workflow automation (Former Integromat).
Key Make.com features:
Ease of Use Integration Options Custom Workflows Scalability
-
AWS Step Functions makes it easy to coordinate the components of distributed applications and microservices using visual workflows.
Key AWS Step Functions features:
Orchestration Visual Workflow Error Handling Scalability
-
An easy to use, powerful, and reliable system to process and distribute data.
Key Apache NiFi features:
User-Friendly Interface Extensive Connector Support Real-time Data Processing Scalability
-
Capture every user event and route them anywhere. Automatically.
Key Astronomer features:
Managed Airflow Integration and Extensibility User-friendly Interface Scalability
-
Framework for real-life data science; build, improve, and operate end-to-end workflows.
Key Metaflow features:
Ease of Use Scalability Versioning Integration with Popular Tools
-
StackStorm is a powerful open-source automation platform that wires together all of your apps...
Key StackStorm features:
Open Source Event-Driven Automation Flexible and Extensible Active Community
-
An open-source framework for data science code.
Key Kedro features:
Modular Design Pipeline Abstraction Reproducibility Version Control
-
ProActive Workflows & Scheduling is a java-based cross-platform workflow scheduler and resource manager that is able to run workflow tasks in multiple languages and multiple environments: Windows, Linux, Mac, Unix, etc.
Key Activeeon features:
Scalability Automation Flexibility Cost Efficiency