-
An easy to use, powerful, and reliable system to process and distribute data.Pricing:
- Open Source
#Analytics #Web Analytics #Mobile Analytics 18 social mentions
-
Dramatiq is a fast and reliable distributed task processing library for Python 3.Pricing:
- Open Source
#Data Integration #Stream Processing #Web Service Automation 8 social mentions
-
Azkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs.Pricing:
- Open Source
I used this once, was pretty nice: https://azkaban.github.io/.
#DevOps Tools #Workflow Automation #Workflows 3 social mentions
-
Apache Kafka is an open-source message broker project developed by the Apache Software Foundation written in Scala.Pricing:
- Open Source
Kafka is a bit of a sledgehammer to crack a nut. It's designed to be massively scaleable and fault-tolerant, and that comes at the expense of having to run two clusters of three(ish) nodes each, where one set is the queue itself and the other set is orchestrator nodes. "Big operational problem" means that it's a lot to set up and maintain.
#Stream Processing #Data Integration #ETL 121 social mentions
Discuss: What is your favourite task queuing framework?
Related Posts
15+ Best Cloud ETL Tools
estuary.dev // 9 months ago
Airbyte vs Fivetran vs Estuary
estuary.dev // over 1 year ago
10 Best Airflow Alternatives for 2024
hevodata.com // about 1 year ago
Top 8 Apache Airflow Alternatives in 2024
blog.skyvia.com // 11 months ago
5 Airflow Alternatives for Data Orchestration
kdnuggets.com // 4 months ago
14 Best Open Source ETL Tools For QA Teams In 2024
theqalead.com // 5 months ago