Azkaban
Apache Airflow
Metaflow
Luigi
Jenkins
RunDeck
Apache Oozie
Portainer
Apache Kylin
Apache Druid
Spring Batch
Google BigQuery
Amazon Redshift
Apache Spark
jq
Greenplum Database
Azkaban Apache KylinBased on our record, Azkaban should be more popular than Apache Kylin. It has been mentiond 3 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Not sure if https://azkaban.github.io/ would fit your use case. Source: about 2 years ago
I used this once, was pretty nice: https://azkaban.github.io/. Source: about 2 years ago
Apache Azkaban is a batch workflow job scheduler to help developers run Hadoop jobs. The open-sourced platform “resolves ordering through job dependencies” and offers an intuitive web interface to help users maintain and track workflows. Source: about 2 years ago
A Kafka-based data integration platform will be a good fit here. The services can add events to different topics in a broker whenever there is a data update. Kafka consumers corresponding to each of the services can monitor these topics and make updates to the data in real-time. It is also possible to create a unified data store through the same integration platform. Developers can implement a unified store either... - Source: dev.to / almost 2 years ago
Apache Airflow - Airflow is a platform to programmaticaly author, schedule and monitor data pipelines.
Apache Druid - Fast column-oriented distributed data store
Metaflow - Framework for real-life data science; build, improve, and operate end-to-end workflows.
Spring Batch - Level up your Java code and explore what Spring can do for you.
Luigi - Luigi is a Python module that helps you build complex pipelines of batch jobs.
Google BigQuery - A fully managed data warehouse for large-scale data analytics.
