Best job scheduler in 2022? (Airflow / Dagster / Prefect / Luigi / other)

1

Metaflow

#Workflow Automation #DevOps Tools #Workflows 12 social mentions

2

Node-RED

A bit off the beaten path, but I've been toying with the idea of using Node Red as a job scheduler. There are timer plugins to launch flows at specified times, email plugins that can catch flow errors, automatic version control plugins, an exec command with support for stdout, stderr, error code (you could build a subflow to do the logging automatically). For reading logs you could maybe create a "dashboard" but I've never used that feature. It does support multiple users but I don't know if authentication is as granular as the job/flow level.

#DevOps Tools #Automation #API Tools 120 social mentions