Workflow Orchestration Tools
Schedule, monitor, and manage complex data workflows and pipeline dependencies.
AP
Apache Airflow
Platform to programmatically author, schedule, and monitor workflows.
Orchestrationworkfloworchestration
PR
Prefect
Modern workflow orchestration tool for data pipelines with a Pythonic API.
OrchestrationorchestrationPython
DA
Dagster
Data orchestrator for machine learning, analytics, and ETL workflows.
Orchestrationorchestrationsoftware-defined assets
MA
Mage
Open-source data pipeline tool for building, running, and managing ETL and ML workflows.
Orchestrationorchestrationopen-source
KE
Kestra
Open-source, declarative, event-driven orchestration platform that defines workflows in YAML.
OrchestrationorchestrationYAML
FL
Flyte
Open-source, Kubernetes-native workflow orchestration platform built for scalable ML and data pipelines.
OrchestrationorchestrationML
LU
Luigi
Python package from Spotify for building complex batch job pipelines with dependency resolution.
OrchestrationorchestrationPython
TE
Temporal
Durable execution platform for building reliable, fault-tolerant distributed applications and workflow automation.
Orchestrationorchestrationdistributed
WI
Windmill
Open-source developer platform for turning scripts into workflows, internal tools, and scheduled jobs.
Orchestrationorchestrationopen-source
9 tools