Kestra is an infinitely scalable orchestration and scheduling platform, creating, running, scheduling, and monitoring millions of complex pipelines.
Cost / License
- Free
- Open Source (Apache-2.0)
Platforms
- Mac
- Windows
- Linux
- Online
- Self-Hosted




Metaflow is described as 'Human-friendly Python library that helps scientists and engineers build and manage real-life data science projects. Metaflow was originally developed at Netflix to boost productivity of data scientists who work on a wide variety of projects from classical' and is a workflow automation tool. There are more than 10 alternatives to Metaflow for a variety of platforms, including Linux, Mac, Self-Hosted, SaaS and Windows apps. The best Metaflow alternative is Kestra, which is both free and Open Source. Other great apps like Metaflow are Apache Airflow, Aqueduct MLOps framework, Zenaton and RunDeck.
Kestra is an infinitely scalable orchestration and scheduling platform, creating, running, scheduling, and monitoring millions of complex pipelines.




Airflow is a platform to programmaticaly author, schedule and monitor data pipelines.




Aqueduct is an open-source MLOps framework that allows you to write code in vanilla Python, run that code on any cloud infrastructure you'd like to use, and gain visibility into the execution and performance of your models and predictions.

Zenaton is a developer tool and hosted workflow engine for writing, running and monitoring all of your background processes whether it is a single task or a long running workflow. It allows developers to easily integrate third party services and APIs iby triggering tasks and...




RunDeck is an open source automation service with a web console, command line tools and a WebAPI. It lets you easily run automation tasks across a set of nodes.




StackStorm is a powerful open-source automation platform that wires together all of your apps, services and workflows. It’s extendable, flexible, and built with love for DevOps and ChatOps.
Azkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows.




Shipyard’s your go-to cloud-based DataOps platform for secure data extraction, transformation, reverse ETL, workflow orchestration, monitoring, alerting, and more.

Mage.ai is an open-source data pipeline tool designed to simplify the process of building, running, and maintaining machine learning and data workflows. With an intuitive interface, it allows users to create powerful pipelines for ETL (Extract, Transform, Load) processes, data...



Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.


The Valohai platform makes machine learning in production easy. Data scientists and machine learning engineers can work together to build end-to-end machine learning pipelines that take in data, train a model, and deploy to production automatically.



