Apache Airflow Alternatives

Apache Airflow is described as 'Airflow is a platform to programmaticaly author, schedule and monitor data pipelines' and is an app in the development category. There are more than 25 alternatives to Apache Airflow for a variety of platforms, including Web-based, Linux, SaaS, Self-Hosted and Windows apps. The best Apache Airflow alternative is n8n, which is free. Other great apps like Apache Airflow are Automa, Google Opal, Gumloop and Kestra.

Copy a direct link to this comment to your clipboard
Apache Airflow alternatives page was last updated

Alternatives list

  1. Shipyard’s your go-to cloud-based DataOps platform for secure data extraction, transformation, reverse ETL, workflow orchestration, monitoring, alerting, and more.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Online
    • Software as a Service (SaaS)
     
  2. Luigi icon
     Like

    Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

    14 Luigi alternatives

    Cost / License

    • Free
    • Open Source

    Platforms

    • Linux
     
  3. Metaflow icon
     Like

    Metaflow is a human-friendly Python library that helps scientists and engineers build and manage real-life data science projects. Metaflow was originally developed at Netflix to boost productivity of data scientists who work on a wide variety of projects from classical...

    Cost / License

    Application type

    Platforms

    • Self-Hosted
     
  4. CloudReactor icon
     1 like

    Easily deploy, schedule, manage and monitor tasks and workflows. Create complex workflows in seconds. Deploy tasks to AWS.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
     
  5. Dagster icon
     Like

    Dagster is a cloud-native data pipeline orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability.

    3 Dagster alternatives

    Cost / License

    Application type

    Platforms

    • Online
     
  6. Temporal icon
     Like

    What if your code never failed? Failures happen. Temporal makes them irrelevant. Build applications that never lose state, even when everything else fails.

    15 Temporal alternatives

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    • Self-Hosted
    • Docker
     
  7. Velda icon
     Like

    Velda is a dev-environment that allows developers to run jobs with cloud compute resource like GPUs without any other extra setup.

    Cost / License

    Platforms

    • Self-Hosted
    • Software as a Service (SaaS)
    • Online
     
  8. Prefect icon
     Like

    Prefect is an orchestrator for data-intensive workflows. It's the simplest way to transform any Python function into a unit of work that can be observed and orchestrated. With Prefect, you can build resilient, dynamic workflows that react to the world around them and recover...

    Cost / License

    Platforms

    • Online
    • Self-Hosted
     
  9.  Like

    Dataflow based workflow framework. Contribute to flowsaber/flowsaber development by creating an account on GitHub.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
     
  10. TaskYak icon
     Like

    The TaskYak is a distributed, team-based task orchestration platform. It lets you easily create scheduled or complex job workflows that your team can manage through a simple, self-hosted, and intuitive dashboard.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Windows
    • Linux
     
  11. Shuffle is a low-code / no-code workflow automation program primarily aimed at security automation. Features include:

    Cost / License

    Platforms

    • Windows
    • Linux
    • Docker
     
  12. Mage.ai icon
     Like

    Mage.ai is an open-source data pipeline tool designed to simplify the process of building, running, and maintaining machine learning and data workflows. With an intuitive interface, it allows users to create powerful pipelines for ETL (Extract, Transform, Load) processes, data...

    Cost / License

    Platforms

    • Self-Hosted
     
You are at page 3 of Apache Airflow alternatives