Top 10 orchestration-framework Open-Source Projects

• luigi

  14 17,356 6.3 Python

  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

  

Project mention: Ask HN: What is the correct way to deal with pipelines? | news.ycombinator.com | 2023-09-21

I agree there are many options in this space. Two others to consider:

- https://airflow.apache.org/

- https://github.com/spotify/luigi

There are also many Kubernetes based options out there. For the specific use case you specified, you might even consider a plain old Makefile and incrond if you expect these all to run on a single host and be triggered by a new file showing up in a directory…

• zeebe

  6 3,038 10.0 Java

  Distributed Workflow Engine for Microservices Orchestration

  

Project mention: Is there a product that can orchestrate running jobs? | /r/kubernetes | 2023-07-12

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Zato

  3 1,074 9.9 Python

  ESB, SOA, REST, APIs and Cloud Integrations in Python

• ActiveWorkflow

  1 792 4.2 Ruby

  Polyglot workflows without leaving the comfort of your technology stack.

  

• Runbook

  2 724 0.0 Ruby

  A framework for gradual system automation

  

• bacalhau

  12 614 9.8 Go

  Compute over Data framework for public, transparent, and optionally verifiable computation

  

Project mention: Deno Cron | news.ycombinator.com | 2023-11-29

This is really interesting - we’ve tried really hard to solve some of these with Bacalhau[1] - a much simpler distributed compute platform. Would love your feedback!

[1] https://github.com/bacalhau-project/bacalhau

Disclosure: I confounded Bacalhau

• endly

  0 256 5.5 Go

  End to end functional test and automation framework

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• Orkestra

  4 102 0.0 Go

  Orkestra is a cloud-native release orchestration and lifecycle management (LCM) platform for the fine-grained orchestration of inter-dependent helm charts and their dependencies (by Azure)

  

• Domain

  1 44 7.9 C#

  An choreographer of core-domains, facilitating the abstraction of infrastructure, for a scalable domain model. (by Whaally)

  

Project mention: I wrote a library to simplify the development of a domain model. What do you think? | /r/csharp | 2023-09-06

• chain-z

  1 1 6.0 Java

  Asynchronous execution made simple

  

Project mention: FLaNK Stack Weekly for 07August2023 | dev.to | 2023-08-07

orchestration-framework related posts

• Is there a product that can orchestrate running jobs?

  2 projects | /r/kubernetes | 12 Jul 2023

• Moving Config Docs From YAML to Markdown

  3 projects | dev.to | 3 May 2023

• Camunda's Hacktoberfest 2022

  1 project | dev.to | 4 Oct 2022

• Back-end for sending out emails after a certain delay

  3 projects | /r/node | 9 Sep 2022

• In the context of Python what is a Bob Job?

  2 projects | /r/learnpython | 10 Jul 2022

• Apache Airflow. How to make the complex workflow as an easy job

  1 project | dev.to | 20 Feb 2022

• Do you use Model-Driven Engineering in your jobs?

  2 projects | news.ycombinator.com | 5 Nov 2021
• A note from our sponsor - SaaSHub
  www.saashub.com | 14 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com