Seeking opinions on workflow/DAG orchestration with Go

• gleam

  1 3,373 6.3 Go

  Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly. (by chrislusf)

Gleam

• flyte

  31 4,779 9.8 Go

  Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

  

Flyte

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• temporal

  16 9,940 9.9 Go

  Temporal service

  

Temporal

• goflow

  1 1,035 6.5 CSS

  A Golang based high performance, scalable and distributed workflow framework (by s8sg)

GoFlow

• Benthos

  76 7,617 9.7 Go

  Fancy stream processing made operationally mundane

  

Benthos

• flower

  1 31 10.0 Go

  [Proof of Concept] This is the simple implementation of the workflow engine that manages workflows composed of DAGs. (by d-tsuji)

Flower

• optimus

  5 737 4.4 Go

  Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management. (by raystack)

  

this may help: https://github.com/odpf/optimus

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• argo

  43 14,314 9.8 Go

  Workflow Engine for Kubernetes

  

If you’re using K8s there’s Argo workflows : https://argoproj.github.io/argo-workflows/

Suggest a related project