Top 9 Go Workflow engine Projects

argo

18 12,941 9.8 Go

Workflow engine for Kubernetes

Project mention: What are some good self-hosted CI/CD tools where pipeline steps run in docker containers? | reddit.com/r/devops | 2023-05-14

Drone, or Tekton, Argo Workflows if you’re on k8s
temporal

5 7,229 7.8 Go

Temporal service

Project mention: Temporal .NET – Deterministic Workflow Authoring in .NET | news.ycombinator.com | 2023-05-03

Correct, the workflow's guarantee to always complete executing independent of hardware failures is dependent on the database not losing data. You host your workflow code with Temporal's Worker library, which talks to an instance of the Temporal Server [1], which is an open-source set of services (hosted by you or by Temporal Cloud), backed by Cassandra, MySQL, or Postgres. [2] So for instance increasing Cassandra's replication factor increases your resilience to disk failure.
[1] https://github.com/temporalio/temporal
[2] https://docs.temporal.io/clusters#persistence
InfluxDB

www.influxdata.com
sponsored

Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
devtron

30 3,122 9.7 Go

Tool integration platform for Kubernetes

Project mention: Stupid question? Lens vs OpenLens vs Monokle | reddit.com/r/kubernetes | 2023-05-16
scipipe

1 1,002 0.0 Go

Robust, flexible and resource-efficient pipelines using Go and the commandline

Project mention: Ask HN: What have you created that deserves a second chance on HN? | news.ycombinator.com | 2023-01-26

https://scipipe.org - A pipeline tool for shell commands by a declarative flow-based API in Go
Github link: https://github.com/scipipe/scipipe
There are many pipeline tools for shell commands, but a majority has one or more limitations in their API which makes certain complex pipelines impossible or really hard to write.
We were pushing the limits of all the tools we tried, so developed our own, and implemented it in Go, with a declarative API for defining the data flow dependencies, instead of inventing yet another DSL. This has allowed us great flexibility in developing also complex pipelines, e.g. combining parameter sweeps nested with cross-validation implemented as workflow constructs.
SciPipe is also unique in providing an audit report for every single output of the workflow, in a structured JSON format. A helper tool allows converting these reports to either an HTML report, a PDF, or a Bash script that will generate the one accompanying output file from scratch.
An extra cool things is that, because the audit reports live alongside output files, if you run a scipipe workflow that uses files generated by another scipipe workflow, it will pick up also all the history for the input files generated by this earlier workflow, meaning that you get a 100% complete audit report, even if your analysis spans multiple workflows!
uTask

0 896 7.4 Go

µTask is an automation engine that models and executes business processes declared in yaml. ✏️📋
temporalite

5 512 8.5 Go

An experimental distribution of Temporal that runs as a single process

Project mention: Python SDK: The Release | dev.to | 2023-03-09

git clone https://github.com/temporalio/temporalite.git cd temporalite go build ./cmd/temporalite
iwf

7 313 10.0 Go

iWF is a platform for developing resilient, fault-tolerant, scalable long running applications. It offers a convenient abstraction for durable timers, background execution with backoff retry, persistence, indexing, message queues, RPC, and more. You will build long-running reliable processes faster than ever

Project mention: A new Workflow engine to orchestrate micro services for building reliable, fault-tolerant, and scalable applications, faster than ever | reddit.com/r/microservices | 2023-05-24
ONLYOFFICE

www.onlyoffice.com
sponsored

ONLYOFFICE Docs — document collaboration in your environment. Powerful document editing and collaboration in your app or environment. Ultimate security, API and 30+ ready connectors, SaaS or on-premises
machine

0 129 1.2 Go

Machine is a workflow/pipeline library for processing data (by whitaker-io)
cronicle

0 19 0.0 Go

cronicle is a simple and scalable task scheduler that builds on the foundations of git, golang and standard logging (by jshiv)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-05-24.