Go Workflow engine

Open-source Go projects categorized as Workflow engine

Top 9 Go Workflow engine Projects

  • argo

    Workflow engine for Kubernetes

    Project mention: What are some good self-hosted CI/CD tools where pipeline steps run in docker containers? | reddit.com/r/devops | 2023-05-14

    Drone, or Tekton, Argo Workflows if you’re on k8s

  • temporal

    Temporal service

    Project mention: Temporal .NET – Deterministic Workflow Authoring in .NET | news.ycombinator.com | 2023-05-03

    Correct, the workflow's guarantee to always complete executing independent of hardware failures is dependent on the database not losing data. You host your workflow code with Temporal's Worker library, which talks to an instance of the Temporal Server [1], which is an open-source set of services (hosted by you or by Temporal Cloud), backed by Cassandra, MySQL, or Postgres. [2] So for instance increasing Cassandra's replication factor increases your resilience to disk failure.

    [1] https://github.com/temporalio/temporal

    [2] https://docs.temporal.io/clusters#persistence

  • InfluxDB

    Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  • devtron

    Tool integration platform for Kubernetes

    Project mention: Stupid question? Lens vs OpenLens vs Monokle | reddit.com/r/kubernetes | 2023-05-16
  • scipipe

    Robust, flexible and resource-efficient pipelines using Go and the commandline

    Project mention: Ask HN: What have you created that deserves a second chance on HN? | news.ycombinator.com | 2023-01-26

    https://scipipe.org - A pipeline tool for shell commands by a declarative flow-based API in Go

    Github link: https://github.com/scipipe/scipipe

    There are many pipeline tools for shell commands, but a majority has one or more limitations in their API which makes certain complex pipelines impossible or really hard to write.

    We were pushing the limits of all the tools we tried, so developed our own, and implemented it in Go, with a declarative API for defining the data flow dependencies, instead of inventing yet another DSL. This has allowed us great flexibility in developing also complex pipelines, e.g. combining parameter sweeps nested with cross-validation implemented as workflow constructs.

    SciPipe is also unique in providing an audit report for every single output of the workflow, in a structured JSON format. A helper tool allows converting these reports to either an HTML report, a PDF, or a Bash script that will generate the one accompanying output file from scratch.

    An extra cool things is that, because the audit reports live alongside output files, if you run a scipipe workflow that uses files generated by another scipipe workflow, it will pick up also all the history for the input files generated by this earlier workflow, meaning that you get a 100% complete audit report, even if your analysis spans multiple workflows!

  • uTask

    µTask is an automation engine that models and executes business processes declared in yaml. ✏️📋

  • temporalite

    An experimental distribution of Temporal that runs as a single process

    Project mention: Python SDK: The Release | dev.to | 2023-03-09

    git clone https://github.com/temporalio/temporalite.git cd temporalite go build ./cmd/temporalite

  • iwf

    iWF is a platform for developing resilient, fault-tolerant, scalable long running applications. It offers a convenient abstraction for durable timers, background execution with backoff retry, persistence, indexing, message queues, RPC, and more. You will build long-running reliable processes faster than ever

    Project mention: A new Workflow engine to orchestrate micro services for building reliable, fault-tolerant, and scalable applications, faster than ever | reddit.com/r/microservices | 2023-05-24

    ONLYOFFICE Docs — document collaboration in your environment. Powerful document editing and collaboration in your app or environment. Ultimate security, API and 30+ ready connectors, SaaS or on-premises

  • machine

    Machine is a workflow/pipeline library for processing data (by whitaker-io)

  • cronicle

    cronicle is a simple and scalable task scheduler that builds on the foundations of git, golang and standard logging (by jshiv)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-05-24.

Go Workflow engine related posts


What are some of the best open-source Workflow engine projects in Go? This list will help you:

Project Stars
1 argo 12,941
2 temporal 7,229
3 devtron 3,122
4 scipipe 1,002
5 uTask 896
6 temporalite 512
7 iwf 313
8 machine 129
9 cronicle 19
Clean code begins in your IDE with SonarLint
Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.