Powerful document editing and collaboration in your app or environment. Ultimate security, API and 30+ ready connectors, SaaS or on-premises Learn more →
Top 9 Go Workflow engine Projects
Workflow engine for KubernetesProject mention: What are some good self-hosted CI/CD tools where pipeline steps run in docker containers? | reddit.com/r/devops | 2023-05-14
Drone, or Tekton, Argo Workflows if you’re on k8s
Temporal serviceProject mention: Temporal .NET – Deterministic Workflow Authoring in .NET | news.ycombinator.com | 2023-05-03
Correct, the workflow's guarantee to always complete executing independent of hardware failures is dependent on the database not losing data. You host your workflow code with Temporal's Worker library, which talks to an instance of the Temporal Server , which is an open-source set of services (hosted by you or by Temporal Cloud), backed by Cassandra, MySQL, or Postgres.  So for instance increasing Cassandra's replication factor increases your resilience to disk failure.
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
Tool integration platform for KubernetesProject mention: Stupid question? Lens vs OpenLens vs Monokle | reddit.com/r/kubernetes | 2023-05-16
Robust, flexible and resource-efficient pipelines using Go and the commandlineProject mention: Ask HN: What have you created that deserves a second chance on HN? | news.ycombinator.com | 2023-01-26
https://scipipe.org - A pipeline tool for shell commands by a declarative flow-based API in Go
Github link: https://github.com/scipipe/scipipe
There are many pipeline tools for shell commands, but a majority has one or more limitations in their API which makes certain complex pipelines impossible or really hard to write.
We were pushing the limits of all the tools we tried, so developed our own, and implemented it in Go, with a declarative API for defining the data flow dependencies, instead of inventing yet another DSL. This has allowed us great flexibility in developing also complex pipelines, e.g. combining parameter sweeps nested with cross-validation implemented as workflow constructs.
SciPipe is also unique in providing an audit report for every single output of the workflow, in a structured JSON format. A helper tool allows converting these reports to either an HTML report, a PDF, or a Bash script that will generate the one accompanying output file from scratch.
An extra cool things is that, because the audit reports live alongside output files, if you run a scipipe workflow that uses files generated by another scipipe workflow, it will pick up also all the history for the input files generated by this earlier workflow, meaning that you get a 100% complete audit report, even if your analysis spans multiple workflows!
µTask is an automation engine that models and executes business processes declared in yaml. ✏️📋
An experimental distribution of Temporal that runs as a single processProject mention: Python SDK: The Release | dev.to | 2023-03-09
git clone https://github.com/temporalio/temporalite.git cd temporalite go build ./cmd/temporalite
iWF is a platform for developing resilient, fault-tolerant, scalable long running applications. It offers a convenient abstraction for durable timers, background execution with backoff retry, persistence, indexing, message queues, RPC, and more. You will build long-running reliable processes faster than everProject mention: A new Workflow engine to orchestrate micro services for building reliable, fault-tolerant, and scalable applications, faster than ever | reddit.com/r/microservices | 2023-05-24
ONLYOFFICE Docs — document collaboration in your environment. Powerful document editing and collaboration in your app or environment. Ultimate security, API and 30+ ready connectors, SaaS or on-premises
Machine is a workflow/pipeline library for processing data (by whitaker-io)
cronicle is a simple and scalable task scheduler that builds on the foundations of git, golang and standard logging (by jshiv)
Go Workflow engine related posts
Show HN: Capillaries: Distributed data processing with Go and Cassandra
2 projects | news.ycombinator.com | 15 May 2023
Futuristic documentation systems in Python, part 1: aiming for more
3 projects | dev.to | 14 Mar 2023
temporal VS javactrl-kafka - a user suggested alternative
2 projects | 2 Feb 2023
Temporalite: Experimental distribution of Temporal that runs as single process
1 project | news.ycombinator.com | 29 Jan 2023
How to do distributed cronjobs with worker queues?
8 projects | reddit.com/r/golang | 12 Nov 2022
Airflow :: Deploy Apache Airflow on Rancher K3s
3 projects | dev.to | 6 Nov 2022
Developers and Distributed Systems and Dinosaurs, Oh MY!!!
2 projects | dev.to | 15 Sep 2022
A note from our sponsor - ONLYOFFICE
www.onlyoffice.com | 28 May 2023
What are some of the best open-source Workflow engine projects in Go? This list will help you: