Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems. Learn more →
Top 12 Go Pipeline Projects
-
Project mention: Data on Kubernetes: Part 4 - Argo Workflows: Simplify parallel jobs : Container-native workflow engine for Kubernetes 🔮 | dev.to | 2024-07-28
Remember to meet the prerequisites, including AWS cli, kubectl, terraform and Argo Workflow CLI.
-
InfluxDB
InfluxDB high-performance time series database. Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems.
-
> My CI of choice is [Concourse](https://concourse-ci.org/) which describes itself as "a continuous thing-doer". While it has a bit of a learning curve, I appreciate its declarative model for the pipelines and how it versions every single input to ensure reproducible builds as much as it can.
What's the thought process behind using a CI server - which I thought is mainly for builds - for what essentially is a data pipeline?
-
💚Argo Events 🔥🔥🔥🔥 - Argo Events is an event-driven workflow automation framework for Kubernetes which helps you trigger K8s objects, Argo Workflows, Serverless workloads, etc.
-
onepanel
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
-
-
-
Dataplane
Dataplane is a data platform that makes it easy to construct a data mesh with automated data pipelines and workflows.
-
CodeRabbit
CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
-
mongo-go-pagination
Golang Mongodb Pagination for official mongodb/mongo-go-driver package which supports both normal queries and Aggregation pipelines with all information like Total records, Page, Per Page, Previous, Next, Total Page and query results.
-
-
-
kubernetes-operator-roiergasias
'Roiergasias' kubernetes operator is meant to address a fundamental requirement of any data science / machine learning project running their pipelines on Kubernetes - which is to quickly provision a declarative data pipeline (on demand) for their various project needs using simple kubectl commands. Basically, implementing the concept of No Ops. The fundamental principle is to utilise best of docker, kubernetes and programming language features to run a workflow with minimal workflow definition s
-
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Go Pipelines discussion
Go Pipelines related posts
-
Tracking Supermarket Prices with Playwright
-
Ask HN: What do you use to run background jobs?
-
How to host React/Next "Cheaply" with a global audience? (NGO needs help)
-
Cicada - Build CI pipelines using TypeScript
-
Unpopular opinion: CI/CD engines are an awful idea
-
You Want Modules, Not Microservices
-
Best tool for automated and reproducible build?
-
A note from our sponsor - InfluxDB
influxdata.com | 24 Apr 2025
Index
What are some of the best open-source Pipeline projects in Go? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | argo | 15,572 |
| 2 | Concourse | 7,540 |
| 3 | argo-events | 2,465 |
| 4 | onepanel | 723 |
| 5 | triggers | 561 |
| 6 | zerocopy | 546 |
| 7 | Dataplane | 226 |
| 8 | mongo-go-pagination | 131 |
| 9 | pipeline-go | 56 |
| 10 | nanobus | 11 |
| 11 | kubernetes-operator-roiergasias | 7 |
| 12 | release-dash | 3 |
Sponsored
InfluxDB high-performance time series database
Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems.
influxdata.com