Top 11 Go Data Analysis Projects

gonum

24 7,249 8.2 Go

Gonum is a set of numeric libraries for the Go programming language. It contains libraries for matrices, statistics, optimization, and more

Project mention: How to set up interface to accept multi-dimension array? | /r/golang | 2023-07-13

But if you want to see what can be done for numeric stuff, check out gonum. Personally, I still wouldn't use Go, and I rather suspect it's still pretty easy to reach for something like what you're trying to do and not find it because Go just can't write that type sensibly, but you can at least see what is available, written by people who disagree with me about Go not being a great language for this.

pachyderm

8 6,074 9.8 Go

Data-Centric Pipelines and Data Versioning

Project mention: Open Source Advent Fun Wraps Up! | dev.to | 2024-01-05

20. Pachyderm | Github | tutorial

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
cloudquery

102 5,581 10.0 Go

The open source high performance ELT framework powered by Apache Arrow

Project mention: We might want to regularly keep track of how important each server is | news.ycombinator.com | 2024-02-06

Check out CloudQuery - https://github.com/cloudquery/cloudquery for an easy cloud asset inventory.

flyte

31 4,761 9.8 Go

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Project mention: First 15 Open Source Advent projects | dev.to | 2023-12-15

9. Flyte by Union AI | Github | tutorial

octosql

34 4,695 1.2 Go

OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.

Project mention: Wazero: Zero dependency WebAssembly runtime written in Go | news.ycombinator.com | 2023-07-01

Never got it to anything close to a finished state, instead moving on to doing the same prototype in llvm and then cranelift.
That said, here's some of the wazero-based code on a branch - https://github.com/cube2222/octosql/tree/wasm-experiment/was...
It really is just a very very basic prototype.

incubator-devlake

10 2,424 9.9 Go

Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
rill

1 1,338 9.9 Go

Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code. (by rilldata)

Project mention: Governments on GitHub | news.ycombinator.com | 2023-06-09

WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
bacalhau

12 602 9.8 Go

Compute over Data framework for public, transparent, and optionally verifiable computation

Project mention: Deno Cron | news.ycombinator.com | 2023-11-29

This is really interesting - we’ve tried really hard to solve some of these with Bacalhau[1] - a much simpler distributed compute platform. Would love your feedback!
[1] https://github.com/bacalhau-project/bacalhau
Disclosure: I confounded Bacalhau

Dataplane

1 183 8.3 Go

Dataplane is a data platform that makes it easy to construct a data mesh with automated data pipelines and workflows.
go-dataframe

4 62 6.9 Go

A simple package to abstract away the process of creating usable DataFrames for data analytics. This package is heavily inspired by the amazing Python library, Pandas.

Project mention: How is Go in data analytics? | /r/golang | 2023-05-25

Just use my library go-dataframe and you’ll be good to go!

rtdl

2 43 0.0 Go

rtdl makes it easy to build and maintain a real-time data lake (by realtimedatalake)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).