Top 7 Go Data Analysis Projects

gop

4 8,419 9.5 Go

The Go+ programming language is designed for engineering, STEM education, and data science.

Project mention: Rob Pike's simple C regex matcher in Go | news.ycombinator.com | 2022-08-12

> That said, I hope someday Go adds the "?" return-operator
Same here. I think this is my biggest code-reading pain point as a go developer. I'm toying with the idea of playing more with Go+
https://github.com/goplus/gop/blob/main/doc/docs.md#error-ha...
gonum

7 6,440 7.3 Go

Gonum is a set of numeric libraries for the Go programming language. It contains libraries for matrices, statistics, optimization, and more

Project mention: What libraries are missing? | reddit.com/r/golang | 2022-12-16

Math libraries. It's just gonum right now. Missing things that often require people to link C or Python libs. E.g. https://github.com/gonum/gonum/issues/354
SonarLint

www.sonarlint.org
sponsored

Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.
pachyderm

4 5,867 9.8 Go

Data-Centric Pipelines and Data Versioning

Project mention: Show HN: We scaled Git to support 1 TB repos | news.ycombinator.com | 2022-12-13

There are a couple of other contenders in this space. DVC (https://dvc.org/) seems most similar.
If you're interested in something you can self-host... I work on Pachyderm (https://github.com/pachyderm/pachyderm), which doesn't have a Git-like interface, but also implements data versioning. Our approach de-duplicates between files (even very small files), and our storage algorithm doesn't create objects proportional to O(n) directory nesting depth as Xet appears to. (Xet is very much like Git in that respect.)
The data versioning system enables us to run pipelines based on changes to your data; the pipelines declare what files they read, and that allows us to schedule processing jobs that only reprocess new or changed data, while still giving you a full view of what "would" have happened if all the data had been reprocessed. This, to me, is the key advantage of data versioning; you can save hundreds of thousands of dollars on compute. Being able to undo an oopsie is just icing on the cake.
Xet's system for mounting a remote repo as a filesystem is a good idea. We do that too :)
octosql

23 4,419 8.3 Go

OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.

Project mention: Analyzing multi-gigabyte JSON files locally | news.ycombinator.com | 2023-03-18
bacalhau

3 256 10.0 Go

Compute over Data framework for public, transparent, and optionally verifiable computation

Project mention: GitHub | reddit.com/r/BacalhauProject | 2023-03-27
rtdl

0 41 7.0 Go

rtdl makes it easy to build and maintain a real-time data lake (by realtimedatalake)
gibberish

1 4 10.0 Go

A golang package and command line tool for the analysis and identification of gibberish text. (by prophittcorey)

Project mention: Show HN: A Go package to train and classify bogus text, usernames and emails | news.ycombinator.com | 2023-01-10
InfluxDB

www.influxdata.com
sponsored

Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-03-27.