The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 4 Go data-warehouse Projects
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
optimus
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management. (by raystack)
Go team does acknowledge [1] it as a bug, so there is some point here
However, that said, I wonder if OP (duckdb) could have written their solution [2] differently. Shouldn't they be able to select from a Pipe as well as Error channel simultaneously? (similar to how they are doing it inside here [3]). If not, I would have create a go-routine that does blocking read on the Pipe and then pass it on to another channel to select on.
[1] https://github.com/golang/go/issues/66239
[2] https://github.com/scratchdata/scratchdata/blob/7c1a0fcd0e20...
[3] https://github.com/scratchdata/scratchdata/blob/7c1a0fcd0e20...
You can check odpf github, they created some dataops tools using go, one of the example is optimus (https://github.com/odpf/optimus) which is a data pipeline orchestrator
Go data-warehouse related posts
- Debugging a Golang Bug with Non-Blocking Reads
- Show HN: ScratchDB – Open-Source Snowflake on ClickHouse
- Show HN: ScratchDB – Open-Source Snowflake on ClickHouse
- "There's a Dashboard for That" New Open Source Template for Bug Tracking
- We Built an Open Source DevOps Dashboard with Go (mostly!)
- Open Source & Free Dev Dashboard (900+ GitHub Stars in First Week!)
- Just Launched (900 GitHub Stars in One Week) Free Dev Dashboard!
-
A note from our sponsor - WorkOS
workos.com | 25 Apr 2024
Index
What are some of the best open-source data-warehouse projects in Go? This list will help you:
Project | Stars | |
---|---|---|
1 | Rudderstack | 3,926 |
2 | scratchdata | 1,027 |
3 | optimus | 737 |
4 | beneath | 78 |
Sponsored