parquet-go
parquet-go
| parquet-go | parquet-go | |
|---|---|---|
| 4 | 3 | |
| 333 | 1,170 | |
| - | - | |
| 0.0 | 4.2 | |
| 9 months ago | about 2 months ago | |
| Go | Go | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parquet-go
-
anyone have experience writing data to parquet files? Is there a better alternative for storing large amounts of financial tick data?
segmentio/parquet-go
-
Oracle DB support in Benthos
github.com/segmentio/parquet-go -> it's early days but his library is looking very promising for building applications that read or write parquet data, which was a major pain point not that long ago
-
ArcticDB: A Database for Observability
Finally seeing Apache Parquet and Apache Arrow used with Go efficiently and effectively!
Great job. Looking forward to exploring this more in the Prometheus and CNCF Ecosystem.
The underneath library used (https://github.com/segmentio/parquet-go) looks amazing too!
- High-performance Go library to manipulate parquet files
parquet-go
-
anyone have experience writing data to parquet files? Is there a better alternative for storing large amounts of financial tick data?
xitongsys/parquet-go
-
Consider Using CSV
> It's so complex to work with, that unless you're specifically in data science, it's both unheard of and unusable.
FWIW, in my experience at a "data analytics platform" company, it's reasonably popular for data-heavy workflows since Because Parquet is well-defined, and file sizes are a fraction of their CSV equivalents.
> Is it a limitation of the format itself?
I don't think so. In other languages, you can generally read/write Parquet files without a ton of dependencies (e.g. https://github.com/xitongsys/parquet-go).
-
parquet-tools
(Throwaway account) I built https://github.com/hangxie/parquet-tools, the original idea was from parquet-go, it is still the underlying lib for my implementation.
What are some alternatives?
ristretto - A high performance memory-bound Go cache
tad - A desktop application for viewing and analyzing tabular data
encoding - Go package containing implementations of efficient encoding, decoding, and validation APIs.
parquet-tools - Utility to deal with Parquet data
frostdb - ❄️ Coolest database around 🧊 Embeddable column database written in Go.
Apache Parquet - Apache Parquet
go-ora - Pure go oracle client
xsv - A fast CSV command line toolkit written in Rust.
Iris - The fastest HTTP/2 Go Web Framework. New, modern and easy to learn. Fast development with Code you control. Unbeatable cost-performance ratio :rocket:
marketstore - DataFrame Server for Financial Timeseries Data