parquet-tools
parquet-go
parquet-tools | parquet-go | |
---|---|---|
1 | 3 | |
31 | 1,170 | |
- | - | |
8.3 | 4.2 | |
7 days ago | about 2 months ago | |
Go | Go | |
BSD 3-clause "New" or "Revised" License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parquet-tools
-
parquet-tools
(Throwaway account) I built https://github.com/hangxie/parquet-tools, the original idea was from parquet-go, it is still the underlying lib for my implementation.
parquet-go
-
anyone have experience writing data to parquet files? Is there a better alternative for storing large amounts of financial tick data?
xitongsys/parquet-go
-
Consider Using CSV
> It's so complex to work with, that unless you're specifically in data science, it's both unheard of and unusable.
FWIW, in my experience at a "data analytics platform" company, it's reasonably popular for data-heavy workflows since Because Parquet is well-defined, and file sizes are a fraction of their CSV equivalents.
> Is it a limitation of the format itself?
I don't think so. In other languages, you can generally read/write Parquet files without a ton of dependencies (e.g. https://github.com/xitongsys/parquet-go).
-
parquet-tools
(Throwaway account) I built https://github.com/hangxie/parquet-tools, the original idea was from parquet-go, it is still the underlying lib for my implementation.
What are some alternatives?
gpq - Utility for working with GeoParquet
parquet-go - Go library to read/write Parquet files
dsq - Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more.
tad - A desktop application for viewing and analyzing tabular data
Apache Parquet - Apache Parquet
parquet - A library for reading and writing parquet files.
xsv - A fast CSV command line toolkit written in Rust.
rill - Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.
frostdb - ❄️ Coolest database around 🧊 Embeddable column database written in Go.
marketstore - DataFrame Server for Financial Timeseries Data
js-bson - BSON Parser for node and browser