js-bson
parquet-go
| js-bson | parquet-go | |
|---|---|---|
| 1 | 3 | |
| 1,100 | 1,170 | |
| 1.6% | - | |
| 8.1 | 4.2 | |
| 3 days ago | about 2 months ago | |
| TypeScript | Go | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
js-bson
parquet-go
-
anyone have experience writing data to parquet files? Is there a better alternative for storing large amounts of financial tick data?
xitongsys/parquet-go
-
Consider Using CSV
> It's so complex to work with, that unless you're specifically in data science, it's both unheard of and unusable.
FWIW, in my experience at a "data analytics platform" company, it's reasonably popular for data-heavy workflows since Because Parquet is well-defined, and file sizes are a fraction of their CSV equivalents.
> Is it a limitation of the format itself?
I don't think so. In other languages, you can generally read/write Parquet files without a ton of dependencies (e.g. https://github.com/xitongsys/parquet-go).
-
parquet-tools
(Throwaway account) I built https://github.com/hangxie/parquet-tools, the original idea was from parquet-go, it is still the underlying lib for my implementation.
What are some alternatives?
tad - A desktop application for viewing and analyzing tabular data
parquet-go - Go library to read/write Parquet files
parquet-tools - Utility to deal with Parquet data
Apache Parquet - Apache Parquet
xsv - A fast CSV command line toolkit written in Rust.
frostdb - ❄️ Coolest database around 🧊 Embeddable column database written in Go.
marketstore - DataFrame Server for Financial Timeseries Data
KeenWrite - Free, open-source, cross-platform desktop Markdown text editor with live preview, string interpolation, and math.
bsv - maximum performance data processing
ndjson.github.io - Info Website for NDJSON