tad
parquet-go
| tad | parquet-go | |
|---|---|---|
| 3 | 3 | |
| 3,016 | 1,171 | |
| - | - | |
| 7.3 | 4.2 | |
| 16 days ago | about 2 months ago | |
| TypeScript | Go | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tad
-
Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL
Very impressive project and vision! Love the demo!
I am also ex-GS and worked on what I am fairly sure is the table display tool you're describing. I tried to carry the essential aspects of that work (multi-level pivots, with drill-down to the leaf level, and all interactive events and analytics supported by db queries) to Tad (https://www.tadviewer.com/, https://github.com/antonycourtney/tad), another open source project powered by DuckDb.
An embeddable version of Tad, powered by DuckDb WASM, is used as the results viewer in the MotherDuck Web UI (https://app.motherduck.com/).
If you're interested in embedding Tad in Pretzel, or leveraging pieces of it in your work, or collaborating on other aspects of DuckDb WASM powered UIs, please get in touch!
- Building a database to search Excel files
-
Consider Using CSV
Since this is about CSV, this is obligatory tool for larger ones:
* https://github.com/antonycourtney/tad
parquet-go
-
anyone have experience writing data to parquet files? Is there a better alternative for storing large amounts of financial tick data?
xitongsys/parquet-go
-
Consider Using CSV
> It's so complex to work with, that unless you're specifically in data science, it's both unheard of and unusable.
FWIW, in my experience at a "data analytics platform" company, it's reasonably popular for data-heavy workflows since Because Parquet is well-defined, and file sizes are a fraction of their CSV equivalents.
> Is it a limitation of the format itself?
I don't think so. In other languages, you can generally read/write Parquet files without a ton of dependencies (e.g. https://github.com/xitongsys/parquet-go).
-
parquet-tools
(Throwaway account) I built https://github.com/hangxie/parquet-tools, the original idea was from parquet-go, it is still the underlying lib for my implementation.
What are some alternatives?
rill - Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.
parquet-go - Go library to read/write Parquet files
KeenWrite - Free, open-source, cross-platform desktop Markdown text editor with live preview, string interpolation, and math.
parquet-tools - Utility to deal with Parquet data
bsv - maximum performance data processing
Apache Parquet - Apache Parquet
js-bson - BSON Parser for node and browser
xsv - A fast CSV command line toolkit written in Rust.
duckdb-wasm - WebAssembly version of DuckDB
frostdb - ❄️ Coolest database around 🧊 Embeddable column database written in Go.
csv-to-ml - 🧌 Upload a CSV file and get an ML model
marketstore - DataFrame Server for Financial Timeseries Data