AwesomeCSV
🕶️A curated list of awesome tools for dealing with CSV. (by secretGeek)
parquet-wasm
Rust-based WebAssembly bindings to read and write Apache Parquet data (by kylebarron)
| AwesomeCSV | parquet-wasm | |
|---|---|---|
| 1 | 6 | |
| 658 | 472 | |
| - | - | |
| 3.0 | 9.0 | |
| 24 days ago | 1 day ago | |
| PowerShell | Rust | |
| Creative Commons Zero v1.0 Universal | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
AwesomeCSV
Posts with mentions or reviews of AwesomeCSV.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-05-03.
-
Why isn’t there a decent file format for tabular data?
One major limitation with quoted values that can this contain record delimiters (as opposed to escaping the delimiters) is that it stops systems from being able to load records in parallel.
Some systems ban embedded record delimiters, for this reason.
Btw, I’ve (previously) included at least one of your essays in “awesome csv” list at GitHub. https://github.com/secretGeek/AwesomeCSV#essays
There’s a few specs mentioned there too — is one of those the spec you worked on?
parquet-wasm
Posts with mentions or reviews of parquet-wasm.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-04-29.
- FLaNK AI Weekly for 29 April 2024
- Parquet-WASM: Rust-based WebAssembly bindings to read and write Parquet data
-
Goodbye, Node.js Buffer
nodejs-polars is node-specific and uses native FFI. polars can be compiled to Wasm but doesn't yet have a js API out of the box.
As for the fastest way to serialize data to Pandas data to the browser, you should use Parquet; it's the fastest to write on the Python side and read on the JS side, while also being compressed. See https://github.com/kylebarron/parquet-wasm (full disclosure, I wrote this)
-
Rust 1.63.0
I'm building WebAssembly bindings to existing Rust libraries [0] and lower-dependency geospatial tools [1]. Rust makes it very easy to bind rust code to both WebAssembly and Python. And by avoiding some large C geospatial dependencies we can get reliable performance in both wasm and Python using the exact same codebase.
[0]: https://github.com/kylebarron/parquet-wasm
[1]: https://github.com/kylebarron/geopolars
- Why isn’t there a decent file format for tabular data?
-
Recommendations when publishing a WASM library
Looks to be a great resource. I've been working on a WASM implementation of reading and writing Apache Parquet [0] and it's been difficult being new to WASM to find the best way of distributing the WASM that works on Node and through bundlers like Webpack.
[0]: https://github.com/kylebarron/parquet-wasm