parquet-wasm
transmitic
parquet-wasm | transmitic | |
---|---|---|
6 | 16 | |
464 | 57 | |
- | - | |
9.0 | 7.2 | |
3 days ago | 2 months ago | |
Rust | HTML | |
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parquet-wasm
- FLaNK AI Weekly for 29 April 2024
- Parquet-WASM: Rust-based WebAssembly bindings to read and write Parquet data
-
Goodbye, Node.js Buffer
nodejs-polars is node-specific and uses native FFI. polars can be compiled to Wasm but doesn't yet have a js API out of the box.
As for the fastest way to serialize data to Pandas data to the browser, you should use Parquet; it's the fastest to write on the Python side and read on the JS side, while also being compressed. See https://github.com/kylebarron/parquet-wasm (full disclosure, I wrote this)
-
Rust 1.63.0
I'm building WebAssembly bindings to existing Rust libraries [0] and lower-dependency geospatial tools [1]. Rust makes it very easy to bind rust code to both WebAssembly and Python. And by avoiding some large C geospatial dependencies we can get reliable performance in both wasm and Python using the exact same codebase.
[0]: https://github.com/kylebarron/parquet-wasm
[1]: https://github.com/kylebarron/geopolars
- Why isn’t there a decent file format for tabular data?
-
Recommendations when publishing a WASM library
Looks to be a great resource. I've been working on a WASM implementation of reading and writing Apache Parquet [0] and it's been difficult being new to WASM to find the best way of distributing the WASM that works on Node and through bundlers like Webpack.
[0]: https://github.com/kylebarron/parquet-wasm
transmitic
-
Rust Cryptography Should Be Written in Rust
I use it for a desktop file transfer app [0]. I chose Rust because my primary language is Python and I just wanted to learn something new and really different for this project. Go would have been easier, but Rust just feels bullet proof. It's so strict. If it compiles, it works! It's been a very interesting journey.
[0] https://github.com/transmitic/transmitic
- Looking for file-transfer software that can easily traverse NAT
- Transmitic v0.12.0 released! Reverse Connections
- Transmitic v0.11.1 released! Shared With Me perf improvements
- Transmitic v0.11.0 released! Optional encrypted config
- Transmitic v0.10.6 released! UI and perf improvements
- Transmitic v0.10.5 macOS support released!
- Transmitic v0.10.5 released! Linux support
- Transmitic v0.10.4 released!
-
Rust 1.63.0
I've built a p2p file transfer program [0]. All my development experience had been in Python, but I really wanted to try a statically typed, low level language, and decided to give rust a try.
It was hard to get going, and I still only know basics, but everything just works! Typing, borrow checker, the matched results, all of that makes code bullet proof.
[0] https://github.com/transmitic/transmitic
What are some alternatives?
datasette-stripe - A web SQL interface to your Stripe account using Datasette.
quickjs-emscripten - Safely execute untrusted Javascript in your Javascript, and execute synchronous code that uses async functions
Airshare - Cross-platform content sharing in a local network
geopolars - Geospatial extensions for Polars
polkadot-sdk - The Parity Polkadot Blockchain SDK
odiff - The fastest pixel-by-pixel image visual difference tool in the world.
rson - Rust Object Notation
tokio-scoped - Scoped Runtime for tokio
csvz - The hot new standard in open databases
enarx - Enarx: Confidential Computing with WebAssembly