parquet-wasm
zero-to-production
parquet-wasm | zero-to-production | |
---|---|---|
6 | 85 | |
464 | 5,087 | |
- | - | |
9.0 | 4.0 | |
3 days ago | about 1 month ago | |
Rust | Rust | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parquet-wasm
- FLaNK AI Weekly for 29 April 2024
- Parquet-WASM: Rust-based WebAssembly bindings to read and write Parquet data
-
Goodbye, Node.js Buffer
nodejs-polars is node-specific and uses native FFI. polars can be compiled to Wasm but doesn't yet have a js API out of the box.
As for the fastest way to serialize data to Pandas data to the browser, you should use Parquet; it's the fastest to write on the Python side and read on the JS side, while also being compressed. See https://github.com/kylebarron/parquet-wasm (full disclosure, I wrote this)
-
Rust 1.63.0
I'm building WebAssembly bindings to existing Rust libraries [0] and lower-dependency geospatial tools [1]. Rust makes it very easy to bind rust code to both WebAssembly and Python. And by avoiding some large C geospatial dependencies we can get reliable performance in both wasm and Python using the exact same codebase.
[0]: https://github.com/kylebarron/parquet-wasm
[1]: https://github.com/kylebarron/geopolars
- Why isn’t there a decent file format for tabular data?
-
Recommendations when publishing a WASM library
Looks to be a great resource. I've been working on a WASM implementation of reading and writing Apache Parquet [0] and it's been difficult being new to WASM to find the best way of distributing the WASM that works on Node and through bundlers like Webpack.
[0]: https://github.com/kylebarron/parquet-wasm
zero-to-production
-
Empowering Web Privacy with Rust: Building a Decentralized Identity Management System
Zero to Production in Rust - Book by Luca Palmieri: An in-depth book that guides readers through building a fully functional backend application in Rust, from zero to production.
-
Rust books to read
And the book "Zero To Production In Rust - An introduction to backend development", I didn’t read it yet but seems pretty good
-
How to read a YAML configuration file in my Rust service?
It’s a lot simpler if you add serde to the mix (derive Deserialize for your settings types). Have a look at the example from the Zero to Production book: https://github.com/LukeMathWalker/zero-to-production/blob/main/src/configuration.rs
-
Ask HN: What to use for a Rest API written in Rust?
You probably want to check out the Zero to Production book which is about using Rust for back-end development.
https://www.zero2prod.com/
-
I’ve fallen in love with rust so now what?
If your'e more into a tutorial with a book https://www.zero2prod.com/ is really good. You gonna build a newsletter service. With all the good stuff in backend development.
-
Hyper – A fast and correct HTTP implementation for Rust
If you want to build a backend in Rust, Axum (which uses hyper underneath) is pretty recommended these days, as it's all in the tokio ecosystem. Actix Web is good too, but it has its own ecosystem of libraries. I read the book Zero To Production in Rust [0] which was a great overview on not just Rust but scalable backend architectures as a whole.
Interestingly, Cloudflare wanted to use hyper but found that it was too correct, so they had to build their own [1].
[0] https://www.zero2prod.com
[1] https://blog.cloudflare.com/how-we-built-pingora-the-proxy-t...
-
Conversion?
In addition to the book, which has already been recommended. If you’re specifically into backend you should try Zero to Production. Luca really knows what he’s talking about, and it’s an excellent overview of backend rust and the development process in general.
-
Do you know any programming tutorials where somebody explains how to write an app from the architecture point of view?
I highly recommend the book Zero to Production in Rust which also has an associated GitHub. I like the style of the writing and the explanations used within the book. Even though it uses Rust, the concepts seem to work in any language - I have applied the concepts to both Go and Python in the past.
-
Opensource to learn from?
I would recommend you a book - "Zero to Production in Rust" https://www.zero2prod.com/
-
Simple projects to practice Rust?
if you want to learn more about web backend development there is nothing better then https://www.zero2prod.com/
What are some alternatives?
datasette-stripe - A web SQL interface to your Stripe account using Datasette.
rust-by-example - Learn Rust with examples (Live code editor included)
quickjs-emscripten - Safely execute untrusted Javascript in your Javascript, and execute synchronous code that uses async functions
realworld-axum-sqlx - A Rust implementation of the Realworld demo app spec using Axum and SQLx.
transmitic - Encrypted, peer to peer, file transfer program :: https://discord.gg/tRT3J6T :: https://www.reddit.com/r/transmitic/ :: https://twitter.com/transmitic
axum - Ergonomic and modular web framework built with Tokio, Tower, and Hyper
geopolars - Geospatial extensions for Polars
black-hat-rust - Applied offensive security with Rust - https://kerkour.com/black-hat-rust
odiff - The fastest pixel-by-pixel image visual difference tool in the world.
rust-blog - Educational blog posts for Rust beginners
rson - Rust Object Notation
tour_of_rust - A tour of rust's language features