parquet-wasm
datasette-stripe
parquet-wasm | datasette-stripe | |
---|---|---|
6 | 6 | |
464 | 20 | |
- | - | |
9.0 | 0.0 | |
3 days ago | almost 2 years ago | |
Rust | JavaScript | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parquet-wasm
- FLaNK AI Weekly for 29 April 2024
- Parquet-WASM: Rust-based WebAssembly bindings to read and write Parquet data
-
Goodbye, Node.js Buffer
nodejs-polars is node-specific and uses native FFI. polars can be compiled to Wasm but doesn't yet have a js API out of the box.
As for the fastest way to serialize data to Pandas data to the browser, you should use Parquet; it's the fastest to write on the Python side and read on the JS side, while also being compressed. See https://github.com/kylebarron/parquet-wasm (full disclosure, I wrote this)
-
Rust 1.63.0
I'm building WebAssembly bindings to existing Rust libraries [0] and lower-dependency geospatial tools [1]. Rust makes it very easy to bind rust code to both WebAssembly and Python. And by avoiding some large C geospatial dependencies we can get reliable performance in both wasm and Python using the exact same codebase.
[0]: https://github.com/kylebarron/parquet-wasm
[1]: https://github.com/kylebarron/geopolars
- Why isn’t there a decent file format for tabular data?
-
Recommendations when publishing a WASM library
Looks to be a great resource. I've been working on a WASM implementation of reading and writing Apache Parquet [0] and it's been difficult being new to WASM to find the best way of distributing the WASM that works on Node and through bundlers like Webpack.
[0]: https://github.com/kylebarron/parquet-wasm
datasette-stripe
-
Zed Shaw Explains How Stripe Is PayPal Circa 2010
If you want to analyse your payment failures with SQL you could use https://table.dog to download them into a SQLite database.
-
SQLite is not a toy database
https://table.dog is a CLI that downloads your Stripe account to a SQLite db.
Would appreciate it if you could test it out if you are interested.
-
Rust 1.63.0
https://table.dog (a CLI to download Stripe to SQLite).
I considered Node.js, C#.
I went with Rust for a few reasons:
- Easy to build small portable binaries (as a primary language feature).
- The type checker ensures type consistency when writing out to SQL tables (SQLite is loosely typed). Code that reads from the SQLite database implicitly benefits from Rusts strong type checks.
- Macros to convert structs to SQL insert/updates.
- Reduce the chance of errors at runtime.
- Leverage as much as SQLite's write throughput as possible.
- When converting Stripes Open API JSON spec into Rust code (using another Node.js program), the Rust type checker ensures I have a well formed HTTP client - the strict compiler makes it a good target for generated programs. Read more about this idea at (https://willcrichton.net/notes/rust-the-new-llvm/).
-
Show HN: Tdog – Download Stripe to SQLite
This is a CLI written in Rust to download your Stripe account to a local SQLite database.
It is intended to enable using SQL queries over your data.
There is also a template for fly.io and Datasette to give you a Sigma like web UI:
https://github.com/tabledog/datasette-stripe
- Show HN: Stripe Sigma alternative: tdog – SQLite – Datasette
What are some alternatives?
quickjs-emscripten - Safely execute untrusted Javascript in your Javascript, and execute synchronous code that uses async functions
mvsqlite - Distributed, MVCC SQLite that runs on FoundationDB.
transmitic - Encrypted, peer to peer, file transfer program :: https://discord.gg/tRT3J6T :: https://www.reddit.com/r/transmitic/ :: https://twitter.com/transmitic
enarx - Enarx: Confidential Computing with WebAssembly
geopolars - Geospatial extensions for Polars
sqlitedao - Simple dao for sqlite for personal/desktop projects
odiff - The fastest pixel-by-pixel image visual difference tool in the world.
tokio-scoped - Scoped Runtime for tokio
rson - Rust Object Notation
subscription-use-cases - Create subscriptions with fixed prices or usage based billing.
csvz - The hot new standard in open databases