bincode
PyO3
Our great sponsors
bincode | PyO3 | |
---|---|---|
16 | 147 | |
2,512 | 10,947 | |
2.3% | 3.6% | |
6.9 | 9.8 | |
23 days ago | about 21 hours ago | |
Rust | Rust | |
MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bincode
-
Hey Rustaceans! Got a question? Ask here (14/2023)!
Ermm... actually I meant something like this: playground, but then I realized it's basically (de)serialization, and I just found that we already have a crate for that: bincode.
-
Convert a base-64 encoded, serialised, Rust struct to a Python class
One, figure out the bincode format (documented here: https://github.com/bincode-org/bincode/blob/trunk/docs/spec.md) and write your own parser. Maybe a one-off that specifically only handles this one data structure would be fairly straightforward.
-
impl serde::Deserialize... is it really that complicated?
Step 1: The Deserialize type requests data from the Deserializer with one of the deserialize_type methods. This gives it an opportunity to provide certain metadata about the type: structs provide a list of fields, enums provide a list of variants, tuples provide a length, etc. Some data formats (notably bincode) require this metadata to drive deserializing, as the wire format is not self-describing. Crucially, the Deserialize type also provides a visitor that is capable of receiving the requested data from the Deserializer.
-
A nicer way to pack this message?
Alternatively, give Bincode a try.
If you can use std, have you had a look at the crate [bincode](https://crates.io/crates/bincode)? If you can't use std, I've found the crate [bincode-nostd](https://crates.io/crates/bincode-no-std) which is old but maybe you can find something similar and more recent?
-
Hey Rustaceans! Got an easy question? Ask here (9/2022)!
Like separate instructions? I was thinking if a instruction have unknown length I make sure I have some kind of header field that tells the data length of the instruction so receiver knows when next instruction starts. And I was planning on using Bincode with serde to serialize and dezerialize like structs and stuff.
-
Easily converts a struct into Vec<u8> and back.
Isn't this essentially bincode?
-
Does rust have function works like eval?
This is similar in practice to using abi_stable, and end-users will still receive compiled files, but your plugins will be sandboxed and a single build will work on all platforms. The downside is that it's a bit more work because WebAssembly's support for passing complex data types between the host and the WebAssembly code is in the preliminary stages, so you need to do something like using Serde to encode your data into something like Bincode or MessagePack (or JSON and friends) to hand it off between the host and the plugin.
-
Netcode & ECS data organization
The network manager handles serializing it into a binary format (using the bincode crate https://crates.io/crates/bincode), sending it out to other clients on a separate IO thread etc. I'm not exactly sure how bincode handles the serializations, but it allows me to automatically derive ways for a struct (in this case, Snapshot) to be serialized and desterilized to/from raw bytes which can be sent/received over the network.
-
If you could re-design Rust from scratch today, what would you change?
I've built type-specific hacks to avoid this which produce up to 50% runtime improvements. Latest one is in this PR: https://github.com/bincode-org/bincode/pull/337. The standard library should provide a way to sidestep the copy through a pointer. Useful BufRead/BufWrite traits would be a good start.
PyO3
-
Encapsulation in Rust and Python
Integrating Rust into Python, Edward Wright, 2021-04-12 Examples for making rustpython run actual python code Calling Rust from Python using PyO3 Writing Python inside your Rust code — Part 1, 2020-04-17 RustPython, RustPython Rust for Python developers: Using Rust to optimize your Python code PyO3 (Rust bindings for Python) Musing About Pythonic Design Patterns In Rust, Teddy Rendahl, 2023-07-14
- Polars – A bird's eye view of Polars
-
In Rust for Python: A Match from Heaven
This story unfolds as a captivating journey where the agile Flounder, representing the Python programming language, navigates the vast seas of coding under the wise guidance of Sebastian, symbolizing Rust. Central to their adventure are three powerful tridents: cargo, PyO3, and maturin.
- Segunda linguagem
-
Calling Rust from Python
I would not recommend FFI + ctypes. Maintaining the bindings is tedious and error-prone. Also, Rust FFI/unsafe can be tricky even for experienced Rust devs.
Instead PyO3 [1] lets you "write a native Python module in Rust", and it works great. A much better choice IMO.
-
Python 3.12
Same w/ Rust and Python, this is really neat because now each thread could have a GIL without doing exactly what you said. The pyO3 commit to allow subinterpreters was merged 21 days ago, so this might "just work" today: https://github.com/PyO3/pyo3/pull/3446
-
Removing Garbage Collection from the Rust Language (2013)
I expected someone to write a rust-based scripting language which tightly integrated with rust itself.
In reality, it seems like the python developers and toolchain are embracing rust enough to reduce the benefits to a new alternative.
-
Bytewax: Stream processing library built using Python and Rust
Hey HN! I am one of the people working on Bytewax. Bytewax came out of our experience working with ML infrastructure at GitHub. We wanted to use Python because we could move fast, the team was very fluent in it, and the rest of our tooling was Python-native already. We didn't want to introduce JVM-based solutions into our stack because of the lack of experience and the friction we had trying to get Python-centric tooling working with existing solutions like Flink.
In our research, we found Timely Dataflow (https://timelydataflow.github.io/timely-dataflow/, https://news.ycombinator.com/item?id=24837031) and the Naiad project (https://www.microsoft.com/en-us/research/project/naiad/) as well as PyO3 (https://github.com/PyO3/pyo3) and we thought we found a match made in heaven :). Bytewax leverages both of these projects and builds on them to provide a clean API (at least we think so) and table stakes features like connectors, state recovery, and cloud-native scaling. It has been really cool to learn about the dataflow computation model, Rust, and how to wrangle the GIL with Rust and Python :P.
Would love to get your feedback :).
`pip install bytewax` to get started. We have a page of guides (https://www.bytewax.io/guides) with ready-to-run examples.
-
Tell HN: Rust Is the Superglue
You can practice your Rust skills by writing performant and/or gluey extensions for higher-level language such as NodeJS (checkout napi-rs) and Python or complementing JS in the browser if you target Webassembly.
For instance, checkout Llama-node https://github.com/Atome-FE/llama-node for an involved Rust-based NodeJS extension. Python has PyO3, a Rust-Python extension toolset: https://github.com/PyO3/pyo3.
They can help you leverage your Rust for writing cool new stuff.
-
Writing Python Like Rust
(2020).
Things have arguably become even nicer (although slightly more divergent between the two) since then: Python's `Optional[T]` can now be written as `T | None`, and the core container types can now be annotated directly (e.g. `List[T]` becomes `list[T]`).
Combined via pyO3[1], Python and Rust are a real joy to write together.
What are some alternatives?
serde - Serialization framework for Rust
rust-cpython - Rust <-> Python bindings
pybind11 - Seamless operability between C++11 and Python
msgpack-rust - MessagePack implementation for Rust / msgpack.org[Rust]
RustPython - A Python Interpreter written in Rust
milksnake - A setuptools/wheel/cffi extension to embed a binary data in wheels
uniffi-rs - a multi-language bindings generator for rust
rust-cbor - CBOR (binary JSON) for Rust with automatic type based decoding and encoding.
wasmtime - A fast and secure runtime for WebAssembly
egui - egui: an easy-to-use immediate mode GUI in Rust that runs on both web and native
nue - I/O and binary data encoding for Rust
py2many - Transpiler of Python to many other languages